Once you are done with this one, you probably will want to read Part 2. I don’t think I’d pass this interview (my C++ abilities are close to 0, and my C knowledge is basic) but the approach to solving… I’ve been doing this for more than 15 years!
You have to have your own definition of doing your best work. You can do your best work with a client and they can still struggle to make progress. You are not in control of their behavior; you are only in control of your own behavior.
I have been thinking (for more than 2 years) that Spark can be considered just another SQL engine that just happens to have Scala, Python and more lower-level APIs. At a previous company we migrated a SQL workflow from running in Redshift to (directly) running on SparkSQL in Databricks and it was painless, just making sure the same data source tables were present in both.
This looks like an improvement to the writing culture Amazon advocates for (the 6 page memo). I’m a big proponent of more and better writing and the problems mentioned here are why some people (and companies) hate writing.