2017: Year in Review
9 minutes read | 1743 words by Ruben BerenguelI am trying to make these posts a tradition (even if a few days late). I thought 2016 had been a really weird and fun year, but 2017 has beaten it easily. And I only hope 2018 will be even better in every way. For the record, when I say we, it means Laia and me unless explicitly changed.
Work
Everything work related has gone up. More work, better work, more interesting work. Good, isn’t it?
As far as my consulting job in London, the most relevant parts would be:
- Lead a rewrite and refactor of the adserver (Golang) to improve speed and reliability.
- Migrated a batch job from Apache Pig to Apache Spark to be able to cope with larger amounts of data from third parties (now we process 2x the data with 1/10th of the cost).
- Planned an upgrade of our Kafka cluster from Kafka 0.8.2 to Kafka 0.10.1, which we could not execute as well as planned because the cluster went down. Helped save that day together with the director of engineering when that happened.
- Was part of the hiring team, we’ve had one successful hire this year (passed probation, is an excellent team member and loves weird tech). We hope to enlarge our team much more in the coming year.
- Put a real time service in Akka in production, serving and evaluating models generated by a Spark batch job.
We also moved offices, now we have a free barista “on premises”. Free, good quality coffee is the best that can be done to improve my productivity.
In April I got new business cards (designed by Laia, you can get your own design if you want, contact her):
I kept on helping a company with its SEO efforts, and as usual patience works. Search traffic has improved 30% year-to-year, so I’m pretty happy with it. Let’s see what the new year brings.
I became technical advisor of a local startup (an old friend, PhD in maths is a founder and works there as data scientist/engineer/whatever), trying to bring data insights to small and medium retailers. I help them with technology decisions where I have more hand-to-hand experience, or know where the industry is moving.
Life
Traveling up and down as usual (2-3 weeks in London, then l’Arboç, then maybe somewhere else…) sprinkled with some conferences and holidays.
Regarding life, the universe and everything, what I’ve done and where I’ve been
- In February we visited Hay-on-Wye again, for my birthday
- In March I convinced Holden Karau (was easy: she loves talking about Spark :D) to be one of our great keynote speakers at PyData Barcelona 2017
- In late March we visited Edinburgh and Glasgow
- In early May I attended PyData London to be able to prepare better for ours. Met some great people there.
- A bit later in May I visited Lisbon for LX Scala, thanks Jorge and the rest for the great work
- And at the end of May, we held PyData Barcelona 2017, where I was one of the organisers. We had more than 300 attendees, enjoying a lot of interesting talks. Thanks to all attendees and the rest of the organising committee… We made a hell of a great conference
- Mid-June, I gave my first meetup presentation, Snakes and Ladders (about typing in Python as compared with Scala) in the PyBCN meetup
- In late June, we visited Cheddar and Wells
- In September I visited Penrith for the awesome (thanks Jon) Scala World 2017. Looking forward to the 2019 edition.
- In early October we visited San Sebastian for the Python San Sebastian 2017 conference. We ate terribly well there (we can recommend Bodegón Alejandro as one of the best places to eat anywhere in the world now)
- Mid-October we visited Bletchley Park. Nice.
- In late October we (Ernest Fontich and myself) submitted our paper Normal forms and Sternberg conjugation theorems for infinite dimensional coupled map lattice. Now we need to wait.
- In November we visited Brussels (Ghent and Brugge too), and took an unofficial tour of the European Council with a friend who works there.
- In December I attended for the second time Scala Exchange, and the extra community day (excellent tutorials by Heiko Seeberger and Travis Brown). Was even better than last year (maybe because I knew more people?) and I already got my tickets for next year.
- In December we attended a wine and cheese pairing (with Francesc, our man in Brussels, and Laia) at Parés Baltà. They follow biodynamic principles (no herbicides, as natural as they can get, etc) and offer added sulfite free wines, too. They are excellent: neither Laia nor I drink, and we bought 4 bottles of their wines and cavas.
Last year I decided to start contributing to open source software this year, and I managed to become a contributor to the following projects:
- Apache Spark
- PureConfig
- ScalaFix
- ScalaFmt (well is still pending review and I need to work a bit more on it… had forgotten!)
- Impromptu (a very small thing in a very interesting library, PR merged as I write these lines, technically it was my first PR in 2018)
- Scala Native (the merit goes to Guillaume Massé, I just wrote a POC)
- Spark-Testing-Base
I wanted to contribute to the Go compiler code base, but didn’t find an interesting issue. Maybe this year.
Learning
This year I didn’t push courses/learning as strongly as last year… Or at least this is what I thought before writing this post.
- In January I enrolled in the Functional Programming in Scala specialisation in Coursera. Only course left is the Capstone project, I will be finishing this January if nothing goes wrong
- During Spring I took Udacity’s Deep Learning Nanodegree Foundation
- In May I took a spoon carving course with Forest+Found (they are the authors of The Urban Woodsman and The Wild Dyer)
- In August I took Apache Kafka Series - Learn Apache Kafka for Beginners, with the rest of the courses in the series waiting for me having more time available.
- In September I tried to learn knitting and lace, but it does not seem to suit me.
- In September I enrolled in a weekly Taichi and Qi Gong course by Mei Quan Tai Chi. Will repeat for the next term
- In December I started learning about Cardistry
Reading
I have read slightly less than last year (36 books vs 44 last year), and the main victim has been fiction. Haven’t read much, and the best… has been the re-read of Zelazny’s Chronicles of Amber. Still excellent. I have enlarged my collection of Zelazny books, now I have more than 30.
As far as non-fiction goes, I have specially enjoyed:
- Essentialism: given how many things I do at once, this book felt quite refreshing
- Rich dad, poor dad: Nothing too fancy, just common sense. Invest on having assets (money-generating items) instead of liabilities (money-sucking items, like the house you live in)
- 10% Entrepreneur: Links very well with the above. Being a 10% entrepreneur is a natural way to invest in your assets.
- The Checklist Manifesto: Checklists are a way to automate your life. I have read several books around this concept (“creating and tweaking systems”, as a concept) and it resonates with me. If I can automate (even if I’m the machine), it’s a neat win.
- The Subtle Art of Not Giving a F*ck: Recommended read. For no particular reason. I’ve heard that the audiobook version is great, too.
Music/events
This year I have listened mostly to Sonata Arctica. We attended their concert in Glasgow (March) and it was awesome, they are really good live. This was a build up for KISS at the O2 in London (May) which was totally terrific. And followed by Bat Out of Hell (opening day!) in London. It was great, and probably the closest I’ll ever be to listening Meat Loaf live. Lately I’ve been listening to a very short playlist I have by Loquillo, and also Anachronist.
We have also attended a performance by Penn and Teller (excellent), and IIRC we have also watched just one screening: The Last Jedi (meh, but Laia liked it).
Gadgets
This year I have gotten hold of a lot of gadgets. I mention only the terribly useful or interesting
- From last year, iPhone 7 “small”. Not happy with it. Battery life sucks big time, I got a external Mophie battery for it.
- Mid-year: Apple Watch Series 2. Pretty cool, and more useful than I expected.
- Late this year: AirPods. THEY ARE AWESOME
- Laptop foldable cooling support. While taking the deep learning course my Air got very hot, and I needed some way to get it as cool as possible.
- Nutribullet. My morning driver is banana, Kit Kat chunky, milk, golden flax seed, guarana.
- Icebreaker merino underwear. I sweat a bit, and get easily chaffed on the side of my legs (where it contacts my underwear). Not any more: not only is wool better at sweat-handling, but the fabric also feels better on the skin. And not, does not feel hot in the summer.
- Double Edge Shaving. I hated shaving (and actually just kept my beard trimmed so it was never a real beard or a clean shave…) and this razor (not this one specifically, safety razors are pretty much all the same) has changed that. Now I shave regularly and enjoy it a lot (together with this soap and this after shave balm)
- Chilly bottles. They work really well to keep drinks cold or hot. I’ll be getting their food container soon.
- Plenty of lightning cables. You can never have enough of these. I also got this great multi-device charger, ideal for traveling.
- Compact wallet. I’ve been shown the ads so many times I finally moved from my Tyvek wallets to one from Bellroy. It is very good.
- Book darts. Small bookmarks that don’t get lost, look great and can double as line markers. Also, they don’t add bulk to a book, so you can have many in the same book without damaging it at all. They are great, I’m getting a second tin in my next Amazon order of stuff.
- Two frames from an artist I saw showcased in our previous office (they had exhibits downstairs). Blue Plaque Doors and Hatchard’s, by Luke Adam Hawker.
On the fun side, I also have a spiral didgeridoo, a proper Scottish bagpipes, a Lego Mindstorms I have not played with yet :( and an Arduboy. Oh, and a Raspberry Pi Zero Wireless.
- London
- emacs
- Linux
- Music
- Trips
- Python
- Christmas
- Time Management
- iPad
- Maths
- Books
- Programming
- Apache Spark
- SEO
- Scala
- Productivity
- github
- Kafka