The Flattened Data Engineering Reading List

Resources for data engineers

I have over the last years assembled knowledge on how to build data processing systems, by reading and watching others, trying things that turned out to be mistakes, and occasionally hitting good spots. I believe in sharing things, so I will put pieces out on my web site, gradually building a resource site for data engineers. The first piece is a data engineering reading & watching list with the articles, books, and presentations I find to be most valuable or influential.

I am also sharing slides and videos of presentations that I have held in the last years. This spring, I held a presentation at Jfokus 2016 on how to build end-to-end processing solutions, which serves as a starting guide for anyone aspiring to build data-centric products. The slides and video are on SlideShare. Among my presentations on SlideShare are also slide decks on how to organise teams for building successful data processing applications, functional patterns in software architecture (mostly data processing architecture), as well as approximate counting techniques.

In the next sharing phase, I aim to collect pieces in a structured manner, in the form of a resource site. The first piece is a reading and watching list with the articles, books, and presentations I find to be most valuable or influential.

Happy reading: lotsOfResources flatMap { _.allGoodLinks }