Modern Data Practice and the SQL Tradition

In this essay, I collected some of my thoughts on the topic of SQL and how it fits into modern data practice. It was motivated after a wave of disbelief I faced when at a presentation last week I claimed that modern data projects could benefit immensely by adopting SQL early on and sticking with it: a “start with SQLite, scale with Postgres” philosophy.

I had not read Florents Tselai but am now an immediate fan for life. This post is a perspective from a data engineer / scientist who wants to see people utilize SQL more heavily in their data pipelines. My only difference in perspective is that I think it typically makes sense to skip Postgres and go straight to RS/BQ/SF. Same advantages, much greater scalability.


Want to receive more content like this in your inbox?