Spotify: The Winding Road to Better ML Infrastructure

labs.spotify.com

Spotify has used Machine Learning for over a decade but being systematic about the development and deployment of Machine Learning is a recent introduction.

This post goes quite deep on Spotify's ML infrastructure. If you're into that sort of thing, it's a great post. If not, here's what I found interesting:

  • Kubeflow, which I first heard about a year ago, has apparently had a great year. The ecosystem has grown and matured, and Spotify has settled on it as a foundational layer of their ML infra.
  • Even companies that have cutting edge ML capabilities are still just figuring out how to scale and operate these systems and the associated teams of software engineers. We are still at the early part of the S curve.

Read more...
Linkedin

Want to receive more content like this in your inbox?