Airbnb: Capturing Data Evolution in a Service-Oriented Architecture

medium.com

Web-scale companies have been solving the problem of consistent state management across microservice architectures for years now. (Kafka originally grew out of this need from within Linkedin!) But each attempt builds on the efforts that came before it, and as such, gets more and more fully-featured.

This post outlines Airbnb's approach for change data capture called SpinalTap. It is impressive, to say the least. The article is excellent, so I'll let them describe it there. The thing I was most impressed by was the work they've done on continuous data validation.

This is far beyond what most other companies have in place. Airbnb has open sourced-several of the components (link at the bottom of the article).

Read more...
Linkedin

Want to receive more content like this in your inbox?