WePay | Waltz: A Distributed Write-Ahead Log


Very interesting!

We are happy to announce the open source release of Waltz. (...) Waltz is what we describe as a write-ahead log. This recorded log is neither the output of a change-data-capture from a database nor a secondary output from an application. It is the primary information of the system state transition. This is different from a typical transaction system built around a database system where the database is the source of truth. In the new model, the log is the source of truth (the primary information), and the database is derived from the log (the secondary information).

This is similar to Kafka in concept, but Waltz provides different guarantees and can therefore be used for different applications:

Waltz is similar to existing log systems like Kafka in that it accepts / persists / propagates transaction data produced / consumed by many services. However, unlike other systems, Waltz provides a machinery that facilitates a serializable consistency in distributed applications.

This just came out. Could be a big deal.


Want to receive more content like this in your inbox?