How to detect the origin of data quality issues that will impact your analytics pipeline while still deploying services fast in Kafka | by Michael E Colley | Sep, 2021 | Medium

medium.com

Turnstyl is an NPM package built to work with Kafka and other message brokers to allow you to compare the data schema input at the producer level to what arrives in your data warehouse downstream. It integrates with Big Query and Kafka to make sure your output matches your input.

Read more...
Linkedin

Want to receive more content like this in your inbox?