Build a distributed big data reconciliation engine using Amazon EMR and Amazon Athena | Amazon Web Services

Direct Energy, an energy services provider, migrated their on-premises SQL Server data warehouse to AWS data lakes, but they needed a way to be sure that the data in their new data lake matched the data in their internal systems. They developed a system called Pythagoras to compare data in the two systems, using Amazon EMR and Athena.


Want to receive more content like this in your inbox?