Change Data Capture (CDC) on Top of Statement-Based Replication (SBR)

Yes, that’s right, here at Box, we were able to successfully create a Change Data Capture stream on top of Statement-based Replication. Although normally impossible, some quirks in our data access layer coupled with some unique usages of MySQL​ query comments, PGTID and Kafka have enabled us to successfully provide an at-least-once delivery event stream of changes in our sharded MySQL infrastructure. The sharded MySQL​ infrastructure lies at the heart of Box.com, made up of 100s of shards, 1000s of servers and billions of records. In this talk, I will take you through the implementation details as well as the challenges involved in building out our change stream. Speaker: Venkat Morampudi – Box