/events @ Box: Using HBase as a Message Queue
Box's /events API powers our desktop sync experience and provides users with a realtime, guaranteed-delivery event stream reflecting all of the activity happening inside their accounts. To support this functionality, we chose to leverage HBase to store and serve a separate message queue for each of our 30+ million users. This talk will cover how we implemented queue semantics on top of HBase, how we were able to replicate our queues between clusters to enable transparent client failover in the event of a complete HBase cluster outage, and why we chose to build a queuing system on top of HBase rather than leveraging a pre-existing system.
Staff Software Engineer, Box
David is a Staff Software Engineer at Box, where he's spent the past four years working on the infrastructure powering the company's desktop sync experience. He's currently building out Box's new HBase-backed guaranteed-delivery messaging infrastructure. Prior to Box, David worked at a small mobile telecom company building 3G network switches.