This year the Cassandra team in Instagram has been working on a very interesting project to make Apache Cassandra's storage engine pluggable, and implemented a new RocksDB-based storage engine into Cassandra. The new storage engine can improve the performance of Apache Cassandra significantly, make Cassandra 3-4 times faster in general, and even 100 times faster in some use cases.
In this talk, we will describe the motivation and different approaches we have considered, the high-level design of the solution we choose, also the performance metrics in benchmark and production environments.
I'm a software engineer in Instagram Cassandra team. I'm also a Apache Cassandra Committer. We are working on projects to improve Apache Cassandra database, and provide a general key value data storage solution for Instagram. Before that, I worked at Data infrastructure team in Facebook.