Percona Live 2017 Open Source Database Conference

April 24 - 27, 2017

Santa Clara, California

SmyteDB: Poor Man's Distributed Database Built with Kafka and RocksDB

SmyteDB: Poor Man's Distributed Database Built with Kafka and RocksDB

 25 April - 5:15 PM - 5:40 PM @ Ballroom D
Experience level: 
Intermediate
Duration: 
25 minutes conference
Tracks:
Developer
Topics:
RocksDB
Other OSDB
NoSQL
Replication

Description

Smyte is building a fraud and spam detection platform that analyzes all of the traffic running through busy consumer websites and mobile apps. In this talk I'm going to describe how we build our own distributed database, SmyteDB, by integrating Kafka with RocksDB. In our design, Kafka enables us to support database replication and linearization without reinventing distributed primitives. Meanwhile, RocksDB's unique data model allows us to customize the storage layer for a wide variety of operations such as counting and list membership.

Speakers

Yunjing Xu's picture

Yunjing Xu

Engineering, Smyte

Biography:

-

Share this talk