Events storage and analysis with Riak at Booking.com

High Availability
22 September 5:20PM - 6:10PM @ Matterhorn 3

Duration: 
50 minutes conference
At Booking.com, we have a constant flow of events coming from various applications and internal subsystems. This critical data needs to be stored for real-time, medium and long term analysis. Events are schema-less, making it difficult to use standard analysis tools. This presentation will explain how we built a complete storage and real-time analysis solution from scratch, based on Riak. I will cover: - presentation of our events pipeline - data serialization and why we created our own format, - Riak configuration, - solutions for lowering the cluster's internal network usage - finally, real-time analysis on Riak using advanced features


Speakers

Software Engineer, Booking.com
Damien Krotkine is a software engineer at Booking.com (world’s leading online hotel and accommodation reservations company). He currently works on the events subsystem, where he helps gathering, storing, managing and analyzing big quantities of data in real-time. Previously, he has been working in various fields like Linux Distribution, e-commerce, online real-time advertising. He's an active member of the Perl community, maintaining some NoSQL related modules ( Redis driver, Riak client, Bloomd client ... )

Slides