Percona Live: Open Source Database Performance Conference - Amsterdam 2016 Logo

October 3-5, 2016

Amsterdam, Netherlands

Processing 11 billions events a day with Spark in Badoo

Processing 11 billions events a day with Spark in Badoo

 5 October 2:40 PM - 3:05 PM @ Winterthur
Experience level: 
Beginner
Duration: 
25 minutes conference
Tracks:
OSDBMS
Architecture/Design
Topics:
Hadoop
Spark
Tools and Techniques

Description

Most of contemporary information systems have a stream of some events (payments, likes, votes, messages etc.). Without being able to measure this information flow, it is useless. And there is no problem, if event rate is not very high, or event stream should be measured in short-term windows, e.g. there is no need in distributed information processing. In our talk we'll cover the following aspects: 1.) How to organize the event stream 2.) Which types of analysis can be performed over it 3.) What kind of instruments Badoo uses to solve it's needs in near-realtime event processing

Speakers

Alexander Krasheninnikov's picture

Alexander Krasheninnikov

Head of Data Team, Badoo

Biography:

Experience in web development for 10 years.

Share this talk


Slides