Percona Live: Open Source Database Performance Conference - Amsterdam 2016 Logo

October 3-5, 2016

Amsterdam, Netherlands

MySQL configuration generation at Dropbox

MySQL configuration generation at Dropbox

 4 October 12:20 PM - 1:10 PM @ Zürich 2
Experience level: 
Intermediate
Duration: 
50 minutes conference
Tracks:
Operations and Management
MySQL
Topics:
MySQL
Python
Devops

Description

Managing configuration for 1000s of database servers is hard, "hotfix" like set globals are easily forgotten, configuration rollouts can be complicated. At dropbox, instead of using puppet of chef (we use both), we wrote our own configuration handler for managing mysql configuration. This talk is about the overall architecture of the configuration generator we use. We will discuss the design decisions, and what special properties do we get from our configuration manager from knowing that it will only be managing mysql configurations. We still use puppet, we will also discuss what are the use cases where we didn't want to write our own solution. Dropbox has grown enormously since launching in 2008, surpassing 500 million signups and 500 petabytes of user data. Our Databases team of SREs manage thousands of MySQL servers which requires a deep understanding of MySQL, automation, Linux, Python, Go, hardware, performance tuning, monitoring and reliability.

Speakers

Peter Boros's picture

Peter Boros

Storage SRE - databases, Dropbox

Biography:

Peter joined Dropbox's database team in February 2016, has a strong interest in automation and performance tuning. Before joining Dropbox, among many other things, he was Principal Architect at Percona, worked at Sun Microsystems, specialized there in performance tuning and was a DBA at Hungary's largest social networking site. He also taught many Oracle University MySQL courses. He has been using and working with open source software from early 2000s. He currently lives in Dublin, Ireland with his wife and son.

Viacheslav Bakhmutov's picture

Viacheslav Bakhmutov

SRE, Dropbox

Biography:

Slava joined Dropbox's database team in September 2015 as Site Reliability Engineer. Before joining Dropbox, he worked at Yandex, the biggest Russian IT company. He currently lives in Dublin, Ireland.

Share this talk


Slides