Ghostferry: the Swiss Army Knife of Live Data Migrations with Minimum Downtime

Tuesday 4:50PM-5:15PM

@ Room G

MySQL / MariaDB

25 minutes conference

Intermediate

Tracks:
Developer, Operations

Existing tools like mysqldump and replication cannot migrate data between GTID-enabled MySQL and non-GTID-enabled MySQL -- a common configuration across multiple cloud providers that cannot be changed. These tools are also cumbersome to operate and error-prone, thus requiring a DBA's attention for each data migration. We introduced a tool that allows for easy migration of data between MySQL databases with constant downtime on the order of seconds.

Inspired by gh-ost, our tool is named Ghostferry and allows application developers at Shopify to migrate data without assistance from DBAs. It has been used to rebalance sharded data across databases. We plan to open source Ghostferry at the conference so that anyone can migrate their own data with minimal hassle and downtime. Since Ghostferry is written as a library, you can use it to build specialized data movers that move arbitrary subsets of data from one database to another.


Speakers

Shuhao Wu

Shuhao Wu (Shopify Inc.)

Software Developer

Biography:

Shuhao is a software developer working Shopify for the last 3 years. His current work include improving and automating many aspects the database infrastructure for the Datastores team. When not writing software, Shuhao's pursuing a Masters of Applied Science in mechanical engineering.


Slides



  Download Slides  

Connect with Percona

Stay Connected on:

Percona Live Conferences

The Percona Live Open Source Database Conferences are the premier event for the diverse and active open source database community, as well as businesses that develop and use open source database software.
 

Contact Us

For general information about the event/expo/conference, including registration, please contact us at:

  • info(@) percona.com
  • +1-888-401-3401
  • +1-919-948-2863
  • 8081 Arco Corporate Drive - Suite 330 - Raleigh, NC 27617, USA