Shuhao Wu (Shopify Inc.) delivers the talk, "Ghostferry: the Swiss Army Knife of Live Data Migrations with Minimum Downtime", on DAY 1 of the Percona Live Open Source Database Conference 2018, 4/24, at Santa Clara, CA.
Existing tools like mysqldump and replication cannot migrate data between GTID-enabled MySQL and non-GTID-enabled MySQL -- a common configuration across multiple cloud providers that cannot be changed. These tools are also cumbersome to operate and error-prone, thus requiring a DBA's attention for each data migration. We introduced a tool that allows for easy migration of data between MySQL databases with constant downtime on the order of seconds.
Inspired by gh-ost, our tool is named Ghostferry and allows application developers at Shopify to migrate data without assistance from DBAs. It has been used to rebalance sharded data across databases. We plan to open source Ghostferry at the conference so that anyone can migrate their own data with minimal hassle and downtime. Since Ghostferry is written as a library, you can use it to build specialized data movers that move arbitrary subsets of data from one database to another.
Using PMM to Identify and Troubleshoot Problematic MySQL Queries
The Open Source Alternative to Paying for MongoDB
Why PostgreSQL Is Becoming A Migration Target For Enterprise
Moving MongoDB to the Cloud: Strategies and Points To Consider
Google Cloud Platform: MySQL at Scale with Reliable HA
Analytical Queries in MySQL - PLO October 2020