At a blistering pace and for a variety of reasons, companies are migrating their on-premise database infrastructures to cloud-based solutions?to save costs on hardware, tame the impact of disaster recovery or even to improve security. Zalando is not an exception and more than two years ago we migrated our first production services to AWS.
In addition to the fully managed database services like RDS and Aurora, Amazon offers a wide spectra of EC2 instances with different performance and price. Without a lot of experience in running cloud databases it's not easy to make a right choice and as a result you will either have a pure database performance or you will overpay for over-provisioned resources.
In this talk I will explain why we decided to run most of our databases on EC2 Instances instead of RDS, how we chose EC2 Instance types and EBS Volume sizes, which AWS CloudWatch metrics MUST be monitored (and why), what problems we hit and how to avoid them.
Alexanders everyday duty at Zalando is creation and maintenance of hundreds PostgreSQL clusters in sizes from several megabytes up to several terabytes of data. Occasionally he is contributing to different open source projects. He is one of the main contributors to the Patroni project.