Alexey Kopytov delivers the talk, "Benchmark Noise Reduction: How to Configure Your Machines for Stable Results", on DAY 1 of the Percona Live Open Source Database Conference 2018, 4/24, at Santa Clara, CA.

This talk is about measuring and reducing noise in benchmark results. Properly tuning the operating system and hardware to achieve stable results in benchmarks becomes an art in itself these days. There may be many reasons for that:

- jitter in CPU and I/O schedulers
- dynamic CPU frequency scaling
- process address space randomization
- kernel configuration
- etc.

If you are not seeing stable results in your performance comparisons, you are wasting your time. Since I do a lot of MySQL benchmarks as a part of my job, I have collected a number of recipes to measure and reduce system noise and achieve more stable numbers in benchmarks. I'm going to describe those recipes as well as the new sysbench module implemented to automate those tasks and simplify system tuning for other people.

Related Videos: Percona Live Sessions, Containers and Automation, MySQL, Performance, MySQL-related Technologies

Using PMM to Identify and Troubleshoot Problematic MySQL Queries
Google Cloud Platform: MySQL at Scale with Reliable HA
Analytical Queries in MySQL - PLO October 2020
From Containers to Kubernetes Operators - Philipp Krenn - Percona Live ONLINE 2020
MySQL Ecosystem on ARM - Krunal Bauskar - Percona Live ONLINE 2020
How Does Geo-Replication Work in TiDB? - Jay Lee - Percona Live ONLINE
SQL Row Store vs Data Warehouse: Which Is Right for Your Application? - Robert Hodges - PLO October 2020