Buy Percona ServicesBuy Now!

Call for Questions: Webinar with MySQL Benchmarking Experts

 | June 5, 2018 |  Posted In: Benchmarks, MySQL

PREVIOUS POST
NEXT POST

benchmarking requestIf you attended my latest Troubleshooting MySQL Concurrency Issues with Load Testing Tools webinar you learned how I exploit benchmarking tools to replicate locking issues and crashes. But I told you nothing about proper use of these tools: for reliable benchmarks. I did not tell you that for a reason… I am just a Support Engineer and not a benchmarking expert.

And I have a dream. I want to invite world famous MySQL benchmarking experts for a Percona webinar and ask them for their secrets. I have a pretty long list of my own questions, but in order to make 1-hour webinar productive, we need to concentrate on just a few of the hottest ones. Therefore I need your help.

Please add your questions into the comments field of this blog post. Then we will choose the most important and/or most popular of these to discuss at the webinar.

Some benchmarking questions

My list of questions includes:

  1. What do you benchmark? Are they real applications or artificial tests?
  2. How do you create tests for a real application workload?
  3. Do you test hardware?
  4. Which tools do you use? How? Any tips?
  5. How do you work with hardware limitations when the test machine is smaller than the production one?
  6. Which are the most common mistakes for benchmarks?
  7. We all heard about “Lies, Damned Lies and Benchmarks”. Why do you still benchmark? How are you sure that yours have meaningful results?
  8. What are the most common mistakes made by those who publish benchmark results for public use?
  9. What are the best practices for benchmarks?

Please tell me what you think about these questions and add yours!

PREVIOUS POST
NEXT POST
Sveta Smirnova

Sveta joined Percona in 2015. Her main professional interests are problem solving, working with tricky issues, bugs, finding patterns that can solve typical issues quicker and teaching others how to deal with MySQL issues, bugs and gotchas effectively. Before joining Percona Sveta worked as a Support Engineer in the MySQL Bugs Analysis Support Group in MySQL AB-Sun-Oracle. She is the author of the book "MySQL Troubleshooting" and JSON UDF functions for MySQL.

4 Comments

  • Neil J. Gunther . I’d like to hear more about how to accurately test scalable systems (throughput, response time distribution and constraints), and have him look at and maybe even constructively criticize benchmarks in MySQL space 🙂

  • I’d be interested in learning something about how to properly benchmark different DBMSes (MySQL, MongoDB, Cassandra, …) and different storage engines against eachother, especially what benchmarking tools are available for this and how to use them.

Leave a Reply