I finally posted a copy of the slides from my Percona Live presentation, “Creating a Benchmarking Infrastructure that Just Works”. The PDF is available via this link.
The content comes from my personal experiences over many years benchmarking and testing databases, usually focusing on performance. It was an opportunity to see how far my personal benchmark infrastructure has evolved, but even better has inspired me to improve it in several areas.
I never had a chance to to my own post-conference wrap-up regarding the Percona Live show. While waiting for my flight home at SFO airport I concluded that it was by far the best technology conference I’ve ever attended. The MySQL community is truly amazing and finally meeting many of the people that I’ve only “known” online was great. I’m really looking forward to next year’s event and ways I can contribute to existing benchmarking and testing projects.
Resources
RELATED POSTS
Nice slides! I have to digest them better before having something useful to say.
For now, all I can say is that the more I test, the more my test infrastructure looks like real code and less like shell scripts.
That’s why I wrote first a wrapper for ApacheBench (benchmarking websites is my main goal), and later a tool to automate execution of sql queries with increasing concurrency (see https://github.com/gggeek/ezab). All in php, take it or leave it.
I am also still looking for the best tool to graph operating system stats during test runs, in parallel to app results data. As a consultant, I need to run this on different customers machines, where installing sw is often forbidden – this rules out a lot of nice software. I still have in my backlog testing of dim_stat though…
Thanks, it’s my version 1 of the presentation, so it will improve over time, plus I’ll be adding more lessons learned. And please report back when you find a simple but helpful way to track operating system information, I’m always looking for something better.
Hi Tim, that’s great work, thanks for sharing.
Was the presentation recorded and it is available somewhere?
Good question. I’m pretty sure they recorded them but I only see the keynote recordings available on their site. Have you tried asking Percona about it?