EmergencyEMERGENCY? Get 24/7 Help Now!

Making Apache Spark Four Times Faster

 | January 15, 2016 |  Posted In: Apache Spark, MySQL

This is a followup to my previous post Apache Spark with Air ontime performance data. To recap an interesting point in that post: when using 48 cores with the server, the result was worse than with 12 cores. I wanted to understand the reason is was true, so I started digging. My primary suspicion was that Java (I […]

Read More

Apache Spark with Air ontime performance data

 | January 7, 2016 |  Posted In: Apache Spark, Benchmarks, MySQL

There is a growing interest in Apache Spark, so I wanted to play with it (especially after Alexander Rubin’s Using Apache Spark post). To start, I used the recently released Apache Spark 1.6.0 for this experiment, and I will play with “Airlines On-Time Performance” database from http://www.transtats.bts.gov/DL_SelectFields.asp?Table_ID=236&DB_Short_Name=On-Time. You can find the scripts I used here https://github.com/Percona-Lab/ontime-airline-performance. The uncompressed dataset is about 70GB, which is […]

Read More

Percona Server for MongoDB storage engines in iiBench insert workload

 | December 23, 2015 |  Posted In: MongoDB, MySQL

storage engine

We recently released the GA version of Percona Server for MongoDB, which comes with a variety of storage engines: RocksDB, PerconaFT and WiredTiger. Both RocksDB and PerconaFT are write-optimized engines, so I wanted to compare all engines in a workload oriented to data ingestions. For a benchmark I used iiBench-mongo (https://github.com/mdcallag/iibench-mongodb), and I inserted one billion […]

Read More

MongoDB 3.2 WiredTiger in iiBench

 | December 15, 2015 |  Posted In: Benchmarks, MongoDB

MongoDB 3.2 was recently released with WiredTiger as the default storage engine. In just over five years, MongoDB has evolved into a popular database. MongoDB 3.0 supported “pluggable storage engines.” The B-Tree-based WiredTiger should outperform IO-optimized RocksDB and PerconaFT in in-memory workloads, but it demonstrates performance degradation when we move into IO workloads. There are reports that WiredTiger […]

Read More

Amazon Aurora in sysbench benchmarks

 | December 3, 2015 |  Posted In: Cloud and MySQL, Cloud and NoSQL, MySQL, Percona Server

In my previous post Amazon Aurora – Looking Deeper, I promised benchmark results on Amazon Aurora. There are already some results available from Amazon itself: https://d0.awsstatic.com/product-marketing/Aurora/RDS_Aurora_Performance_Assessment_Benchmarking_v1-2.pdf. There are also some from Marco Tusa: http://www.tusacentral.net/joomla/index.php/mysql-blogs/175-aws-aurora-benchmarking-blast-or-splash.html. Amazon used quite a small dataset in their benchmark: 250 tables, with 25000 rows each, which in my calculation corresponds to 4.5GB […]

Read More

Amazon Aurora – Looking Deeper

 | November 16, 2015 |  Posted In: Cloud and MySQL, Cloud and NoSQL, MySQL

Recently my colleague (by Percona) Yves Trudeau and colleague (by industry) Marco Tusa published their materials on Amazon Aurora. Indeed, Amazon Aurora is a hot topic these days, and we have a stream of customer inquiries regarding this technology. I’ve decided to form my own opinion, and nothing is better than a personal, hands-on experience, which I […]

Read More

VividCortex Agent Benchmark

 | September 18, 2015 |  Posted In: MySQL

Intro The purpose of this project was to measure the potential overhead of VividCortex Agent, which is used by VividCortex.com database monitoring system. This benchmark is part of a consulting engagement with VividCortex and paid by the customer. The assumption is that VividCortex agent uses CPU processing time, and we should see an impact on […]

Read More

Clarification on “Call me Maybe: MariaDB Galera Cluster”

 | September 17, 2015 |  Posted In: InnoDB, MariaDB, MySQL, Percona XtraDB Cluster

Recently Aphyr (Kyle Kingsbury) published https://aphyr.com/posts/327-call-me-maybe-mariadb-galera-cluster The article is technically valid, I am not going to dispute a conclusion Aphyr made, but it is also quite technically involved, so users who just jump to conclusion may get the wrong impression and we’re left with more questions than ever. So, let me state what is the […]

Read More

Checkpoint strikes back

 | August 3, 2015 |  Posted In: MongoDB, MySQL

In my recent benchmarks for MongoDB, we can see that the two engines WiredTiger and TokuMX struggle from periodical drops in throughput, which is clearly related to a checkpoint interval – and therefore I correspond it to a checkpoint activity. The funny thing is that I thought we solved checkpointing issues in InnoDB once and […]

Read More

InnoDB vs TokuDB in LinkBench benchmark

 | July 24, 2015 |  Posted In: Benchmarks, MySQL, Percona Server, TokuDB

Previously I tested Tokutek’s Fractal Trees (TokuMX & TokuMXse) as MongoDB storage engines – today let’s look into the MySQL area. I am going to use modified LinkBench in a heavy IO-load. I compared InnoDB without compression, InnoDB with 8k compression, TokuDB with quicklz compression. Uncompressed datasize is 115GiB, and cachesize is 12GiB for InnoDB […]

Read More