Can we get faster expression handling in MySQL

Can we get faster expression handling in MySQL


Andrew from Sphinx continues to work on improving SQL (or SphinxQL) support and now he published benchmarks comparing arithmetic expression handling in Sphinx to one in MySQL. The result ? Sphinx scored 3x to 20x faster. Andrew goes to explain results are not 100% comparable (as we can see in the table results are even different) and some performance can be attributed to Sphinx using different typing for expression. Though I’m wondering how much of Performance difference that really explain. I doubt it is 20x. Andrew goes on to explain there are further optimizations possible for Sphinx such as JIT compilation and expression optimization which he claims can increase the lead even further

Andrew is kind enough to provide explanations and benchmark results though this is far from the first notion of this problem I hear about. Many other companies looking to optimize MySQL problem, especially in analytics space when expressions should be computed over hundreds of millions of rows have expressed their concerns with this part of MySQL execution. I’m wondering if we’re going to see any improvements in this space by Oracle, MariaDB or Drizzle. I think Drizzle is in advantage here – with simplifying MySQL functionality a lot they probably can also simplify expression handling to be faster.


Share this post

Comments (7)

  • Mark Callaghan Reply

    Will Andrew describe this in his talk at the User Conference?

    March 30, 2010 at 5:44 pm
  • peter Reply


    I do not know but I surely can tell him to mention it 🙂

    March 30, 2010 at 6:09 pm
  • neh Reply

    yep sphinx is indeed that faster.. i used it on wikipedia dumps and i was lyk shocked to see the performance difference. It will be awesome to see such improvements in drizzle!

    March 30, 2010 at 7:16 pm
  • Andrew Aksyonoff Reply

    Mark, technically this (ie. support for expressions) isn’t a new feature, just a new benchmark, so frankly I was not going to. Though on the other hand if I quickly hack in double precision support that’d be formally new + we perhaps do want to highlight it anyway… 🙂

    March 31, 2010 at 1:19 am
  • Vlad Rodionov Reply

    Surely, it is faster but the results are wrong in many tests. Does it prove that expression handling in Sphinx is faster than in MySQL?

    April 5, 2010 at 11:25 am
  • peter Reply


    As the article says typing is different in Sphinx and MySQL which why results are different. I would not call these wrong results. Also you can see significant difference een when result is the same.

    April 5, 2010 at 12:15 pm
  • nerkn Reply

    I wonder if there isn’t any other way except sql?
    Or why db’s don’t provide other gateways?

    Sql handle some queries like random row etc.

    October 14, 2010 at 2:43 am

Leave a Reply