Yes, Virginia, There is Going to be a TokuMX Storage Engine for MongoDB 2.8Dave Rosenlund
UPDATE: Since the publication of this blog post, Tokutek subsequently published preliminary benchmark results for this new TokuMX sibling, now called TokuMXse. In addition, there have been a number of release candidates. Finally, MongoDB ultimately decided to call the new release of MongoDB v3.0 (previously it had been called v2.8).
First things first… Congratulations to Keith, Michael, and the rest of the WiredTiger team. We look forward to seeing you in the MongoDB market in 2015 . That said, while this news is certainly germane, it’s not the sole motivation behind today’s post.
The reason for this post is to formally and officially disclose what we have been telling our customers and prospects (when asked) for weeks: Yes. Tokutek will indeed offer a storage engine API edition of TokuMX for MongoDB.
Background: As most folks in the MongoDB community know, MongoDB recently announced their intention to make a storage engine API available in its forthcoming release of MongoDB, version 2.8. That release was originally slated for this month, but according to recent statements by Eliot Horowitz, the release will most likely be available sometime in early 2015. In addition to announcing the API, Eliot and team reached out to storage engine vendors, including Tokutek and WiredTiger, encouraging them to build products based on that API. Tokutek fully embraced this move by MongoDB, and as anyone who follows us in JIRA knows, we started work on a version of TokuMX based on the new APIs soon thereafter.
What it all means: If you believe, as we do, that competition is a good thing — one that results in more / better choices for users — this can only mean good things are going to continue happening in the world of high-performance big data applications built with MongoDB. Soon the MongoDB community will have several storage engine choices and among them will be the new, to-be-named, TokuMX sibling.
Implications for TokuMX: Unfortunately, the new MongoDB storage engine APIs will not enable storage engine vendors to, for example, offer ACID compliant transaction support; a better election protocol; improved replication and sharding; clustered secondary indexes; and so on. These TokuMX improvements to MongoDB require a deeper level of software engineering. Consequently, Tokutek will offer two products for MongoDB: TokuMX, the product we offer today with the aforementioned improvements and a new, storage-engine-only, sibling.
Watch this space in the coming weeks for more news about our new TokuMX product, and comparisons between it, the full version of TokuMX, WiredTiger, and more. It’s going to be an interesting new year.
More about TokuMX: In June of 2013 Tokutek released a fork of MongoDB built with the same proven, modern database indexing engine it first introduced for MySQL in 2008. Since its introduction, TokuMX has won over numerous MongoDB users with its high-performance ingestion and compression abilities. The MaxCDN and Performance Horizon Group TokuMX success stories are two recently published examples of companies meeting their rapidly accelerating MongoDB data ingestion and storage needs with TokuMX.
Your comments are welcome here or you can reach me on Twitter via @dcrosenlund.