Percona Live: Open Source Database Performance Conference - Amsterdam 2016 Logo

October 3-5, 2016

Amsterdam, Netherlands

Scalable Big Query Using SPIDER Parallel Queries and OpenSVC

Scalable Big Query Using SPIDER Parallel Queries and OpenSVC

 5 October 2:40 PM - 3:05 PM @ Zürich 2
Experience level: 
25 minutes conference
Big Data


Querying multiple billions rows almost in real time are common requirements in many technical environment: web logs, monitoring, internet of things, back offices applications. We will explore an easy to deploy SPIDER sharding appliance that can compare in simplicity with MongoDB, Cassandra, Hadoop. We will explore such ready to use database abstraction composed of 66 dockers virtual machine. We will learn the basics of provisioning it via OpenSVC dockers in Gcloud . What components are used: Maxscale, TokuDB, GoLang ETL how and why they fit inside this architecture. The promise of such appliances are a massive reduction of cost or time to answer for a given SQL job. Using VM migration to additional or better hardware we can now state that we scale when the dataset size growth!


VAROQUI Stephane's picture

VAROQUI Stephane

Principal Consultant, MariaDB Corporation


Stephane Varoqui (svar) is a friendly MariaDB Consultant, mainly in French speaking areas. Stephane originally started working at MySQL in 2005. In life and at work being a good dolphin and see lion he likes deep dives into his preferred topics: optimizer, compression, high availability.

Share this talk