Scalable Big Query Using SPIDER Parallel Queries and OpenSVC
Querying multiple billions rows almost in real time are common requirements in many technical environment: web logs, monitoring, internet of things, back offices applications. We will explore an easy to deploy SPIDER sharding appliance that can compare in simplicity with MongoDB, Cassandra, Hadoop. We will explore such ready to use database abstraction composed of 66 dockers virtual machine. We will learn the basics of provisioning it via OpenSVC dockers in Gcloud . What components are used: Maxscale, TokuDB, GoLang ETL how and why they fit inside this architecture. The promise of such appliances are a massive reduction of cost or time to answer for a given SQL job. Using VM migration to additional or better hardware we can now state that we scale when the dataset size growth!
Principal Consultant, MariaDB Corporation
Stephane Varoqui (svar) is a friendly MariaDB Consultant, mainly in French speaking areas. Stephane originally started working at MySQL in 2005. In life and at work being a good dolphin and see lion he likes deep dives into his preferred topics: optimizer, compression, high availability.