Laurie Coffin welcomes everyone to the Percona Live Europe Open Source Database Conference.
Join Peter Zaitsev, CEO of Percona, as he discusses the growth and adoption of open source databases and tools and Percona’s commitment to remaining an unbiased champion of the open source database ecosystem. At Percona, we see a lot of compelling open source projects and trends that we think the community will find interesting. Following Peter’s keynote we will have a round of lightning talks from projects that we think are stellar and deserve to be highlighted.
How can you optimize database performance if you can’t see what’s happening? Percona Monitoring and Management (PMM) is a free, open source platform for managing and monitoring MySQL, MariaDB, MongoDB and ProxySQL performance. PMM uses Metrics Monitor (Grafana + Prometheus) for visualization of data points, along with Query Analytics, to help identify and quantify non-performant queries and provide thorough time-based analysis to ensure that your data works as efficiently as possible. Michael Coburn will provide a brief demo of PMM.
The inability to control the traffic sent to MySQL is one of the worse nightmares for a DBA. Scaling out and high availability are only buzz words if the application doesn't support such architectures. ProxySQL is able to create an abstraction layer between the application and the database: controlling traffic at this layer hides the complexity of the database infrastructure from the application, allowing both HA and scale out. The same layer is able to protect the database infrastructure from abusive traffic, acting as a firewall and cache, and rewriting queries.
Cloudflare operates multiple DNS services that handle over 100 billion queries per day for over 6 million internet properties. We collect and aggregate logs for these queries for customer analytics, DDoS attack analysis and ad-hoc debugging. I'll briefly cover how we securely and reliably ingest these log events, and use ClickHouse as an OLAP system to both serve customer real-time analytics and other queries.
Drawing from our own experience at GitHub, we argue that open sourcing your database infrastructure/tooling is not only a good, but a smart business decision, that may reward you in unexpected ways. Here are our observations.
A major objective of creating MyRocks at Facebook was replacing InnoDB as our main storage engine, with more space optimisations, and without big migration pains. We have made good progress and we extended our goals to cover more use cases. In this keynote, we will share our MyRocks production deployment status and our MyRocks development plans.
From its humble beginnings in 2012, the Prometheus monitoring system has grown a substantial community with a comprehensive set of integrations. This talk will provide an overview of the core ideas behind Prometheus and its feature set.
This talk is intended to give an overview of the feature differences between Percona Server for MySQL, Oracle MySQL Community Edition and MariaDB Server. We'll also dive into how some of these features are useful to a database developer or DBA in troubleshooting issues, increasing query performance and improving reliability.
ProxySQL is a very powerful platform that allows us to manipulate and manage our connections and queries in a simple but effective way.
Historically MySQL falls short in sharding capabilities. This significant area often caused developers to implement sharding at the application level, or DBAs/SAs to move on to another solution. ProxySQL has an elegant and simple solution that allows us to implement MySQL sharding capabilities without the need to perform significant (or any) changes in the code.
This brief presentation will illustrate how to successfully configure and use ProxySQL to perform sharding. We will cover very simple approaches based on connection user/IP/port, to complicated ones that see the need to read values inside queries.
Please note this presentation requires at least some basic ProxySQL knowledge.
MySQL 8.0 introduced roles: a new security and administrative feature that allows DBAs to simplify user management and increases security of multi-user environments. Using roles is easy, once you have digested all the documentation. For the uninitiated, though, the approach could be disappointing, and even give the feeling of not working at all. This quick demo will show some examples of how to deal with roles for several scenarios, how to assign roles to users, and how to use them effectively. Since there are several ways of assigning roles, the examples will cover both the roles granted as default and the cases where users can switch from one role to another within a session.
Docker is becoming more mainstream and adopted by users as a method to package and deploy self-sufficient applications in primarily stateless Linux containers. It's a great toolset on top of OS-level virtualization (LXC, a.k.a containers) and plays well in the world of micro services.
However, Docker containers are transient by default. If a container is destroyed, all data created is also lost. For a stateful service like a database, this is a major headache to say the least.
There are a number ways to provide persistent storage in Docker containers. In this presentation, we will talk about how to setup a persistence data service with Docker that can be torn down and brought up across hosts and containers.
We will touch upon orchestration tools, shared volumes, data-only-containers, security and configuration management, multi-host networking, service discovery and implications on monitoring when we move from host-centric to role-centric services with shorter life cycles.
ProxySQL aims to be the most powerful proxy in the MySQL ecosystem. It is protocol-aware and able to provide high availability (HA) and high performance with no changes in the application, using several built-in features and integration with clustering software.
During this session we will quickly introduce its main features, so to better understand how it works. We will then describe multiple use case scenarios in which ProxySQL empowers large MySQL installations to provide HA with zero downtime, read/write split, query rewrite, sharding, query caching, and multiplexing using SSL across data centers.
Elasticsearch is a distributed, RESTful search and analytics engine built on top of Apache Lucene. After the initial release in 2010 it has become the most widely used full-text search engine, but it is not stopping there.
The revolution happened and now it is time for evolution. We dive into the following questions:
How did numbers and metrics become first class data in a search engine?
How do shard allocations (which were hard to debug even for us) work and how can you find out what is going wrong with them?
How can you search efficiently across clusters and why did it take two implementations to get this right?
What are current problems and their solution around resiliency and strictness?
Why are types finally disappearing and how are we avoid upgrade pains as much as possible?
How can upgrades be improved so that nobody is stuck on old or even ancient versions?
Attendees learn both about new and upcoming features as well as the motivation and engineering challenges behi
We hear a good deal about MongoDB Atlas, Azure's CosmosDB Document Database, and running MongoDB in your environment. However, less is said about how to compare the cost, upkeep, support and pain of running them.
In this talk, we will go through some of the features of each. This includes some of the common challenges in each. There is no perfect solution and you must consider things such as current cloud implementations, staff knowledge, available tooling and (most importantly) budget.
At the end of this talk, you should have a good grasp on how to build out primary and alternate plans when your projects move from development to critical, prime-time production.
Getting data out of your traditional database stores into a other database type can be problematic, especially if you want to do it in real-time.
Using Tungsten Replicator it's possible to move data from your existing Oracle and MySQL stores into a variety of targets, including Elasticsearch, Kafka and Hadoop.
In this session we'll look at the mechanics of each process and how to combine the core replication technology with filters and deployment models to enable complex data movement and concentration.
Heterogeneous replication from MySQL to MongoDB has been available for a long time using Tungsten Replicator. In this session, we will explain (again) how to enable it and, what is more important and what you can and can't do with this feature. Also, some workarounds for common tasks will be discussed. Lastly, we will review some features missing that would be great to have and some ideas on how to implement them.
- Origins of heterogeneous MySQL to MongoDB replication in tungsten
- MySQL vs. MongoDB
2. Create a lab using Vagrant
- Install all the stuff
- Check the environment
3. What you can do and what you can't do with Heterogeneous Replication
- Empty tables
- Tables with data
- Handling indexes
- Online schema changes
- De-normalizing (Document embedding)
During this session we will cover the last development in ProxySQL to support regular expressions (RE2 and PCRE) and how we can use this strong technique in correlation with ProxySQL's query rules to anonymize live data quickly and transparently.
We will explain the mechanism and how to generate these rules quickly. We show live demo with all challenges we got from the Community and we finish the session by an interactive brainstorm testing queries from the audience.
Starting with version 8.0.1, MySQL supports Common Table Expressions (CTEs), non-recursive and recursive. This talk will introduce these objects, demonstrate how they can be leveraged to create more readable queries, and produce some reports which would otherwise require writing some iterative or recursive stored procedures. Tree-traversal examples will be covered. The implementation will also be briefly discussed.
Replication is one of the features that made MySQL a popular RDBMS. It is easy to setup, and by default it allows read-write access on both the master and slave. It is also easily creates complicated deployments, such as circular replication.
By default, MySQL Replication is asymmetrical, but it has semi-sync replication plugin. Since version 5.7 it supports multi-master slaves. All these features implement a quick start, but there is also a huge risk of making the wrong decision.
In this session, I will demonstrate why one or another replication solution can fail with data loss or perform slowly. I will show methods that will help you to diagnose and resolve these issues.
This session uses built-in, then command-line tools, because knowledge of how they work is essential for effective troubleshooting.
Slack is embarking on a major migration of the mysql infrastructure at the core of our service to use Vitess' flexible sharding and management instead of our simple application-based shard routing and manual administration. This effort is driven by the need for an architecture that scales to meet the growing demands of our largest customers and features under the pressure to maintain a stable and performant service that executes billions of MySQL transactions per hour. This talk will present the driving motivations behind the change, why Vitess won out as the best option, and how we went about laying the groundwork for the switch. Finally, we will discuss some challenges and surprises (both good and bad) found during our initial migration efforts, and suggest some ways in which the Vitess ecosystem can improve that will aid future migration efforts.
Prometheus is an open source time series database and monitoring system. It is very simple to use and has no external dependencies. It has a powerful query language to retrieve and evaluate metrics.
However, Prometheus storage engine is designed for keeping mainly the short-term data. This gap can be filled in by InfluxDB time-series database having it to store the long-term data and perform downsampling.
Learn the pros and cons of those time-series databases and how to hook up Prometheus with InfluxDB for the long-term storage of your metrics, maintain retention and get trends in system performance with Grafana.
MongoDB and Elasticsearch are both NoSQL "databases", or more correctly NoSQL data stores that are often compared and contrasted on a head-to-head basis.
But if comparing that way, one could easily miss out on the opportunity to use both together as individual and independent data stores that serve specific purposes to deliver the best overall solution for your application flow and performance needs.
In this talk, Kimberly will discuss the overall aspects of each technology, best use cases, the strengths and weaknesses of each, scaling, and provide examples for each with details for the underlying technology with architectural information and basic functioning of these two data stores.
Join her as she will offer opinions on the best times to use separately as independent data stores plus the chance to combine the two to get the absolute performance often needed by today's applications and the large amounts of data required.
This presentation uses an abstracted use case from real life to show a migration from MySQL to MariaDB to Percona Server, and how the impact of these three different choices. It also shows how the three different databases reacted on the different platforms used, both in resource management and performance.
Alibaba Cloud Database Kernel Team is supporting cloud database services in Alibaba Cloud Platform.
The MySQL in Cloud is big different with local MySQL. Usually, Cloud supports multi-tenancy. Then we need some features for that, such as:
1. Reset Connection: Let the connections can be re-used by different users.
2. Proxy Bypass IP: Let the Proxy can set the real client IP for connections.
3. Usergroup: SUPER/non-SUPER users are not enough, different users need different access poclies and resource quotas.
4. Implict Primary Key: It will let every tables have a default key internally for all engines, avoid the replication issues.
5. Flashback: It can let users can rollback the small mis-operations, instead of rollback all instance from a backup set.
And many other features for the Cloud cases.
In this session, you can know how Alibaba Cloud make MySQL is more suitable for the Cloud environment.
Come hear how performance improves 3x-10x in the latest Percona XtraDB Cluster 5.7, along with other security changes!
We will highlight:
* Dramatically improved OLTP concurrency throughput under multiple threads
* The value of disabling binlogs in PXC 5.7, and the tradeoffs to consider
* How Percona XtraDB Cluster performance compares to MariaDB Cluster and InnoDB Group Replication
* Integration with ProxySQL using proxysql-admin
MySQL 8.0 implements atomic and crash-safe DDL. We will discuss how this affects behaviour of individual DDL statements, binlog and crash-safeness. We will also discuss the role of InnoDB as a data dictionary SE and a user tables SE, and touch upon requirements for writing a data dictionary SE for MySQL.
MySQL 8.0 implements I_S as views over dictionary tables stored in InnoDB. There are legacy features that require queries to SE. What is the impact of this, and how to make a compromise between updated and fast information.
MySQL Replication, in addition to bringing high-availability, is the foundation to build high-performance MySQL database systems. Using read scale-out and sharding one can design systems that go from the capacity of a single server to supporting the largest internet sites. But to design and operate high-performance, efficient, manageable and reliable deployments requires knowing the intricacies of the underlying technologies.
This session will provide insights on the main factors that affect the performance of Asynchronous Replication and Group Replication, and how to configure them to make the most out of the underlying computing system. It will also show the latest developments in MySQL 5.7 and 8.0, in areas spanning from group communication to the multi-threaded slave applier, and how effective they are in helping meet the performance requirements in terms of throughput, latency and durability to support the most demanding workload types.
Databases play a key part of business infrastructure. To ensure you are prepared in case of a disaster, it is crucial to make sure your database and data are always available.
In this talk, DBA's and sysadmins will get exposed to the different types of backups.
- When a physical vs. logical backup is more appropriate
- How to make complete, partial and incremental backups and how to restore a single table from a physical backup
- Where backups should be stored
- How important it is to test the restoration of a backup
- How to include point-in-time-recovery on backup routines
- How to encrypt backups and why
- Which tools and techniques can be used to ensure the actual backup has consistent data
.IE (IEDR - Ireland's CCTLD) will share how they implement the topics above on their backup life-cycle.
By the end of this talk, the audience will have a clear picture of the key points of an actual backup.
Grafana is the leading open-source graph and dashboard builder for visualizing time series and is a great tool for monitoring databases. Learn how to create dashboards and graphs in Grafana and how to use them to gain insight into the behaviour of your systems.
I will be demoing the new MySQL data source in Grafana that can be used to visualize any data that you have in your database and I will round off the session with a sneak peek of the upcoming major release - Grafana 5.0.0.
The presentation will be a real-life study on how we utilize ProxySQL for connection pooling, database failover and load balancing the communication between our (third party) PHP-application and our master-master MySQL-cluster.
Also, we will show monitoring and statistics using Percona Monitoring and Management (PMM).
ProxySQL is a very powerful tool, with extended capabilities, and we want to show that it?s possible to utilize this to gain functionality (seamless database backend switch) and correct problems (applications missing connection pooling).
Optimizing MySQL performance and troubleshooting MySQL problems are two of the most critical and challenging tasks for MySQL DBA?s. The databases powering your applications need to be able to handle heavy traffic loads while remaining responsive and stable so that you can deliver an excellent user experience. Further, DBA?s are also expected to find cost-efficient means of solving these issues.
In this presentation, we will discuss how you can optimize and troubleshoot MySQL performance and demonstrate how Percona Monitoring and Management (PMM) enables you to solve these challenges using free and open source software. We will look at specific, common MySQL problems and review the essential components in PMM that allow you to diagnose and resolve them.
Matching this environment, MySQL recently introduced the MySQL Document Store, which enables using a regular MySQL database to manage schemaless data. This
presentation will describe the key concepts of the Document Store alongside the new X protocol that supports it and will show how to use the X DevAPI with the MySQL Node.js connector.
SRE is becoming quite the ubiquitous term, but what about DBRE? Let's explore the paths to this craft and how to culturally evolve and support it. Focus on organizational scale, self-service, and force multipliers in recoverability, observability, availability, security, release management, and infrastructure.
- Comparison of old and new paradigms
- What is DBRE and reliability engineering
- The path to DBRE as a career
Paradigm shifts causing this
- Polyglot persistence
- Cloud and virtualization
- Infrastructure as code
- Continous delivery
- Protect the data
- Self-service for scale
- Elimination of toil
- Databases are not special snowflakes
- Reduce the barriers between software and DB ops
DBRE core competencies
- Catastore decision making
- Data distribution
- Failover and availability
- Scaling patterns
- Build guard rails
- Build for services and people
MySQL 8.0 has got a whole new set of collations based on Unicode 9.0.0 and the utf8mb4 character set which is also the default character set in MySQL 8.0. This talk will present the new collations and what they bring into MySQL with regards to functionality and performance. The
talk will also look at the quirks and oddities you will have to think of when migrating your old MySQL 5.7 data to MySQL in order to take advantage of utf8mb4 and the new collations and cover topics:
- How to migrate to utf8mb4 from latin1, utf8 etc.
- Problems that might arise wrt. uniqueness, indexes etc.
- Pitfalls with character set and collation settings
- How to fix character set data that has for some reason a wrong encoding
Load balancing MySQL connections and queries using HAProxy has been popular in the past years. Recently however, we have seen the arrival of MaxScale, MySQL Router, ProxySQL and now also Nginx as a reverse proxy.
For which use cases do you use them and how well do they integrate in your environment? This session aims to give a solid grounding in load balancer technologies for MySQL and MariaDB.
We will review the main open-source options available: from application connectors (php-mysqlnd, jdbc), TCP reverse proxies (HAproxy, Keepalived, Nginx) and SQL-aware load balancers (MaxScale, ProxySQL, MySQL Router).
We will also look into the best practices for backend health checks to ensure load balanced connections are routed to the correct nodes in several MySQL clustering topologies. You'll gain a good understanding of how the different options compare, and enough knowledge to decide which ones to explore further.
At Dropbox we treat data as sacred and we do everything to protect it well. We don't let a single transaction slide not even in case of a disaster. Our requirements to the backups are to be able to recover to any point in time without the slightest chance to lose any single transaction. This certainly brings new challenges to the backup infrastructure.
In this talk I will show you:
- How Dropbox backs up petabytes of data
- How is it possible to schedule thousands of independent backups jobs
- How binary logs are streamed from all hosts in a cluster, processed and merged into a single stream of events that is used for point in time recovery, that way the binary log stream is not affected by the issues of any single node
In this presentation I take a deep dive into the open source storage engine inside InfluxDB. More than just a single storage engine, InfluxDB is two engines in one: the first for time series data and the second, an index for metadata. I'll delve into the optimizations for achieving high write throughput, compression and fast reads for both the raw time series data and the metadata.
Currently we are in the process of rolling out of a new MySQL database layer on our own private cloud. We are the 2nd largest university in Belgium and we have a wide variety of applications running on MySQL. Some are in-house development that we can control and some are external or closed source tools we just have to run. We also opened up the infrastructure for employees and researchers within the university as a service to our internal community.
Our solution is build on virtual servers with network file systems and consists out of open source tools. We added a proxy layer based on ProxySQL to separate of our MySQL topology from the application layer. This because not all applications were build with read-write splitting capabilities or were too hard to reconfigure automatically. We implemented Orchestrator for topology management and introduced Percona Xtrabackup as our primary backup solution. The entire infrastructure is managed using puppet.
At Facebook, we open sourced MyRocks?Flash optimized, space and write efficient MySQL database engine. We are in the process of migrating our main MySQL databases?storing Facebook social graphs, massively sharded, low latency and automated services?from InnoDB to MyRocks. We have been very successful so far and have reduced database size by half.
Compared to deploying new database software into new or non-critical services, replacing existing stable database running on very critical services is much harder. You need to pay attention to lots of things, like how to migrate existing data without stopping or slowing down services, how to migrate within reasonable amount of time, and how to continuously verify not to corrupt any data.
In this session, the speaker will talk about MyRocks production deployment story. The following topics will be covered
- Overview of MySQL at Facebook
- What is MyRocks, and why we decided to create yet another database engine
- How Facebook MySQL SRE team collaborated with Engineering team
- How we prepared, executed and monitored InnoDB to MyRocks migration
- Lessons learned from the migration
In this session we will discuss a new way of compressing data in the Percona XtraDB storage engine, compare it with existing InnoDB table compression from both a performance and data size point of view, and show how we can significantly increase the compression ratio using predefined dictionaries. This talk will cover the most typical usage scenarios for DBAs and reveal some design internals for developers.
In this talk you will discover how you can fully manage your mysql setup in Puppet, including creation of users, databases, and even replication setup.
Puppet is one of the lead open source automation system, but somehow lots of people are still fragile about using it to manage their databases. We will expose how we are using it internally and for our customers, to maintain over time multiple identical mysql stacks accross environments.
MySQL 8.0 is still in development, but we're already seeing a lot of improvement in GIS support. The latest development release comes with support for around 5000 different spatial reference systems, improved standard compliance and a lot of new functionality. How does it all
work, and how can it be used to build applications?
This talk starts with the basics of GIS and spatial data in MySQL: geometries, data types, functions, storage and indexes. We'll walk through a demo of how all the parts fit together to support a GIS web application. We'll also have a sneak peek into the future, including what you should do right now to prepare for the upgrade to MySQL 8.0.
Whether you're currently storing or planning to store spatial data in MySQL, this talk is for you. It covers the topics in a way that is accessible to both novices and more advanced GIS users.
Application databases start out small then later become large and complex. SQL performance and scheme management becomes too complex. Reliability suffers.
This talk will describe how to split a database schema in two, across separate replication chains to improve performance, scalability, and make database management easier.
It will cover the replication features used, the application code features needed to make the split invisible to end users, design choices for different reliability and uptime needs, how to do the split and how to tidy up. Real-life examples of good and bad will be included!
In this presentation, we will discuss the migration of a rapidly growing production InnoDB system to TokuDB. This will include:
- Why TokuDB was chosen
- What features of TokuDB are used, and what features are not used
- Benchmarking and sizing evaluation used
- Additional dependencies and versions for software deployment
- Evaluating the backup options of Toku Hot Backup and LVM snapshots
- The impact of existing online alter statements procedures
- Balancing the memory configuration during migration to avoid OOM
- Tricks for a seamless production outage
The topic of this presentation is how to use ElasticSearch (ES) in order to speedup otherwise slow MySQL analytic queries. For this, we will look at an actual business case for a ride-sharing application, with the actual trip data stored in MySQL.
First, we will examine the ES requirements and explain how to import this data in ES and sync both databases.
Some specifics of ElasticSearch will be discussed, notably the Query DSL as well as the differences with MySQL and how to convert SQL queries to the ElasticSearch DSL.
Then, we will show how to design analytic queries in ES using aggregation and geolocalization, giving some real world examples (e.g. average earning per driver with pickups in the brooklyn area) and performance comparisons with the equivalent queries in MySQL.
Finally, we will discuss how to scale this implementation and make it highly available using ES clustering and sharding features.
Analyzing data to make crucial business decisions is vital for any company to survive in today's competitive market. Even more so when we consider the eCommerce industry. In every corner of the world, eCommerce companies are vying to capture the market share. As a result, companies are required to provide processes and infrastructure to allow data access to Business Intelligence and Development teams without compromising on regulatory requirements. To solve this problem, there is some commercially available software which encrypts data at rest by using key management within or outside the RDBMS. But we have been able to solve this problem innovatively by using triggers and a set of Python scripts which is free, masks data in real time, has simple to configure columns for masking and retains the usability of data after masking. We have developed a set of functions for each type of sensitive data that is used in various applications most commonly. We will also discuss pros and cons.
Typically, a database storage layer is built on B-trees. The same applies to WiredTiger - the default engine for MongoDB.
However, Percona Server for MongoDB has a specific engine built on an LSM tree - it's MongoRocks. Based on the RocksDB library from Facebook, MongoRocks became a different but interesting storage layer solution.
This talk covers its implementation details.
You have been asked to administer a Cassandra installation. In this talk, I will take you through basic Cassandra operations from the point of view of a MySQL DBA.
In the beginning, I was simply looking for "where is the equivalent of a .my.cnf?". Over time, that expanded to "how can I be sure this is healthy?", "Why are the users complaining about timeouts connecting?", and "How do I make this cluster replicate into another datacenter?". I will cover all of this and more.
Hopefully, my frustrations will save you some time and pain.
Is your MongoDB deployment secure? This talk will cover security best practices for a MongoDB deployment. Features such as Authorization, client/server SSL, SELinux and more will be covered.
The EMBL-EBI is an international scientific organisation using open source and commercial technologies: in the database backend, open source SQL and NoSQL DBMSs such as PostgreSQL, MySQL and MongoDB are in use alongside the well consolidated Oracle RDBMS.
Throughout the years the overall number of instances has grown notwithstanding a program of retirement of any instance reaching the end of its lifecycle: on this basis the investigation of the costs related to support, maintenance, operations across all database technologies is of strategic importance for the institute.
We will discuss the activity we conducted over the last 12 months that lead to the migration of ca 30 Oracle instances to open source suitable alternative platforms. Some POC and side investigations have been dedicated to solve specific issues.
We will illustrate overall approach, use cases, tools, technical challenges and adopted solutions and lesson learned, in the context of the evolving EMBL-EBI infrastructure
Did you know that Percona Monitoring and Management (PMM) ships with support for AWS RDS and Aurora out of the box? It does!
In this session we'll discuss:
* How to configure PMM (metrics and queries) against RDS and Aurora using an EC2 instance
* How to configure PMM against CloudWatch metrics
* Configuration parameters for RDS/Aurora/CloudWatch for maximum visibility in PMM
* Interesting components of the Metrics Monitor interface - what are the dashboards, what are the key graphs
* Overview of Query Analytics (QAN) against RDS/Aurora
On the roadmap for Q4 2017 is agent-less monitoring of RDS/Aurora and tighter CloudWatch/Prometheus integration!
Prometheus is a monitoring system with a custom time series database at its core. Prometheus 2.0 features the 3rd major iteration of this database. This talk will look at how it has evolved, and how it fits into the goal of doing metrics-based monitoring.
In this demo, we will showcase how to perform master switching and failover using MySQL/MariaDB Replication Manager (MRM), a project to manage high availability in replicated database environments. We will review the various features of the MRM dashboard and how it integrates seamlessly with software such as ProxySQL to handle database traffic redirection. Finally we will describe several failover scenarios (in-sync, semi-sync, loss of data) and explain the approaches taken in MRM design in order to enforce best practices and achieve data consistency as much as possible.
MyRocks is a Facebook project to integrate the RocksDB LSM storage engine into MySQL. In the past, we have covered basic functionality and performance benefits of MyRocks. In this talk, we'll cover new features of MyRocks necessary to meet our scaling requirements. We have reduced data load times for the storage engine and added better diagnostic capabilities. We have found and fixed various performance and data consistency issues in RocksDB.
We will also cover some new features that have been added to MyRocks over the past year.
This talk will cover the Amazon Migration Tool. The talk will cover the possibilities, potential pitfalls prior to migrating and a high-level overview of its functionalities.
This presentation will discuss implementing external authentication when using Percona Server for MongoDB and MongoDB Enterprise. It will review authentication using OpenLDAP or ActiveDirectory and ActiveDirectory with Kerberos.
The presentation will also include examples of the configurations required by these external directory services. It will also review the LDAP Authorization features introduced in MongoDB Enterprise 3.4.
Recently at MongoDB World, it was announced that MongoDB 3.6 would come out in late 2017 or early 2018 (as per the normal schedule). The feature list was very light, as the focus is more on services like Atlas. In this talk, we will go into what we know is confirmed or already completed, and what is on the desired list.
Some of bigger items are:
$comments and $hints in aggregations
$mergeObjects / $$Remove
Fix deep nesting in aggregation (overflow bug)
Intital improvements to support transactions in the future
randomSample for profile added (was added to Percona Server for MongoDB 3.2/ 3.4 already)
Using PMM, participate in a demonstration of how to leverage the combination of Query Analytics and Metrics Monitor when troubleshooting MySQL performance issues. We'll review the essential components of PMM, and use some of the most common cases of database slowness as examples of where to look and what to do.
Are you running on Amazon, or planning to migrate there? In this talk, we are going to cover the different technologies for running databases on Amazon Cloud environments.
We will focus on the operational aspects, benefits and limitations for each of them.
At Letgo we built a 100% fault tolerance platform using technologies such as ProxySQL + Consul + Replication Manager and Puppet.
The idea of this talk would be to explain how is possible to use a highly available platform using those described technologies. ProxySQL will route read and write queries, consul will ensure ProxySQL nodes are available and replication manager will handle failovers if the master goes down.
All those configurations will be deployed using a configuration manager such as Puppet.
After describing all the pieces, the idea is to run a live demonstration.
Performance, efficiency and QoS in MongoRocks are greatly improved this year thanks to work on it and on RocksDB. I will explain some of the changes that have been made and provide benchmark results to compare current MongoRocks with current WiredTiger and an older MongoRocks release.