Percona's CMO, Laurie Coffin welcomes you to the Business Track
Percona's CEO, Peter Zaitsev provides an insight into Open Source Software. How it began, how companies are adopting this right now and the future of Open Source and why you should be using it!
This talk will describe the parameters which decide what open source database technology you should chose.
It takes a step back and describes how to make decisions based on facts, what technologies might be the better fit and how to ultimately make your choice of a database related technology.
Organizations need an appropriate disaster recovery plan to mitigate the impact of downtime. But how much should a business invest? Designing a highly available system comes at a cost, and not all businesses and indeed not all applications need five 9's availability.
We will explain fundamental disaster recovery concepts and walk you through the relevant options from the MySQL & MariaDB ecosystem to meet different tiers of disaster recovery requirements, and demonstrate how to automate an appropriate disaster recovery plan.
In this talk, we'll go over some of the high level monitoring concepts that PMM enables for you, the CEO, to leverage in order to speak the same language as your technical team. We'll cover:
Which thresholds to follow for CEOs
Host-specific resources - CPU, Memory, Disk, Network
Database-specific resources - Connections, Queries per Second, Slow Queries, Replication lag
Building custom KPI metrics using PMM
Visualize Application logic
Combine Application and Databases under one view
Over the past few years, VidaXL has become a European market leader in the online retail of slow moving consumer goods. When a company achieved over 50% year over year growth for the past 9 years, there is hardly enough time to overhaul existing systems. This means existing systems will be stretched to the maximum of their capabilities, and often additional performance will be gained by utilizing a large variety of datastores.
Polyglot persistence reigns in rapidly growing environments and the traditional one-size-fits-all strategy of monoglots is over.
VidaXL has a broad landscape of datastores, ranging from traditional SQL data stores, like MySQL or PostgreSQL alongside more recent load balancing technologies such as ProxySQL, to document stores like MongoDB and search engines such as SOLR and Elasticsearch.
Companies today find that migrating from on-premises to cloud-based architectures is no longer a choice, but a competitive necessity. Cloud environments require less oversight and management of routine and operational tasks (most of which can be automated). Percona's DBaaS-focused support tiers and DBA Service align with the changing role of database professionals who manage cloud environments. These services allow Percona to help you reduce business costs by providing unbiased support services. Our services help you properly configure your data technologies, tune and improve your data design and performance characteristics and quickly diagnose problems. Ultimately, better support and proactive management help you get more out of your company's cloud deployment, while minimizing risk to the business.
This session will provide a top 5 list on why companies are looking to the cloud. We will discuss, in my experience, the top reasons that companies choose the cloud and what that could mean for your business.
Serverless computing is becoming more popular with developers, as it enables them to build and run applications without needing to operate and manage servers. This talk will provide a high-level overview of serverless applications in the database world, including the use cases, possible solutions, services and benefits provided through the cloud ecosystem, with a focus on the capabilities of the AWS serverless platform.
Databases are the backbone of mission-critical enterprise applications. While modern development practices and cloud-based deployment models are increasing IT agility like never before, they are also increasing business risk. As the amount of data collected continues to soar, and as the types of open source databases deployed for specific applications continue to expand, organizations require powerful and cost-effective solutions for their multi-vendor production environments. Percona has over 12 years of battle-tested database experience, and has helped thousands of customers achieve better performance, better cost savings and better ROI. An unbiased, trusted partner, Percona provides single-source expertise in multi-vendor environments that eliminates lock-in, increases agility and enables business growth.
Laurie Coffin, Percona's CMO kick starts the keynotes!
Open source database adoption continues to grow in enterprise organizations, as companies look to scale for growth, maintain performance, keep up with changing technologies, control risks and contain costs. In today's environment, a single database technology or platform is no longer an option, as organizations shift to a best-of-breed, polyglot strategy to avoid vendor lock-in, increase agility and enable business growth.
Following Peter's keynote, we will have a round of lightning talks featuring the latest releases from PostgreSQL, MongoDB and MariaDB.
PostgreSQL 11- Bruce Momjan
PostgreSQL benefits from over 20 years of open source development and has become the preferred open source relational database for developers. PostgreSQL 11 was released on October 18. It provides users with improvements to overall performance of the database system, with specific enhancements associated with very large databases and high computational workloads.
MongoDB 4.0- Alexander Rubin
Do you love MongoDB? With version 4.0 you have a reason to love it even more! MongoDB 4.0 adds support for multi-document ACID transactions, combining
the document model with ACID guarantees. Through snapshot isolation, transactions provide a consistent view of data and enforce all-or-nothing execution to maintain data integrity. And not only transactions - MongoDB 4.0 has more exciting features like non-blocking secondary teads, improved sharding, security improvements and more.
MariaDB 10.3- Arjen Lentz
MariaDB benefits from a thriving community of contributors. The latest release, MariaDB 10.3, provides several new features not found anywhere else, as well backported and reimplemented features from MySQL."
This keynote highlights the collaborative journey PaddyPowerBetfair and Percona have taken through the adoption of MySQL within the PPB enterprise. The keynote focuses on how Percona has assisted PPB in adopting MySQL, and how PPB has used this partnership to deliver a full DBaaS for MySQL solution on Openstack. (This case study will be presented in full later in the day with a 50 minute presentation by the PPB DBA and cloud automation teams.)
PostgreSQL is an advanced open source database software that is completely community driven.
It is also important to understand how different it is from MySQL conceptually and where is it different from MySQL.
This talk starts with a brief overview on PostgreSQL and conceptual differences between PostgreSQL and MySQL.
MongoDB 4.0 brings transactional properties from the SQL world to the NoSQL world. Now supporting snapshot isolation, commits and rollbacks are one of the most exciting features of MongoDB 4.0. Moreover, MongoDB 4.0 brings interesting enhancements like change streams, SHA-2 authentication, and security enhancements to create users using authentication restrictions.
In this session we will walk through the new features available on MongoDB 4.0:
Security enhancements and SHA-2 authentication
Change streams and read concern
MMAP deprecation on 4.2
MongoDB mobile database
It's been 3 years now since we've shifted 100% of our production workloads into containers. We will provide an overview of our infrastructure and environment, introduce our service discovery solution and reveal what we call "Backend High Availability Pillars". We will reveal our secrets to successfully operate stateful apps into containers and will detail our past and future challenges:
- 2014: config management (chef) to dedicated on-prem servers
- 2015: RKT containers orchestrated through Fleet on hundreds of on-prem servers
- 2017: RKT containers orchestrated through Kubernetes on hundreds of on-prem servers
- 2018: Docker containers orchestrated through Kubernetes on a Cloud Provider (WIP)
We will introduce Percona Server 8.0 - what's new since Percona Server 5.7 and how it's different from MySQL 8.0.
The session shows real use case scenarios for the MySQL 8 new features like Resource Groups, instant column addition and others that make DBA's life easier.
Have you heard about USE Method (Utilization - Saturation - Errors), RED (Rate - Errors - Duration) or Golden Signals (Latency - Traffic - Errors - Saturations)?
In this presentation, we will talk briefly about these different, but similar â€œfocusesâ€ and discuss how we can apply them to the data infrastructure performance analysis troubleshooting and monitoring.
We will use MySQL as an example but most of the talk will apply to other database technologies as well.
Backup is critical for database maintenance, especially when providing database service on the cloud. For Alibaba Cloud ApsaraDB, the backup system is one of the most import basic infrastructures and faces many challenges because of the cloud environment.
In this topic, I will share how we use and improve Percona XtraBackup to provide backup/recover service at Alibaba Cloud, such as backup validate, resource usage control, multi engines backup (InnoDB, TokuDB and MyRocks), and DB/Table level backup, etc.
Since the beginning, Facebook has used a conventional username/password to secure access to production MySQL instances. Over the last few years, we've been working on moving to x509 TLS client certificate authenticated connections. Given the many types of languages and systems at Facebook that use MySQL in some way - this required a massive amount of changes for a lot of teams.
This talk is a partially technical overview of how our new solution works and part hard-learned tricks for getting an entire company to change their underlying MySQL client libraries.
The optimizer is the "brain" of the database, interpreting SQL queries and determining the fastest method of execution. This talk uses the explain command to show how the optimizer interprets queries and determines optimal execution. The talk will assist developers and administrators in understanding how Postgres optimally executes their queries and what steps they can take to understand and perhaps improve its behaviour.
Every new version of MongoDB comes with exciting new features and a lot of improvements and version 4.0 couldn't be an exception to this rule. An upgrade from previous versions will unlock long waiting features like transactions but at the same time without proper planning could be catastrophic for your organization.
This presentation will guide you through the stapes for planning and implementing an upgrade to MongoDB 4.0. We will examine how MongoDB 4.0 affects your organization ecosystem and what changes might be necessary prior to the upgrade. We will demonstrate the upgrade steps with a detailed rollback plan. Finally, we will cover some post-upgrade considerations that will allow you to release the power of MongoDB 4.0.
How are you doing integration tests with your datastore?
* Mocking is not an option since you want to test the actual system.
* There are some in-memory implementations, like H2 or HSQLDB for relational databases, but there are still subtle differences to your production system and not all datastores have in-memory cousins.
* Using the actual datastore in your tests is possible, but managing it, running tests in parallel,... is far from ideal.
So what is the solution? There are some very neat solutions based on containers, namely the Docker-Maven-Plugin and TestContainers. From your tests you can start a lightweight, throwaway instance of your datastore and this talk will walk you through how to do that.
This session will be interesting for everyone looking for the latest news about MySQL 8.0 Performance:
- MySQL 8.0 is GA now !
- but what about MySQL 8.0 Performance? ;-)
- the latest benchmark results obtained with MySQL 8.0 will be in the center of the talk
- because every benchmark workload for MySQL is a "problem to resolve"
- and each resolved problem is a potential gain in your production!
- many important internal design changes are coming with MySQL 8.0
- how to bring them in action most efficiently?
- what kind of trade-offs to expect, what is already good, and what is "not yet"?
- how well MySQL 8.0 is able to use the latest HW?
- could you really speed-up your IO by deploying your data on the latest flash storage?
- these and many other questions are answered during this talk + proven by benchmark results.
NOTE: since MySQL 8.0 we're following a "continuous release" model, so with every update there is some new improvement coming, the performance included ;-))
Percona XtraDB Cluster (a.k.a PXC) is multi-master high-availability clustering solution. Given the multi-master aspect, there are multi-guards to protect cluster from entering an inconsistent state. Most of these guards are configurable based on user environment but if they are not configured properly it could cause the cluster to stall, fail, error-out.
In this session, we would go over some of these failure scenarios like cluster entering non-primary due to network partitioning, cluster stall due to flow control, data inconsistency causing shutdown of node, common problem during initial catch up (a.k.a State Snapshot transfer (SST)), delay in purging of transaction, blocking DDL causing complete cluster to staff, misconfigured cluster, etcâ€¦
We would also discuss how to solve some of these problems or have to safely recover from these failures.
Prometheus, now a graduated CNCF project, is the de facto leader in the monitoring and metrics space. With the 2.0 launch nearly a year behind us, we are now focused on making Prometheus boring. i.e, more stable, more usable and even MOAR user-friendly!
This talk will cover the new storage briefly and then move on to new developments and the future roadmap of the project which includes among other things better remote integrations, backfilling API, security improvements and OpenMetrics.
We would like to present our journey in building MySQL Database As A Service on OpenStack at Paddy Power Betfair.
We would like to discuss the help and support we have had from Percona throughout our adoption of MySQL at PPB and also how we met the challenges in building a mature DBaaS on PPB's private OpenStack cloud using Percona software.
At the Wikimedia Foundation, we aim for perfect privacy of our users. That means not only enforcing TLS (https) between our users and the datacenters but all intermediate steps, including database access.
When you are a top 5 website with hundreds of thousands of queries per second and billions of users but a very limited budget, that is not easy, especially for MySQL. This is a description of our experience, including operational and performance pain points, of rolling out encryption.
We also talk about what has changed in the ecosystem since the introduction of MySQL 8.0 and MariaDB 10.3.
PostgreSQL is an advanced open source database that is completely community driven. Continuous development and performance improvements while maintaining a secondary focus on Oracle compatibility gave PostgreSQL a great market penetration. When a database server is deployed in production we often wish to achieve several 9's of availability. Is that even possible with PostgreSQL? What is the combination of tools that you could combine and implement to achieve High Availability (HA) and automatic failover in PostgreSQL? How can we avoid data loss during such failover's? We'll address these questions and then some more in this talk.
In this talk we will cover the backup methods available on MongoDB, being from a simple mongodump to the hotbackup tool available on Percona Server for MongoDB.
Backups are important and more important is to be aware of the pros and cons of a backup method.
This is an intermediate topic for DBAs and SysAdmins who wants to learn a bit more about Backups.
Kubernetes, and its most popular distribution OpenShift, receives a lot of interest as a container orchestration platform. However, databases remain a foreign entity, primarily because of their stateful nature.
In this presentation I discuss how to deploy Open Source databases (MySQL/Percona XtraDB Cluster and MongoDB) on Kubernetes/Openshift. For Percona XtraDB Cluster (PXC) we will be using MySQL Proxy to implement read/write splitting.
If you have never used Kubernetes and Openshift, I will do a quick introduction to these technologies. There will also be a demo where I will set up a PXC cluster with ProxySQL as well as MongoDB replicaset in Openshift Origin and will try to break it.
By the end of this webinar you will have a better understanding of:
* How to leverage Kubernetes/Openshift in your environments
* How to deploy opensource databases in Kubernetes/Openshift with StatefulSet.
* How to operate the databases in Kubernetes
More and more people have mobile phones and more and more people use some IoT devices which are which are collecting many metrics and details example the Geo Locations.
In this presentation, I am going to focus on the Geo Location data and how the new features in MySQL 8 can help us.
I am going to show a use case from one of my customers. They are collecting location information from cars and one of their challenging problem to find cars which were crossing a randomly marked area on the map. I am going to show if MySQL 8 can help this and if yes how?
Also the "traditional" show me the hotels/restaurants/pubs nearby me or in this city, is there any improvement in MySQL 8 which can help us here?
During this talk, I explain how the Group Replication replication works.
This is a theoretical talk in which I explain in details what replication is and how it works.
I discuss what certification is and how it's done. What is XCOM and GCS?
Is Group Replication synchronous?
What is the benefit of Single Primary Mode?
What are the caveats of such replication?
Why is Paxos Mencius more efficient than Totem? Is it always?
After this presentation, the audience should be comfortable with the technical terms and understand how does it work.
Don't miss this talk, the magician will reveal his tricks!
The goal of is to show my own tools of administration & monitoring, I started developed this in 2010 like a mixte of commands for audit MySQL Server, after each client I improved this tools, today my clients enjoy to use PmaControl to know what happens with their database! The time is come to open this software.
What it's can do?
- No configuration / autodetection for all
- Replication monitoring
- Topology in real time (SST/Donor detection + progress)
- Clean efficiently
- UI for MySQL-sys
- BenchMark UI (with sysbench)
- Switch a slave to another master (even with M/S between them without GTID)
Taking existing infrastructure to Google Cloud has been a challenge, and our tiny team did it at breakneck speed. We survived that move and have the scars to prove it. We'll review how we got there, and the challenges that we've faced now that we're out of the datacenter. In this lecture, we will talk about the decisions that we've made for our high availability, DR solution, and database hosting.
* CloudSQL vs. Self-managed instance
* IOPS limitations
* Both bacon saving and issues that we've had with it.
* IP Aliases
* DR solution
A critical piece of your infrastructure is the database tier, yet people don't pay enough attention to it judging by how many are bitten via poorly chosen defaults, or just a lack understanding of running a secure database tier. In this talk, I'll focus on MySQL/MariaDB, PostgreSQL and MongoDB, and cover external authentication, auditing, encryption, SSL, firewalls, replication, and more gems from over a decade of consulting in this space from Percona's 4,000+ customers.
PostgreSQL is one of the leading open-source databases. Out of the box, the default PostgreSQL configuration is not tuned for any particular workload. The default configuration is designed in such a way that PostgreSQL can run on any system with least resources. PostgreSQL does not give optimum performance on high permanence machine because it is not using the all available resource. PostgreSQL provides a system you can tune your database according to your workload and machine specification. Other than PostgreSQL we can also tune our Linux box so that database load can work optimally. Here we learn how to tune PostgreSQL and will see the results of that tuning, We will also touch some of the Linux kernel parameters tuning.
NoSQL databases and especially MongoDB fits in all kind of companies - from small Startups to Enterprise Companies-.
In this talk, we will discuss how MongoDB can be used in Enterprise environment and what features Percona Server for MongoDB offers to help those companies to integrate MongoDB with an existing environment and also to be compliant with security certifications.
We will demonstrate use cases, how to configure roles-based access, LDAP integration, auditing, encryption at rest.
This talk will provide a high level overview of automation tooling, the pros and cons of each option, and how to apply them to managing the operations of your databases using working examples.
In this session, learn what happens in a MySQL 5.7-to-MySQL 8.0 upgrade. Discover how the upgrade precheck tool can help you prepare for your upgrade by identifying old issues in your database and collecting 5.7 metadata and re-establishing it in the uniformly stored MySQL 8.0 data dictionary. Other topics covered include upgrading from 8.0 and onward, going for an automated upgrade experience, and why an automated downgrade is challenging.
MySQL 8 is the new kid on the block, and Percona has already had some customers migrate excitedly to the new release. In this session learn practical migration knowledge: what you need to know if you're already an experienced MySQL DBA, and how to move from MySQL 5.5, 5.6, and 5.7 to MySQL 8.0. Topics covered include the stability of the new release, improvements around high availability, how MySQL 8.0 is more performant, all the new security features (from better passwords to roles) to aid in compliance, and of course, improved manageability and observability enhancements. This is a practical field guide for early MySQL 8 adopters.
Do you already run stock PMM in your environment and want to learn how you extend the PMM platform? Come learn about:
1. Dashboard Customizations
* How to create custom dashboard from existing graphs, or build Cross Server Dashboards
2. External Exporters - Monitor any service, anywhere!
* Adding an exporter, view the data in data exploration, to deploying a working Dashboard
3. Working with custom queries (MySQL and PostgreSQL)
* Execute SELECT statements against your database and store in Prometheus
* Build Dashboards relevant to your environment
4. Customizing Exporter Options
* Enable de-activated functionality that applies to your environment
5. Using Grafana Alerting
* How to set up channels (SMTP, Slack, etc)
* How to configure thresholds and alerts
6. Using MySQL/PostgreSQL Data Source
* Execute SELECT statements against your database and plot your application metrics
At Zalando we run PostgreSQL at scale: a few hundred database clusters in sizes from a few megabytes up to 10 terabytes of data. What is a bigger challenge than running a high-OLTP multi-terabyte PostgreSQL cluster? It is the migration of such a cluster from the bare-metal data center environment to AWS.
There were multiple problems to solve and questions to answer:
* Which instance type to choose: i3 with ephemeral volumes or m4/r4 + EBS volumes?
* Should we give Amazon Aurora a try?
* There is no direct connection from AWS to the data-center. How to build a replica on AWS and keep it in sync if VPN is not an option?
* The database is used by a few hundred employees for ad-hoc queries; ideally, they should retain access through the old connection url.
* How to backup such a huge DB on AWS?
* We should be able to switch back to the data-center if something goes wrong.
In this talk I am going to provide a detailed account of how we managed to successfully solve all these problems.
The purpose of the talk is to present data-at-rest encryption implementation in Percona Server for MySQL.
Differences between Oracle's MySQL and MariaDB implementation.
- How it is implemented?
- What is encrypted:
- General tablespace?
- Double write buffer/parallel double write buffer?
- Temporary tablespaces? (KEY BLOCKS)
- Slow/general/error logs?
- MyISAM? MyRocks? X?
- Performance overhead.
- Transportable tablespaces. Transfer key.
- Keyrings in general
- Key rotation?
- General-Purpose Keyring Key-Management Functions
- Is useful? How to make it profitable?
- Keyring Vault
- How does it work?
- How to make a transition from keyring_file
Locking is critical for providing high concurrency for any database you cannot fully utilize your hardware if locking is throttling its use. This talk explores all aspects of locking in Postgres by showing queries and their locks; covered lock types include row, table, shared, exclusive, and advisory lock types. The high concurrency provided by Multiversion Concurrency Control (MVCC) is also covered.
Introduction about MongoDB Shards and their internals. How to configure and form design for the Shards. Including multiple DC setup, backup instance etc. Explaining about the shard key and choosing the right one - pros and cons. What to do with the Shards and what not to do. tips and tricks & troubleshooting Shard related issues like orphan documents, duplicate _id etc due to application logic.
Apache Cassandra 4.0 has several enhancements. One of the biggest enhancements is switching from blocking network IO using JDK Sockets to Non-Blocking IO with Netty. As a result, Cassandra has seen gains in performance and efficiency. These gains translate into real-world costs and allow Cassandra to scale better. This presentation will take you on a tour of the improvements of Cassandra's network layer (old & new) and help quantify the gains in real-world terms.
Up to MySQL 5.5, replication was not crash safe: after a crash, it would fail with "duplicate key" or "row not found" error, or might generate silent data corruption. It looks like 5.6 is much better, right? The short answer is maybe: in the simplest case, it is possible to achieve replication crash safety but it is not the default setting. MySQL 5.7 is not much better, 8.0 has safer defaults but it is still easy to get things wrong.
Crash safety is impacted by replication positioning (File+Pos or GTID), type (single-threaded or MTS), MTS settings (Database or Logical Clock, and with or without slave preserve commit order), the sync-ing of relay logs, the presence of binary logs, log-slave-updates and their sync-ing. This is very complicated stuff and even the manual is confused about it.
In this talk, I will explain the impact of above and help you finding the path to crash safety nirvana. I will also give details about replication internals, so you might learn a thing or two.
In this presentation attendees will see the performance of a MySQL Server increase by automatic tuning using an open source GA (Genetic Algorithm) with surrounding smart bits. The full interface code will be made publicly available as open source on GitHub.
Genetic Algorithms - a kind of Artificial Intelligence - have been used for a long time, but only recently the interest towards database applications has spiked.
You will see the transactions per second increase and increase again as the server is being adjusted automatically.
You will walk away with a better understanding of Genetic Algorithms, it's application to automated database tuning, and how to start with (or continue) your own experiments in this area.
All new work, this setup has not been showcased anywhere before.
Troubleshooting the database-related problems turns out to be not a simple task even if you run your database on-premise. And performance debug can become a nightmare when you run it as a managed service in AWS/GCP/Azure, because you have no access to the underlying OS, and series of DB metrics gathered by your monitoring solution is the only subject you have to explore.
The talk will make an overview of a monitoring possibilities available for MySQL/PostgreSQL managed database in case of AWS, GCP, and Azure cloud providers. We will review what monitoring data can be gathered, speak about data granularity, and discuss ways to export these metrics to Prometheus for their simplified representation and wide/complex troubleshooting analysis of the whole instance.
Keeping data safe is the top responsibility of anyone running a database. Learn how the Google Cloud SQL team protects against data loss. Cloud SQL is Google's fully-managed database service that makes it easy to set up and maintain MySQL and PostgreSQL databases in the cloud. In this session, we'll dive into Cloud SQL's storage architecture to learn how we check data down to the disk level. We will also discuss PostgreSQL checksums and infrastructure Cloud SQL uses to verify that checksums for data files are accurate without affecting performance of the database.
In this talk, we take a look at the whole stack and I don't just mean LAMP,
we'll cover what an attack surface is and some areas you may look to ensure
that you can reduce it.
What's an attack surface?
Acronym Hell, what do they mean?
Vulnerability naming is this media naming stupidity or driving the message
Detection, Prevention and avoiding the boy who cried wolf.
Emerging technologies to keep an eye on or even implement yourself to help
improve your security posture.
A live compromise demo (or backup video if something fails) which covers
compromising a PCI compliant network structure to reach the database system
and ultimately exploit multiple failures to gain bash shell access over the
The Elephant Shed is an Open Source PostgreSQL Appliance that bundles and integrates proven components, required for easy management of a PostgreSQL server.
It takes more than one piece of software to create a reliable and serviceable platform. There are different approaches to fill the gap, but usually Open Source offers all the bits and pieces needed. However, these need to be well integrated. Elephant Shed is such an integration of all the necessary tools for a high-performance PostgreSQL platform.
The wheel is not reinvented. Instead of new developments, established and reliable open source projects that fullfill the needs of the specific aspect are assembled into the Elephant Shed PostgreSQL appliance. These are integrated within a single user interface. Automated scripts in the background ensure that the interaction of all these tools runs smoothly.
This presentation reasons why Elephant Shed was created and shows the technical details and the advantages it brings.
Learn how to monitor MongoDB using Percona Monitoring and Management (PMM) so that you can:
* gain greater visibility of performance and bottlenecks MongoDB
* Consolidate your MongoDB servers into the same monitoring platform you already use for MySQL and PostgreSQL
* Respond more quickly and efficiently in Severity 1 issues
We'll show how using PMM's native support for MongoDB so that you can have MongoDB integrated in only minutes!
Prometheus has become the go-to system for monitoring cloud-native infrastructures such as Kubernetes, with lots of integration points and options.
In this talk, we will look at all the relevant pieces for setting up Prometheus monitoring of your Kubernetes cluster - primarily from a user's perspective but also peeking under the hood to see how things work.
On the Prometheus side, we'll cover the different ways that service discovery and relabelling can be used, and how they make Prometheus so flexible.
On the Kubernetes side, we'll look at the alphabet soup of available metrics exporters (kube-state metrics, cAdvisor, node exporter, and friends).
Finally, we'll take a step back and consider how Prometheus' somewhat unique design and feature set fits into the broader landscape of monitoring systems, and how it is especially suited to cloud-native environments like Kubernetes.
MySQL 8 introduces a feature that is explained in a single document page, but that can help a lot if correctly used.
It is well hidden, in the optimization: optimizing of the MySQL server chapter.
I am talking of Resource Groups.
Resource groups permit assigning threads running within the server to particular groups so that threads execute according to the resources available to the group.
Group attributes enable control over its resources, to enable or restrict resource consumption by threads in the group. DBAs can modify these attributes as appropriate for different workloads.
This small simple feature can be a blast in case you have contention between different type of load on your database.
The simplest example is a combination of OLTP/OLAP or OLTP/ETL.
In this presentation, I will illustrate the feature and how it can be easily and successfully implement.
Also covering those contexts, like large enterprises, where code dynamic is not as agile as we would like to be.
MySQL 8.0 makes it possible to write queries that do more. MySQL can now traverse hierarchies, analyze data in new ways, and combine JSON and spatial data with traditional types -- all in the same query.
In this talk, we'll look at common table expressions (CTEs), window functions, geography support and JSON functionality, and how these can be used to do things no MySQL query has ever done before.
If you're curious about what these features are or what you can do with them, then this talk is for you.
Getting Percona Monitoring and Management (PMM) up and running on Docker is just a matter of a few simple steps. Now, if your goal is to have a production-ready, long term monitoring solution, there are additional points to consider.
Furthermore, using PMM's stack for other components of your infrastructure may be a good way to consolidate monitoring across your systems.
In this session we are going to cover both tweaking your PMM installation for production and options to extend its default capabilities.
MyRocks is widely used in Alibaba Cloud products, including RDS MySQL and HybirdDB for MySQL. We have many improvements on MyRocks, such as
Online backup MyRocks
A new feature, secondary clustering index
Optimizing auto increment insert
Optimizing replace into
The MariaDB Foundation has started a new effort to coordinate finding and fixing security vulnerabilities in the code base of MariaDB and MySQL.
In this talk, the current activities of the MariaDB Foundation's security efforts are presented, including for example, the recently devised Responsible Disclosure Policy and Hacker One bug bounty program, as well as future plans for continuous and automated security testing to be baked into our Continuous Integration and Testing pipelines.
As one of the world's most popular piece of server software and part of critical infrastructure, hosting vast amounts of databases, it is crucially important that it stays safe and operates without security issues. History has shown us we cannot trust any piece of software to be inherently secure, thus any project must have proper vulnerability disclosure and management procedures, be eager to collaborate with the security community and follow disclosure guidelines, as well as pro-actively look for security bugs in their own code base.
Learn how to monitor PostgreSQL using Percona Monitoring and Management (PMM) so that you can:
* gain greater visibility of performance and bottlenecks PostgreSQL
* Consolidate your PostgreSQL servers into the same monitoring platform you already use for MySQL and MongoDB
* Respond more quickly and efficiently in Severity 1 issues
We'll show how using PMM's native support for PostgreSQL (as of Release 1.14) that you can have PostgreSQL integrated in only minutes!
After working with MongoDB on different projects for more than 5 years, I've collected a few interesting tips/scripts that may help you with your projects and day-to-day tasks. These are some the areas I'll be referring to:
-Sharded clusters maintenance
Learn about different use cases for Percona Server for MongoDB on DC/OS, and see just how easy it is to configure a Percona Server for MongoDB cluster on this enterprise-grade platform.
Lots of database operations require the use of temporary tables. MySQL creates these temporary tables transparently, but this behaviour can be tuned and configured for optimal performance.
MySQL 8 introduces a new engine for in-memory temporary tables, that can replace the Memory engine used in previous releases.
In this session, we will offer an overview of the operations that require temporary tables and present the configuration options that rule this feature.
We will also show some benchmarks to compare the performance of the different internal temporary table engines.
Lag in asynchronous replication is proportional to the gap in throughput between the master and slave. While a great deal of work has been done to make masters faster on multi-core machines, slaves have been left behind. Today, the master-slave throughput gap is essentially a parallelism gap. Parallel application of a serial log of transactions is not trivial.
In this work, our aim was to match the slave's throughput with the master's instead of just making it 'X' times faster. We use information already present in row based binary logs to extract fine-grained dependencies between row mutations which enables the slave to schedule transactions to multiple threads just like the master would have. We also explore how we can relax the transaction execution model on the slave to make them more lightweight and boost single threaded performance.
TiDB is an open source distributed scalable hybrid transactional and analytical processing (HTAP) database built by PingCAP. It also speaks the MySQL protocol and uses RocksDB as the underlying storage engine!
This talk provides an introduction and overview of TiDB, tailored for those with a strong background in MySQL. I will use MySQL as an example to explain various implementation details of TiDB, and translate terminology to MySQL/InnoDB terms.
A new DB stack needs to be deployed and a decision needs to be made where to deploy it ...
Use dedicated servers, on-prem or via an IaaS provider, as that is how and where the application is running, or maybe because there is extensive config management available that will make the job quick and easy?
Or go DBaaS because that is the future and a lot of companies are taking that route? Or the thought of not having to worry about all of the Operating system quirks, including security issues, is really appealing to you?
In this talk, we're going to have a look at the benefits and restrictions of Roll-your-Own vs DBaaS, more specifically Amazon RDS/Aurora and Google CloudSQL
Security should always be one of your top concerns for any database deployment. In this talk I will discuss the top 5 things you can do to secure your PostgreSQL database. Using real world use cases and common practices, I will outline what is available to you as an IT professional to ensure you can make your PostgreSQL database secure. The session will focus on versions 9.6 and 10.
Percona's CMO, Laurie Coffin, opens the keynotes!
Geir Hoydalsvik will talk about the focus, strategy, investments and innovations evolving MySQL to power next-generation Web, mobile, Cloud and embedded applications. He will also discuss the latest and the most significant MySQL database release ever in its history, MySQL 8.0.
Amazon RDS is a fully-managed database service that allows you to launch an optimally configured, secure and highly available database with just a few clicks. It manages time-consuming database administration tasks, freeing you up to focus on your applications and business. This keynote features the latest news and announcements from RDS including the launches of Aurora Serverless, Parallel Query, Backtrack, RDS MySQL 8.0, PostgreSQL 10.0, Performance Insights, and several other recent innovations.
This keynote talk will provide an architectural overview of TiDB, how and why it's MySQL compatible, the latest features and improvements in TiDB 2.1 GA release, and how its multi-cloud fully-managed solution works.
In this keynote, Yoshi will share interesting lessons learned from Facebook's production deployment and operations of MyRocks and future MyRocks development roadmaps. Vadim will discuss MyRocks in Percona Server for MySQL and share performance benchmarks tests from on-premises and cloud deployments.
The market coined the term "enterprise grade" or "enterprise ready" to differentiate products and service offerings for licensed database software. For example: there may be a standard database software or an entry-level package that delivers the core functionality and basic features. Likewise, there may be an enterprise version, a more advanced package which goes beyond the essentials to include features and tools indispensable for running critical solutions in production. With such a differentiation found in commercial software, we may wonder whether a solution built on top of an open source database like PostgreSQL can satisfy all the enterprise requirements.
So, in this talk, we shall discuss how you can build an Enterprise Grade PostgreSQL using open source solutions.
You need to store and retain time-series data in MongoDB and HDDs can't keep up with your insert rate, but you can't afford to keep everything on SSD? Then this presentation is for you. You'll learn how to use sharding and shard tagging to keep your inserts and most recent data on the fast SSDs and your archived data on the cheap HDDs, and how to quickly and efficiently transition data from SSD to HDD. You'll also learn the best programming techniques for adding your time-series data and accessing the data as a stream without missing any data points.
Provide a look at what is Optane Technology at Intel and how some of the Software add-ons and Open Source Databases test out on this technology.
In this session, Arjen provides an overview of the shiny new in MariaDB Server 10.3, as well as putting a spotlight on the many other little improvements and their contributors, which together make the MariaDB ecosystem thrive.
Both Galera and Group Replication provide clustering solution with virtual synchronous replication. The different replication technologies used by these two products ensure that data is replicated, consistent and safe and that several failure scenarios can be handled maintaining high availability. Although the database layer is highly available, applications rarely know the status of the various nodes in the cluster, therefore sending traffic to the wrong node(s) in a degraded system can lead to a high error rate.
ProxySQL has the ability to regularly check the status of the various nodes in the cluster, and determine which nodes are healthy and where to send traffic.
This session will present how to configure ProxySQL as a middle layer between the application and a clustering solution with either Galera or Group Replication, what algorithms are used to route traffic to the right node(s) and ensure that high availability is achieved even in case of degraded cluster conditions.
ClickHouse is fast and scalable open source SQL DBMS from Yandex. In this talk, I will briefly review what's new in 2018, and concentrate on advice and case studies how ClickHouse can solve immediate problems without significant investments of time and resources. ClickHouse can handle petabytes of data, but it perfectly works for smaller projects, thanks to its performance and easy integration with MySQL, Logstash and other open source technologies.
Amazon Aurora is a fully managed relational database service that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. With Aurora, we've completely reimagined how databases are built for the cloud, providing you higher performance, availability, and durability than previously possible. We'll dive deep into architectural details of Amazon Aurora with MySQL and PostgreSQL compatibility and review recent innovations such as Parallel Query, Backtrack, Serverless, and Multi-Master, along with best practices for utilizing the power of relational databases at cloud scale.
In this day and age, maintaining privacy throughout our electronic communications is absolutely necessary. Creating user accounts and not exposing your MongoDB environment to the wider internet are basic concepts that have been missed in the past. Once that has been addressed, individuals and organizations interested in becoming PCI compliant must turn to securing their data through encryption. With MongoDB, we have two options for encryption: at rest (only available as enterprise feature with MongoDB) and transport encryption. In this session, we will review
-Why encryption is important
-What are the prerequisites to set up encryption
-Step by step for encryption at rest and in transit
-Encrypting data with volume encryption in the cloud
-Percona for MongoDB encryption features
PostgreSQL has seen increasing enterprise adoption over the last years. While it has always been considered a rock-solid and secure data base system, recent years brought native replication and partitioning, JSON support as well as increasing federation to other databases or data sources. Operational features like high availability, horizontal and vertical scalability or zero-downtime upgrades can be achieved natively and/or via external projects.
This talk will present the most important enterprise-related features currently implemented in PostgreSQL and provide examples on how use them. It will also discuss features or areas that could potentially hamper adoption.
Redundancy and high availability are the basis for all production deployments. With MongoDB this can be achieved by deploying replica set. In this talk we'll explore how MongoDB replication works and what are the components of a replica set. Using examples of wrong deployment configurations, we will highlight how to properly run replica sets in production, whether it comes to on-premise deployment or in the cloud.
-How MongoDB replication works
-Replica sets components/deployment typologies
-Practices for wrong deployment configuration
-Hidden nodes, Arbiter nodes, Priority 0 nodes
-Availability zones and HA in single region
-Monitoring replica sets status
Graph databases allow users to analyze highly interconnected datasets and find patterns within these relationships. Social networks, corporate hierarchies, fraud detection, network analytics, or building whole knowledge graphs are great use cases for graph databases. However, these datasets of nodes and connecting edges change over time. Whether you are a developer, architect or data scientist, you may want to time travel for analyzing the past or even predict tomorrow.
While your graph database may be lacking built-in support for managing the revision history of graph data, this talk will show you how to manage it in a performant manner for general classes of graphs. Best of all, this won't require any groundbreaking new ideas. We'll simply borrow a few tools and tricks from existing persistent data structure literature and adapt them for good performance within the graph database software.
How do you exclude one table access from a database with too many tables? In previous versions of MariaDB and MySQL, you have to specifically grant access to all other tables individually. This does not scale, especially if tables are created and dropped frequently.
Reverse privileges solve this problem and many other use cases. With just one SQL statement you can ensure a user can never access a resource, regardless which roles or other privileges are granted to it.
Reverse privileges do not work in a vacuum, so we will start with a broad view of the full privilege system, before diving into the specifics of denying access to resources.
MyRocks is a new storage engine from Facebook and available in Percona Server for MySQL. In what cases you will want to use it? We will check different workload and when MyRocks is most suitable for you. Also as for any new engine, it might be not trivial to set up and tune it properly, so we will review the most important settings to pay attention to.
I will talk about unusual and unique ClickHouse features:
- aggregation states as first-class citizens;
- multidimensional arrays and higher-order functions;
- approximate query execution;
- incremental data aggregation;
- query processing without the server;
I will show practical examples and use cases from Yandex and other companies.
Amazon Aurora Serverless is an on-demand, auto-scaling configuration for Aurora (MySQL-compatible edition) where the database will automatically start up, shut down, and scale up or down capacity based on your application's needs. It enables you to run your database in the cloud without managing any database instances. Aurora Serverless is a simple, cost-effective option for infrequent, intermittent, or unpredictable workloads. We'll explore these use cases, take a look under the hood, and delve into the future of serverless databases. We'll also hear a case study from a customer building new functionality on top of Aurora Serverless.
In this session get an overview of all the new security features in MySQL 8.0 and how they fit together to answer the modern security challenges. MySQL 8 takes a new step in tightening the security of MySQL installations and provides new and flexible tools including a brand new default authentication method, SQL roles, enhancements in transparent disk encryption, and modern password controls on password reuse, complexity, and brute force password guessing.
This session will provide a brief overview of container options (Docker, OpenShift, AWS) for PostgreSQL and MySQL. We'll discuss the benefits of containers and how to administer, develop and monitor your database on containers. I'll also review and answer the top questions I get on containers.
MongoDB 4.0 finally supports multi-document ACID transactions. During the presentation, we'll discuss what is a transaction and what ACID properties are.
We'll show how to use transactions in MongoDB doing some real example and we'll discuss the pros and cons and current limitations.
Vitess has many features which make it easy for it to be deployed on a container orchestration framework like Kubernetes.
+ Master fail overs without client seeing errors
+ Fast discoverability of masters and replicas
+ Excellent observability
+ Multi-cell high availability support
During this talk, I will describe these features.
Then we will switch gears I will demonstrate a new Vitess feature: VReplication.
This talk will be an overview of new features in both MariaDB Server 10.3 and MySQL 8.0, as well as a compare/contrast of how certain features are implemented. There will be a look into some of the ways in which MariaDB and MySQL have diverged.
The recent enhancements to MySQL replication make operations easier, further reduce the administrative overhead, provide a much-improved user experience, and enable running MySQL smoothly both at scale and/or in very tightly coupled network infrastructures such as in a
Come and join the engineers behind the product to get to know the latest and greatest replication features and how these enable the creation of rock solid, scalable and resilient database services able to keep up with the most demanding work and fault-loads. Take this opportunity to expend your MySQL knowledge and learn more about hot
topics such as Group Replication/InnoDB Cluster.
At MessageBird we send hundreds of millions of messages across the world every month, which generate billions of events. Providing real-time* analytics is key to being able to quickly deliver those messages to our customers. From measuring and optimising the performance of our platform, to providing insights to our customers, ClickHouse is being used far and wide inside our organisation.
In this talk, we look into how Clickhouse allows us to ingest a large amount of data and run complex analytical interactive queries. We also present the business needs that brought ClickHouse to our attention and detail the journey to its deployment. We cover the problems we faced, and how we dealt with them. We talk about our current Cloud production setup and how we deployed and use it. Last but not least, we talk about mistakes we did along the way and what we learned from running and maintaining a ClickHouse cluster by ourselves.
In recent years, MySQL has become a top database choice for new application development and migration from overpriced, restrictive commercial databases. We'll provide an overview of the MySQL and MariaDB options available on AWS, and do a deep dive on Amazon Relational Database Service (RDS), a fully-managed MySQL service, and Amazon Aurora, a MySQL-compatible database with up to 5x the performance and many additional innovations.
Security is always a challenge when we come to data but regulations like GDPR brings a new layer on top of it with rules more and more restrictive to access and manipulate data. Join us in this presentation to check security best practices, traditional and new features available for MySQL including features coming with the new MySQL 8.
On this talk DBA's and sysadmins will walk through the security features available on the OS and MySQL:
MySQL 8 features (undo, redo and binlog encryption)
We will share our experience of working with 2000 support customers and help the audience to become familiar with all the security concepts and methods, and give you the necessary knowledge to apply to your environment.
pg_chameleon is a lightweight replication system written in python. The tool can connect to the MySQL replication protocol and replicate the data changes in PostgreSQL.
Whether the user needs to set up a permanent replica between MySQL and PostgreSQL or perform an engine migration, pg_chameleon is the perfect tool for the job.
The talk will cover the history the current implementation and the future releases.
The audience will learn how to set up a replica from MySQL to PostgreSQL in a few easy steps. There will be also a coverage on the lessons learned during the tool's development cycle and a small demo.
Database performance affects organizational performance, and we tend to look for quick fixes when under stress. But how can we better understand our database workload and factors that may cause harm to it? What are the limitations in MongoDB that could potentially impact cluster performance?
In this talk, we will show you how to identify the factors that limit database performance. We will start with the free MongoDB Cloud monitoring tools. Then we will move on to log files and queries. To be able to achieve optimal use of hardware resources, we will take a look into kernel optimization and other crucial OS settings. Finally, we will look into how to examine performance of MongoDB replication.
At Facebook, we created MyRocks (RocksDB Storage Engine for MySQL) a few years ago. Since then, we have migrated from InnoDB to MyRocks in our top three largest database services, including Facebook Messenger. On the other hand, we still have many InnoDB instances, especially for general purpose use cases. At previous Percona Live conferences, I spoke about how we migrated from InnoDB to MyRocks. In this session, I am going to talk more about lessons learned after migration. Topics like what kinds of production issues we faced will be covered. I am also going to talk about how we migrated Facebook Messenger -- from HBase to MyRocks.
Database optimizers are constantly improving. During this session, we will cover the new optimizations implemented by the optimizer team for MariaDB 10.3 release and the planned projects for the next 10.4 release.
* Condition Pushdown through GROUP BY and PARTITION BY
* Split-grouping for derived tables (a guaranteed speedup where the optimization applies)
* Improved Engine-Independent Table Statistics support
* New optimizer default settings
We store data with the intention to use it: search, retrieve, group, sort... To perform these actions effectively MySQL storage engines index data and communicate statistics with the Optimizer when it compiles a query execution plan. This approach works perfectly well unless your data distribution is not even.
Last year I worked on several tickets where data follow the same pattern: millions of popular products fit into a couple of categories and rest used the rest. We had a hard time to find a solution for retrieving goods fast. Workarounds for version 5.7 were offered. However new MySQL 8.0 feature: histograms, - would work better, cleaner and faster. This is how the idea of the talk was born.
I will discuss
- how index statistics physically stored
- which data exchanged with the Optimizer
- why it is not enough to make correct index choice
In the end, I will explain which issues resolve histograms and why using index statistics is insufficient for fast retrieving of not evenly distributed data.
MySQL and PostgreSQL are the two most popular open-source relational databases. To help to choose between them, a comparison of their query optimizers has been carried out. The aim of this session is to summarize the outcome of the comparison. Specifically, to point out optimizer-related strengths and weaknesses.
As more and more people are moving to PostgreSQL from Oracle, a pattern of mistakes is emerging. They can be caused by the tools being used or just not understanding how PostgreSQL is different than Oracle. In this talk, we will discuss the top mistakes people generally make when moving to PostgreSQL from Oracle and what the correct course of action.
The purpose of the talk is to present how to enable SSL and data-at-rest encryption and to how SSL and data-at-rest encryption work in under-the-hood of Percona XtraDB Cluster. The presentation will cover a process of making Percona XtraDB Cluster (PXC) secure.
- A configuration of Client-Server Traffic encryption. Is there any difference between C-S encryption in PXC and PS?
- A configuration of replication encryption (SST, IST). How does it work under-the-hood?
- How to make things more comfortable with the pxc-encrypt-cluster-traffic variable.
- PXC data-at-rest encryption. How does it work? How to configure it?
Is there any part of data that is unencrypted? Yes.
- Temporary files encryption.
- Binlog encryption. Possible or not?
- keyring_file. Is useful? How to make it profitable?
- keyring_vault. How does it work?
- Is Mix-match keyring plugins possible? Yes, but useful only when transitioning from keyring_file.
- What is happening in SST when data-at-rest is enabled?
- Performance overhead.
PostgreSQL provides a way to communicate with external Data sources which can be another PostgreSQL instance or any other Database. The other database can be a Relational database like MySQL, Oracle or any NoSQL Database like MongoDB or Hadoop. PostgreSQL Implements ISO Standard call SQL-MED to achieve that capabilities. This Presentation will explain the advantage of this feature and the working of that feature with examples.
* What do writeConflicts indicate?
* Internal writeConflicts process
* When does writeConflicts indicate a problem?
- Small number of writeConflicts/sec
- Large number of writeConflicts/sec
* What to do if you see a large number of writeConflicts/sec
* Identify the operation causing conflicts in the mongod log file
* Improving update operation patterns
The myth that containers aren't ready for databases still persists. We're not buying it.
We have built and open-sourced the MySQL operator for Kubernetes to solve this problem as a layer in the Presslabs stack for open WordPress hosting infrastructure.
We operate with lots of small to medium-sized DBs, in a DB-per-service model, as we call it. The workloads are mostly reads, so we need to efficiently scale that. The MySQL asynchronous replication model fits the bill very well, allowing to scale horizontally from one server (with the obvious availability pitfalls) to tens of nodes.
The operator is based on Percona Server for MySQL for its operational improvements â€”like utility user and backup locksâ€”and relies on Orchestrator to do the automatic failovers.
We plan to integrate it with Percona Management & Monitoring. Community feedback on the operations it automates and to make sure that the data is safely stored is very welcome.
MariaDB 10.3 introduced system-versioned tables. This session explains what we can do with this feature, how to investigate data changes, how to emulate some data warehouse functionalities, how to recover from certain human mistakes.
MySQL replication allows you to write on one writer server and easily scale out reads by redirecting reads to reader servers. But how do we guarantee read consistency with their last write? Galera replication can guarantee that, while MySQL Group Replication and standard MySQL async replication cannot.
If you are running MySQL Server or Percona Server, version 5.7 or newer, with GTID enabled, ProxySQL 2.0 is now able to ensure read consistently with the last write. ProxySQL is able to stream GTID information from all the reader servers, and in real-time is able to determine which reader server(s) is able to execute the SELECT statement producing a resultset that is read consistently with the last write (and GTID) executed by each client.
This presentation will show the technical details that allow you to build an architecture with thousands of ProxySQL instances and MySQL servers, and how GTID information is processed in real-time with limited bandwidth footprint.
Have you ever heard of Graph databases? You should!
Graph databases are optimised to manage fast storage and traversal of nodes and their relationships. In simple terms, they make relationships (or joins in relational jargon) first-class citizens and queries of interrelated nodes blazing fast.
This talk is about the basic concepts of Graph databases and Neo4j, an open source database server build from the ground up for graphs.
We will cover these topics:
- Intro to graphs and why they matter in the database world
- Graphs modelling for relational minds: how to build graphs and how to make the most out of it
- Intro to Neo4j - architecture and use cases
- Cypher, a declarative graph query language
- Neo4j installation and use cases
Managed database services are gaining in popularity. In this session we look at how best to configure Amazon RDS for PostgreSQL and also look at common user operations of using RDS for PostgreSQL. We will also look beyond common user operations and into some specific optimizations related to upgrade, logical replication, performance, and reducing downtime.
This session describes existing encryption-at-rest features for MongoDB, with a focus on what is freely available in open source packages. You'll learn how to set it up, how to rotate your master keys, and how to achieve full encryption rotation. You'll also learn about the future direction for open source alternatives for MongoDB encryption.
Or to be better say my PostgreSQL "hello World".
In this presentation I will illustrate the ways, the accidents and the surprises I had in my journey as MySQL DBA to implement a specular solution with PostgreSQL as total probie.
I will start from the basics, covering my journey in:
- Basic configuration
- Security definition
- Create a database and tables
- The magic behind indexes
Do you ever wonder why your MongoDB databases seem to be much slower than expected? Do you experience periodical hot spots and want to know the culprit(s)? Do you want to know which database operations are the most expensive and the ones most meaningful to improve?
In this talk you will quickly understand the limits of MongoDB's built-in database profiler, especially in sharded environments. I will present an open source tool we developed to solve these issues. We created a tool that collects, stores and helps to visually analyze slow MongoDB operations. By using the tool you will get a better picture of your MongoDB clusters without the need of a deeper MongoDB expertise. The tool runs database commands simultaneously against a multitude of databases or mongod's and with just a few clicks you can easily intervene and spot performance issues.
We present a kV database named "SharedRocks" which use d master-slave replication architecture for single write and multi-reads. It has high availability feature and easy to recovery from crashing. It's built on RocksDB which is the most popular key-value storage engine and PolarStore(PolarFS). The Alibaba's shared file storage. The shared file storage engine provides file persistence with three replicas and variety of new generation hardwares like RDMA, SPDK, etc. SharedRocks implements the master-slave replication between SharedRocks data nodes that are distribution architecture. SharedRocks' read only(slave) nodes are deployed very convenient. because of both of data and status are persistent on shared file storage. SharedRocks can access them anywhere..
So, you are a developer or sysadmin and showed some abilities in dealing with databases issues. And now, you have been elected to the role of DBA. And as you start managing the databases, you wonderâ€¦
* How do I tune them to make best use of the hardware?
* How do I optimize the Operating System?
* How do I best configure MySQL or MariaDB for a specific database workload?
If you're asking yourself the following questions when it comes to optimally running your MySQL or MariaDB databases, then this talk is for you!
We will discuss some of the settings that are most often tweaked and which can bring you significant improvement in the performance of your MySQL or MariaDB database. We will also cover some of the variables which are frequently modified even though they should not.
Performance tuning is not easy, especially if you're not an experienced DBA, but you can go a surprisingly long way with a few basic guidelines.
MySQL 8.0 introduced the new MySQL Document Store, which combines the
robust relational foundation and the power of the SQL language in MySQL
with CRUD-style document access in a NoSQL database. In this session, we
runtime, and MySQL 8.0's X DevAPI to build modern applications. This
session describes the architecture of the MySQL Document Store, the X
DevAPI, the X Protocol and related new technologies.
Percona Monitoring and Management (PMM) is a free and open-source solution for managing and monitoring MySQL and MongoDB performance. It provides accurate per-second analysis for MySQL and MongoDB servers, which allows you to tune the database as efficiently as possible.
This session will also be a review of internal PMM architecture, an overview of all components, and the communications between them.
In this session, we will dive deep into HOT (Heap Only Tuple) update optimization. Utilizing this optimization can result in improved writes rates, less index bloat and reduced vacuum effort but to enable PostgreSQL to use this optimization may require changing your application design and database settings. We will examine how the number of indexes, frequency of updates, fill factor and vacuum settings can influence when HOT will be utilized and what benefits you may be able to gain.
Information security continue to be a major concern and priority of organizations, as regulations such as GDPR continue to drive compliance requirements. Databases are of particular interest, as this is where all data, including sensitive information, is stored. As the amount of data collected continues to soar, and as the types of open source databases deployed for specific applications continue to expand, business risk continues to increase. Fortunately there are some basic steps you can take to improve your security hygiene and effective solutions to help you mitigate risk.