Aug 20, 2025 |
Insight for DBAs, PostgreSQL
In my previous blog post, Integrating Citus with Patroni: Sharding and High Availability Together, I explored how to integrate Citus with Patroni and demonstrated how basic table distribution works. In this follow-up post, I will discuss various other Citus distribution models. We will also explore how shard rebalancing and data movement are handled and further […]
Aug 04, 2025 |
Insight for DBAs, Insight for Developers, PostgreSQL
Citus is a PostgreSQL extension developed with the intention of sharding and distributing the data across multiple machines. It offers features like distributed tables, reference tables, schema-based sharding and columnar storage. We have already covered the basics of Citus and the initial setup part in some earlier blog posts: How To Scale a Single-Host PostgreSQL […]
Jun 20, 2025 |
Insight for DBAs, MySQL, Storage Engine
Managing farms of MySQL servers under a replication environment is very efficient with the help of a MySQL orchestrator tool. This ensures a smooth transition happens when there is any ad hoc failover or a planned/graceful switchover comes into action. Several configuration parameters play a crucial role in controlling and influencing failover behavior. In this […]
May 08, 2025 |
Insight for DBAs, MySQL
Innodb Cluster or ClusterSet topologies already have secondary instances that can act as a failover for primary or also offload read requests. However, with MySQL 8.4, we now have the feasibility of adding a separate async replica to the cluster for serving various special/ad-hoc queries or some reporting purposes. This will also help offload read traffic away […]
Mar 13, 2025 |
Cloud, Insight for DBAs, PostgreSQL
In this brief blog post, we will talk about Barman cloud utilities, which greatly ease the process of storing backups on cloud platforms like GCP, AWS, Azure, etc. Backups are of paramount importance, and in PostgreSQL, we also need to retain the WAL files, which can be used for various purposes like incremental backups or […]
Feb 14, 2025 |
Insight for DBAs, MySQL
As we know, Orchestrator is a MySQL high availability and replication management tool that aids in managing farms of MySQL servers. In this blog post, we discuss how to make the Orchestrator (which manages MySQL) itself fault-tolerant and highly available. When considering HA for the Orchestrator one of the popular choices will be using the Raft consensus. […]
Jan 02, 2025 |
Insight for DBAs, PostgreSQL
As we know, Patroni is a well-established standard for an HA framework for PostgreSQL clusters. From time to time, we need to perform maintenance tasks like upgrading the topology or making changes to the existing setup. Here, we will discuss mainly how we can replace the IP/Host information in Patroni and Etcd layers. Below, we […]
Dec 10, 2024 |
Insight for DBAs, Percona Software, Valkey
In this blog post we will talk about how to get useful information out of the Valkey OR Redis keys. This would be helpful in many scenarios, like troubleshooting a specific key thing and verifying the resources, especially the “Memory” the data set is holding. Let’s see a few bunch of operations we can perform […]
Nov 05, 2024 |
Insight for DBAs, Open Source, Valkey
Managing keys inside Valkey/Redis is crucial, especially when we need to test in a different environment or restore a partial/specific key-value dataset for a migration or production movement event. Although we can use a full RDB snapshot + AOF to get the full data set, that is not always feasible if we focus on a […]
Sep 25, 2024 |
Benchmarks, Insight for DBAs, MySQL
In this blog post, we will explore how network partitions impact group replication and the way it detects and responds to failures. In case you haven’t checked out my previous blog post about group replication recovery strategies, please have a look at them for some insight. Topology:
|
node1 [localhost:23637] {msandbox} ((none)) > select * from performance_schema.replication_group_members; +---------------------------+--------------------------------------+-------------+-------------+--------------+-------------+----------------+----------------------------+ | CHANNEL_NAME | MEMBER_ID | MEMBER_HOST | MEMBER_PORT | MEMBER_STATE | MEMBER_ROLE | MEMBER_VERSION | MEMBER_COMMUNICATION_STACK | +---------------------------+--------------------------------------+-------------+-------------+--------------+-------------+----------------+----------------------------+ | group_replication_applier | 00023637-1111-1111-1111-111111111111 | 127.0.0.1 | 23637 | ONLINE | PRIMARY | 8.0.36 | XCom | | group_replication_applier | 00023638-2222-2222-2222-222222222222 | 127.0.0.1 | 23638 | ONLINE | SECONDARY | 8.0.36 | XCom | | group_replication_applier | 00023639-3333-3333-3333-333333333333 | 127.0.0.1 | 23639 | ONLINE | SECONDARY | 8.0.36 | XCom | +---------------------------+--------------------------------------+-------------+-------------+--------------+-------------+----------------+----------------------------+ 3 rows in set (0.00 sec) |
Scenario 1: One of the GR nodes […]
Aug 14, 2024 |
Insight for DBAs, MySQL, Percona Software, Storage Engine
Group replication is a fault-tolerant/highly available replication topology that ensures if the primary node goes down, one of the other candidates or secondary members takes over so write and read operations can continue without any interruptions. However, there are some scenarios where, due to outages, network partitions, or database crashes, the group membership could be broken, or we end […]
Jun 24, 2024 |
Insight for DBAs, Insight for Developers, Monitoring, MySQL
Flow control is not a new term, and we have already heard it a lot of times in Percona XtraDB Cluster/Galera-based environments. In very simple terms, it means the cluster node can’t keep up with the cluster write pace. The write rate is too high, or the nodes are oversaturated. Flow control helps avoid excessive […]
May 28, 2024 |
Insight for DBAs, Insight for Developers, Percona Software, Valkey
In this blog post, we are going to implement the concept of sharding in a Valkey setup. This is a built-in feature and can be implemented by enabling clustering in the Valkey configuration. Sharding, in general, helps in distributing/scaling application writes over multiple nodes. In a similar fashion, it works in Valkey. Here, it uses […]
May 13, 2024 |
Insight for DBAs, Insight for Developers, Open Source, Valkey
In this Valkey blog post, I will demonstrate how we can set up a simple replication process among the Valkey nodes and then finally use some auto-failover mechanism with the help of the Valkey-sentinel tool. Replication (Master-Slave) Basically, we have two setups with the information below.
|
IP valkey port sentinel port 172.31.21.83 6379 26379 172.31.58.227 6379 26379 |
Now let’s prepare some basic configurations in file […]
May 06, 2024 |
Database Trends, Hardware and Storage, Insight for DBAs, Insight for Developers, Valkey
Since Valkey (a fork of Redis) is around the corner, I thought to write a short blog post about some of the configuration parts, mainly discussing how to dynamically change certain settings and persist those inside the configuration file. Disk persistence Let me start with a very important setting, which is “SAVE,” that helps in […]
Mar 26, 2024 |
Cloud, Insight for DBAs, Monitoring, Percona Software
Since Percona Monitoring and Management (PMM) 2.40.0, Grafana uses PostgreSQL instead of SQLite database to store users, dashboards, and other persistent data. This aids in getting some useful information related to [configured alerts] directly via querying from the Postgres backend. Sometimes we need to migrate only alert rules from one PMM server to another for […]
Mar 13, 2024 |
Insight for DBAs, MongoDB, Percona Software
In Using Percona Backup for MongoDB in Replica Set and Sharding Environment: Part One, I demonstrated a basic Percona Backup for MongoDB (PBM) setup under the Replica Set and Sharding environment. Now, here we will see some advanced stuff and other backup/restore options available with PBM. Let’s discuss each one. Taking backups on remote storage […]
Feb 21, 2024 |
Insight for DBAs, MongoDB, Percona Software
Backups are crucial for every database system, and having a reliable, fast, and hot backup is the demand for next-generation database systems. Percona Backup for MongoDB (PBM) is a backup management tool that enhances the existing backup capability of MongoDB by providing various layers of backups such as physical, logical, incremental, PITR, etc. In this […]
Dec 19, 2023 |
Insight for DBAs, Monitoring, Percona Software
Setting up Percona Monitoring and Management (PMM) alerts for multiple channels can significantly enhance your monitoring strategy. In this blog post, we will talk about the steps to configure alerts for some well-known communication platforms like Telegram, Slack, and WebHook. Please note that I am not covering the basic alerting and configuration setup. For that, […]
Dec 07, 2023 |
Insight for DBAs, Monitoring, Percona Software
In many scenarios, the standard alert notification template in Percona Monitoring and Management (PMM), while comprehensive, may not align perfectly with specific operational needs. This often leads to an excess of details in the notification’s “Subject” and “Body”, cluttering your inbox with information that may not be immediately relevant. The focus today is on tailoring […]