The latest from the MySQL community

Managing global counters in a multi-threaded system has always been challenging. They pose serious scalability challenges. Introduction of NUMA just increased the complexity. Fortunately multiple options have been discovered with hardware lending support to help solve/ease some of these issues. In this blog we will go over how we can make Global Counter NUMA SMART and also see what performance impact each of this approach has.

Note: a lot of this work is inspired from MySQL codebase that is continuously trying to evolve to solve this issue.

Global Counters

Most of the software (for example: database, web-server, etc…) needs to maintain some global counters. Being global, there is one copy of these counters and multiple worker threads try to update it. Of-course this invites a need of coordination while updating these copies and in turn it becomes scalability hotspots.

Alternative is to loosely maintain these …

MySQL does not limit the number of slaves that you can connect to the master server in a replication topology. However, as the number of slaves increases, they will have a toll on the master resources because the binary logs will need to be served to different slaves working at different speeds. If the data churn on the master is high, the serving of binary logs alone could saturate the network interface of the master.

A classic solution for this problem is to deploy a binlog server – an intermediate proxy server that sits between the master and its slaves. The binlog server is set up as a slave to the master, and in turn, acts as a master to the original set of slaves. It receives binary log events from the master, does not apply these events, but serves them to all the other slaves. This way, the load on the master is tremendously reduced, and at the same time, the binlog server serves …

How to Audit only DML Actions ?
Step by step to Enable Fine Grained MySQL Auditing for Insert/Update/Delete Queries for all Users.
Before i talk about MySQL Audit Filtering , it is more important to know below details:-

• What is MySQL Enterprise Audit ?
• Features of MySQL Audit.
• Why Audit is Important?
•  How to Audit only DML statements for Particular/All Users ?
• Audit Log Restrictions
• Conclusions

What is MySQL Enterprise Audit? At high level, database auditing is the process to guard against misuse of information, track the use of database resources and activity like -Who accessed the database(Users) - Where these queries has been executed(Host Name). -What kind of queries has been executed to db(events/statements). -When did this happened(Time) Then we can have idea of “Why this …

Introduction Before I talk about installation of MySQL inside docker, it's more important to know
what is Docker?
- Docker is a tool designed to create , deploy ,and run an application any where.
-It allow us to package up application with all requirements such as libraries and other dependencies and ship it all as a PACKAGE.
who uses Docker?
Developer : Docker enables developer to develop application without spending much time on IT infrastructure.
Sysadmin :-Docker enables sysadmin to streamline the software delivery, such as develop and deploy bug fixes and new features without any roadblock. 
Enterprise :-Docker works in the cloud , on premise ,and supports both traditional and micro services deployments.
why Docker?
-Easily adapts to your working environment. …

Glimpse of MySQL Enterprise Data Masking Abstract- Many organizational production environment unwittingly breach sensitive information which causes harm of reputation, brand name and million of dollar losses etc. hence database environments will require some form of sanitization in order to render the informational content anonymous. In this paper, we outline research towards a business challenge-why mask your data and the business value- benefits of masked data. We describe a definition of concept, performance measurements of sql query with/without masked data and limitation of data masking with current release of MySQL. …

Introduction MySQL offers two types of clustering solution for managing Read/Write intensive workloads , ensuring Rock Solid Availability. 1.MySQL InnoDB Cluster
2. MySQL NDB Cluster Glimpse of MySQL InnoDB Cluster    This Cluster is designed for users that uses MySQL Server with InnoDB storage engine.    It will serve as a natural extension for users currently using MySQL Replication with InnoDB to a       new replication architecture i.e Clustering on top of Group Replication. MySQL InnoDB Cluster = MySQL Server + MySQL Shell + MySQL Router. MySQL Server

• Group Replication Technology.
• Single-Primary /Multi-Primary Mode.
• Fault Tolerance.
• Conflict detection and resolution.
• Automatic distributed recovery.

MySQL Shell

• Multi-Language(Python , Java script , SQL).
…

How to Deploy MySQL InnoDB Replica Set in Production? Before i talk about Deployment process of MySQL InnoDB Replica Set , it is more important to know below details:-

• What is MySQL InnoDB Replica Set?
• What is prerequisite and limitation of using MySQL Replica Set?
•  In what kind of scenarios MySQL Replica Set is not recommended.
•  How to configure and deploy MySQL Replica Set- (step by step guide )
• How to use InnoDB Replica Set?
• What if Primary goes down? Does select query re-routed to another server?
• What if Secondary goes down while executing select queries?

§      I will answer these all question in this blog.    What is Replica Set ? MySQL InnoDB ReplicaSet a quick and easy way to get MySQL replication(Master-Slave), making it well suited to scaling out reads, and …

NoSQL Development in MySQL Using Python.

In This Tutorial, I will talk about below topic:-
 Introduction to NoSQL + MySQL =MySQL 8.0.
 What is XdevAPI , Xprotocol , Xplugin ?
 How Application communicate with MySQL using XdevAPI ?
 Installation online and offline.
 How to use XdevAPI to develop application using MySQL as NoSQL databases (Similar to MongoDB , ES ) ?
 Conclusion.


Introduction to NoSQL + MySQL =MySQL 8.0

Whenever we have fast changing data , lots of data it is tedious task for application developers to depend on MySQL DBA/developer to get required schema details , instead MySQL document store has new paradigm shift over traditional SQL model which is schema-less , low maintenance, no need to maintain multiple databases (likewise one database for relational model and another for document model).
…

Percona XtraDB Cluster 8.0 comes with an upgraded Galera 4.0 library, which provides a new feature – streaming replication. Let’s review what it is and when it might be helpful.

Previous versions of Percona XtraDB Cluster with Galera 3.x had a limitation in how big transactions are handled.

Let’s review the performance under sysbench-tpcc workload when in parallel we update a big update on a table that is even non-related to the tables in the primary workload.

Without Streaming Replication

Let’s run two workloads.

1. sysbench-tpcc workload with 1 sec resolution
2. In parallel run UPDATE oltp.sbtest SET k=k+1 LIMIT 1000000

Running update:

mysql> update sbtest1 set k=k+1 limit 1000000;
Query OK, 1000000 rows affected (34.48 sec)
Rows matched: 1000000  Changed: …

I was testing the latest Percona XtraDB Cluster 8.0 (PXC) release which has the Galera 4 plugin, and I would like to share my experiences and thoughts on the Streaming Replication feature so far.

What Is Streaming Replication, in One Sentence?

In Galera 4, the large transaction could split into smaller fragments, and even before it got committed these fragments have been replicated to the other nodes and have already started the certification and apply process.

The manual describes all the pros and cons, but let’s see how it works. I have created a table with 10M rows and I am going to run some large updates on that.

First I have run the updates without Streaming Replication, and because it is disabled by …