Showing entries 1 to 10 of 188
10 Older Entries »
Displaying posts with tag: monitoring (reset)
With 500+ VividCortex Users, Shopify Eliminates High Latency Queries From Redis and MySQL

As intuitive and streamlined as ecommerce technology might seem from the user's perspective, it involves so much data that engineering ingenuity and smart database management must constantly deliver in order to keep up. At organizations like Shopify—responsible for the easy and reliable transactions at top brands around the world—that excellence of performance involves deep monitoring of their MySQL core and their Redis caching infrastructure, plus insightful query profiling, packet captures, and the admittance of developers to platforms that measure database performance.

Shopify’s motto is “Make commerce better for everyone.” That mantra applies whether the shopping's done online, on mobile, or in-store. For Shopify's engineering team, better means a fast, reliable application that delivers a positive …

[Read more]
A Metric for Tuning Parallel Replication in MySQL 5.7

MySQL 5.7 introduced the LOGICAL_CLOCK type of multi-threaded slave (MTS).  When using this type of parallel replication (and when slave_parallel_workers is greater than zero), slaves use information from the binary logs (written by the master) to run transactions in parallel.  However, enabling parallel replication on slaves might not be enough to get a higher replication throughput (VividCortex

Etsy's Use of Performance Testing in Development

In a recent case study, we profiled Etsy and learned about how a high-performance data platform helps keep Etsy's global community engaged. In that study, Etsy's engineering team provided some key examples of how they monitor their database in order to ensure good system performance in development. In this post, we want to highlight a few of those specific uses.

Performance Testing in Development

Performance monitoring is key to good DevOps principles--to understand how to improve system performance, one must first understand how the system is performing. Engineering teams need performance analytics in order to do fact-based evaluations, improve code quality, and ensure system stability. By putting performance …

[Read more]
Monitoring ProxySQL using Datadog

ProxySQL is a high performance proxy for MySQL and its forks. One of the key features is its ability to handle hundreds of thousands of connections with very low overhead. Datadog is a monitoring service for cloud-scale applications, bringing together data from servers, databases, tools, and services to present a unified view of an entire stack.

Datadog does not yet provide an integration for ProxySQL. So I decided to write an integration by forking the Datadog agent. Read my detailed blog post on TwinDB Blog to learn how to use the ProxySQL-Datadog integration.

The post Monitoring ProxySQL using Datadog appeared first on ovais.tariq.

ProxySQL Monitoring with Datadog

Introduction

ProxySQL is a high performance proxy for MySQL and its forks. One of the key features is its ability to handle hundreds of thousands of connections with very low overhead. Some of the other key features are query caching, traffic mirroring, query routing and pluggable architecture. It is also the only open source proxy that correctly handles transactions and sessions.

What is Datadog?

Quoting Wikipedia:
Datadog is a monitoring service for cloud-scale applications, bringing together data from servers, databases, tools, and services to present a unified view of an entire stack. These capabilities are provided on a SaaS-based data analytics platform.”

We use Datadog to collect metrics of key systems of our customers. These metrics are used to analyze, alert …

[Read more]
Solving MySQL Replication Lag with LOGICAL_CLOCK and Calibrated Delay

Last week VividCortex's Preetam Jinka published a post on his personal blog examining how our engineering team had overcome a problem with MySQL replication by using a new parallelization policy introduced in MySQL 5.7: LOGICAL_CLOCK.


Image Credit

The solution we developed—which achieves faster replication via group commit and a carefully calibrated delay—can offer huge replication improvements, but its implementation isn't immediately obvious or intuitive. We thought it worthwhile to provide a fuller description of how we arrived at the solution Preetam outlined.

[Read more]
MySQL Query Performance Statistics In The Performance Schema

Updated 1/11/2017

Quite some time ago, when we added the ability to monitor MySQL query performance statistics from MySQL’s PERFORMANCE_SCHEMA, we learned a number of valuable lessons, still worth sharing. There are definitely right and wrong ways to do it. If you are looking to the P_S tables for monitoring MySQL query performance, this blog post might save you some time and mistakes.


Image Credit

What Is The Performance Schema?

First, a quick introduction. The Performance Schema includes a set of tables that give information on how statements are performing. Most of the P_S tables follow a set of predictable conventions: there’s a set of tables with a limited set of full-granularity current and/or historical data, which is aggregated into tables that accumulate over time. In the case …

[Read more]
Monitoring MySQL Health and Performance with Netsil

For SREs and DevOps engineers running MySQL database in production, it is crucial to understand how to monitor MySQL

Continue reading on Netsil »

Percona Monitoring and Management (PMM) Information Script

This blog post discusses an information script for the Percona Monitoring and Management (PMM) tool.

In recent news, we announced the fresh-of-the-press Percona Monitoring and Management (or PMM for short) platform. Given the interaction of the different components that together make up PMM, I developed a script that helps provide you information about the status of your PMM installation.

You can use this script yourself, or one of our support might point you to this page to obtain the information they need to troubleshoot an issue you are experiencing.

You will likely want to execute this script once on the PMM …

[Read more]
Everyone's Capable of a Performance Mindset

The other day I was speaking with someone who asked me a few times how we find and hire engineers who are capable of building performance/monitoring tools. I didn't have a great answer in the moment, but after the conversation was over, I realized it's because I fundamentally believe we all are capable of understanding and solving systems performance problems. We're all brainiacs, so to speak.

This has been a theme of my career. If you look back at my pre-Percona days, read the 2nd and then the 3rd edition of my book High Performance MySQL, examine my opensource software, look at the ebooks and white papers I've written, or listen to the recordings of any of my …

[Read more]
Showing entries 1 to 10 of 188
10 Older Entries »