Remote MySQL Performance and Query Monitoring

There may be the situation that you have to monitor a MySQL server remotely. There are some linux tools to do performance and query monitoring locally, and these tools can also used to monitor remotely - but only unencrypted ! Also often MySQL is only listening on the loopback interface, so it is even not reachable remotely over the net (which is very good seen from the security viewpoint). But there is an easy solution in the Linux world.

Woooo, just wrapped up another night of #DBHangOps, check out the video:

For those of you who aren’t familiar with this awesome series of videos, it’s a bi-weekly meeting of MySQL DBAs via a Google Hangout to simply talk about databases (specifically MySQL). The discussions range anywhere from silly stories to awesome learnings and even little gotchas to know about when working with MySQL operationally. If you’re interested in catching when the next #DBHangops will happen, check MySQL planet for a blog post about it, or check this twitter search.

We look forward to talking with you!

This post is the following part #2 of the previous one - in fact Vadim's comments bring me in some doubts about the possible radical difference in implementation of AIO vs normal I/O in Linux and filesystems. As well I've never used Sysbench for I/O testing until now, and was curious to see it in action. From the previous tests the main suspect point was about random writes (Wrnd) performance on a single data file, so I'm focusing only on this case within the following tests. On XFS performance issues started since 16 concurrent IO write processes, so I'm limiting the test cases only to 1, 2, 4, 8 and 16 concurrent write threads (Sysbench is multi-threaded), and for AIO writes seems 2 or 4 write threads may be more than enough as each thread by default is managing 128 AIO write requests..

Few words about Sysbench …

I write a fair number of scripts on this site and have posted a lot of code over the years. Generally if I am not pasting the code to be viewed on the webpage then I link to a file that a user can download; which leads to a lot of mish-mash code that doesn’t have a home. I’ve always kept the code files in a private SVN repo over the years but have recently moved them all to BitBucket Git repositories. So here they are: lots of code samples and useful bits of programming to save time.

Generic Shell Scripts: https://bitbucket.org/themattreid/generic-bash-scripts/src
Generic Python Scripts: https://bitbucket.org/themattreid/generic-python-scripts/src
Generic MySQL Stored Procs: …

This Week in Website Performance is a weekly feature of the Monitis.com blog. It summarizes recent articles about website performance. Why? Because your friends at Monitis.com care.

NoSQL or Traditional Database: From an APM Perspective There Isn’t Really Much Difference

Author: Michael Kopp.

If your application is executing more statements or downloading more data than is necessary, no amount of backend tuning will have your site running at the highest level of performance. This article serves as a reminder that the application accessing the data can be …

I feel like I just got back home from Oracle OpenWorld (check out my pictures) and some vacation, but I'll be on the road again next week to attend LinuxCon Europe in Barcelona. I'll be there from Monday (Nov. 5th) until Wednesday evening. Oracle is sponsoring the event and we'll have a booth at the exhibition area (booth #19), handing out free Oracle Linux and Oracle VM DVDs. I'll be at the booth every now and then and plan to give a short introduction and live demo of Ksplice rebootless updates on Monday evening (6:00pm).

Two …

This article is following the previously published investigation about I/O limitations on Linux and also sharing my data from the steps in investigation of MySQL/InnoDB I/O limitations within RW workloads..

So far, I've got in my hands a server with a Fusion-io card and I'm expecting now to analyze more in details the limits we're hitting within MySQL and InnoDB on heavy Read+Write workloads. As the I/O limit from the HW level should be way far due outstanding Fusion-io card performance, contentions within MySQL/InnoDB code should be much more better visible now (at least I'm expecting ;-))

But before to deploy on it any of MySQL test workloads, I want to understand the I/O limits I'm hitting on the lower levels (if any) - first on the card itself, and then on the filesystem levels..

NOTE …

I was digging through some old project code and found this script. Sometimes one finds oneself in an odd situation and needs to convert regular SQL, say from a MySQL database dump, into SQLite3 format. There’s not too much else to say, but here is a script that helps with the process. It can likely be improved but this handles the items that came up during conversion on initial runs.

#!/bin/sh
####
# NAME: convert-mysql-to-sqlite3.sh
# AUTHOR: Matt Reid
# DATE: 2011-03-22
# LICENSE: BSD
####
if [ "x$1" == "x" ]; then
   echo "Usage: $0 "
   exit 
fi 
cat $1 |
grep -v ' KEY "' |   
grep -v ' UNIQUE KEY "' |
grep -v ' PRIMARY KEY ' |
sed '/^SET/d' |          
sed 's/ unsigned / /g' | 
sed 's/ auto_increment/ primary key autoincrement/g' |
sed 's/ smallint([0-9]*) / integer /g' | 
sed 's/ tinyint([0-9]*) / integer /g' |  
sed 's/ int([0-9]*) / integer /g' |      
sed 's/ character set [^ ]* / /g' |      
sed 's/ enum([^)]*) / varchar(255) /g' | 
sed 's/ on …

Read the original article at 10 ways I avoid trouble in database operations

1. Avoid destructive commands From time to time I’m working with new recruits and bringing them up to speed in operations. The first thing I emphasize is care with destructive commands. What do I mean here? Well there are all sorts of them. SQL commands such as DROP table & DROP database. But also TRUNCATE [...]

For more articles like these go to Sean Hull's Scalable Startups

Related posts:

1. 5 Ways to Avoid EC2 Outages
2. 7 Ways to Troubleshoot MySQL
…

It's that time of the year again — the summer holidays are over and the conference season starts!

I'm very excited to be at Oracle Open World in San Francisco again, where I will pretty busy. On Saturday and Sunday I will attend MySQL Connect, primarily to man the Oracle Linux booth in the exhibition area. But I hope to catch some of the talks as well (I shared my favourite sessions with Keith Larson from the MySQL team in this interview). During Open World, I will help out manning the Oracle Linux demo pods in the exhibition grounds in Moscone South, where we will showcase Oracle Linux with Ksplice and related technologies. I also have a joint presentation with two of our …