Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Previous 30 Newer Entries Showing entries 31 to 60 of 142 Next 30 Older Entries

Displaying posts with tag: monitoring (reset)

Monitoring just a blink away...
+1 Vote Up -1Vote Down

I bring this up because of recent conversations I have found myself in.

Over the years I have gone back and forth between OSX & Linux laptops. Over these same years I was also monitoring several MySQL databases. I have found numerous server side solutions for you to be able to monitor your database, Nagios and of course MySQL Enterprise Monitor (http://www.mysql.com/products/enterprise/monitor.html) to list a couple. Both of these are great solutions and allow you to try and get some sleep and night.
Years ago, while using OS X, I was enlightened to learn about a free module called Geektool, it is not new, but I often find people are unaware of it.  I have had at least three conversations about it lately. While Nagios and

  [Read more...]
Some More Replication Stuff
+0 Vote Up -0Vote Down
Listening to the OurSQL podcast: Repli-cans and Repli-can’ts got me thinking, what are the issues with MySQL replication that Sarah and Sheeri didn’t have the time to include in their episode. Here’s my list:

Replication Capacity Index

This is a concept introduced by Percona in last year’s post: Estimating Replication Capacity which I revisited briefly during my presentation at this year’s MySQL Users Conference. Why is this important? Very simple: If
  [Read more...]
Refactored again: poor man's MySQL replicator monitor
+3 Vote Up -0Vote Down
I saw that both Haidong Ji and Geert VanderKelen have proposed a Python monitor for MySQL replication, calling it the "poor man's version".
See Poor man’s MySQL replication monitoring and Geert's Refactored: Poor man’s MySQL replication monitoring.
Having Python in your server doesn't really qualify as "poor man". In many cases it's a luxury, and thus, here's my shot at the problem, using a Bash shell script.
Unlike its Python-based competition, this version also checks that the slave is replicating from the intended master, and that it is not lagging behind.


  [Read more...]
Cluster/J - Document-oriented approach on MySQL Cluster
+2 Vote Up -0Vote Down
In a project Severalnines is engaged in, we are developing a realtime application based on Cluster/J. To start with, I must say cluster/j is fantastic and so far I am very happy with it and beaten our expectations big time. It is quite new however and we stumbled on a couple of issues, but those were fixed very fast by the Cluster/J developers. The bugs we encountered were:
Both which were worked around, and really we never did need to have a binary or a varbinary as the PK, we used a

Performance is great - we have two data nodes (nehalem, 32GB RAM, 146GB SAS 10K disk, 2x4 core 2.4GHz (E5620) ) and two application hosts (same spec, less RAM as data

  [Read more...]
CMON - Install Instructions
+2 Vote Up -0Vote Down
CMON 1.1.4 - the Cluster Monitor and Manager has recently been released and here is a little how to about how to install from binary and source (at the end), deployment etc. If you use RPMs, you should follow the install guide here.

1. Download the cmon binary package to a monitoring host
Currently there are binaries available for Linux 64-bit and 32-bit (statically linked) and works for MySQL Cluster 7.0.9 and later 7.0.x versions and also 7.1.x.

In this case the monitoring host will be on 'ndb05' (IP address - see 9.

  [Read more...]
How to detect if a MySQL server is an active replication slave
+7 Vote Up -1Vote Down
Sometimes you know for sure. And sometimes you wonder: Is this server part of a replication system? And, most specifically, is it an active slave?
The completeness of the answer depends on how much visibility you have on the server.
If you can ask the DBA, and possibly have access to the server data directory and configuration file, you can get a satisfactory answer. But if your access is limited to SQL access, things get a bit more complicated.
If you have the SUPER or REPLICATION_CLIENT privilege, then it's easy, at least in the surface.
SHOW SLAVE STATUS will tell you if the slave is running. An empty set means that the server was not configured as a slave.
The answer is not absolute, though. You need to read the output of SHOW SLAVE STATUS to understand if replication is under way.
For example, what is the difference between these two

  [Read more...]
A Small Fix For mysql-agent
+1 Vote Up -0Vote Down
If you're already using an SNMP monitoring tool like OpenNMS, mysql-agent is a great way to add a number of graphics using Net-SNMP. However mysql-agent has a small bug that drove me crazy. I will try to highlight the process on how I discovered it (and hence fix it) since it involved learning about SNMP, how to diagnose it and eventually, once all the pieces came together, how simple it is to write your own agents.

Although versions are not that important, just for the sake of completeness we were using CentOS 5.5, MySQL 5.5.8 Community RPMs, Net SNMP version 5.3.22 and OpenNMS Web Console 1.8.7.

The Problem


  [Read more...]
Pitfalls of monitoring MySQL table activity with stored routines
+3 Vote Up -0Vote Down
A friend of mine needed a quick method to monitor a table that was frequently updated. There were several procedures writing to the table several times per second. He needed a quick way of determining how many updates per second the table was getting.
The table has only one row, which includes a counter that is increased at each operation. Therefore, the simple plan was:
  • Let's get the counter from the table;
  • Allow N seconds to pass;
  • Get the counter again;
  • The difference between the second counter and the first counter, divided by the number of seconds gives the updates per second.
  • The plan makes sense, and if you run the above

      [Read more...]
    CRIB – CentRal Information Base for MySQL
    +2 Vote Up -0Vote Down

    CRIB is a CentRal Information Base for MySQL, a long time coming project since I worked on it on and off for a few weeks and now I decided it’s time to hand it over to the global MySQL community.

    So, what is CRIB?

    CRIB is a central database which collects information about all your MySQL instances which you set as clients. It is monitoring in a way, but not the typical number of connections, memory, index usage, table scans, cpu usage and such, but rather consists of a repository where, if you have tens, hundreds or even thousands of clients, you can see where a particular user was created, where a certain database name features or which tables does a database consists of. It also features a script which logs table sizes periodically (customizable) so you can graph disk usage over time and be able to forecast future disk space requirements

      [Read more...]
    Monitoring MySQL SQL statements the way it SHOULD be done!
    +8 Vote Up -2Vote Down
    You may have read a previous post of mine, back in April this year, where I wrote about using the MySQL 5.5 Audit interface to SQL Statement monitoring. There was a bunch of comments and some ideas, but not much happened. Until now that is.

    Hereby I release the first version of SQLStats, which is a much enhanced version of what I described in the previous post. This is a MySQL Plugin for MySQL 5.5 that allows you to monitor the most recently executed, and the most frequently executed statements using 2 INFORMATION_SCHEMA tables. The thing is not very complex, to be honest, but it does do the job. So what was the job then? Well, looking at what this plugin does, it goes something like this:
    • Allows you to monitor ALL SQL statements executed by the

      [Read more...]
    mycheckpoint (rev 208): aggregation tables, enhanced charting, RPM distribution
    +1 Vote Up -0Vote Down

    Revision 208 of mycheckpoint, a MySQL monitoring solution, has been released. New and updated in this revision:

    • Aggregation tables: aggregated data makes for fast reports on previously slow queries.
    • Enhanced charting: interactive charts now present time stamps dynamically (see demo); “Zoom in” charts are available (see demo) on mycheckpoint‘s HTTP server.
    • RPM distribution: a “noarch” RPM
      [Read more...]
    Not excited about paying for MySQL monitoring for your enterprise?
    +1 Vote Up -2Vote Down
    I think most people will agree that one of the biggest advantages of MySQL Community Server is that it’s free. Being free doesn’t get you a multi-million user community though; MySQL offers a great array of transactional engines, advanced high-availability features, robust I/O performance, and it powers many of the top-500 internet sites. When it […]
    How To Send One Billion Email Marketing Messages Per Month
    +0 Vote Up -12Vote Down

    One... *billion* emails!

    One *Billion* Emails

    In email marketing there are senders of all shapes and sizes, from small businesses using self-serve ESPs to the largest web properties self-sending to massive user bases. While only a few senders will reach or exceed volumes of one billion messages per month, the tools and practices needed to achieve such a volume level are applicable to all senders who want to succeed in email marketing.

    Who Am I?

    My name is Mike Hillyer (click here for bio and social links). I manage a team of Sales Engineers for Message Systems, a leading provider of digital messaging solutions for both

      [Read more...]
    mycheckpoint (rev. 190): HTTP server; interactive charts
    +2 Vote Up -0Vote Down

    Revision 190 of mycheckpoint, a MySQL monitoring solution, has been released. New and updated in this revision:

    • HTTP server: mycheckpoint can now act as a web server. Point your browser and start browsing through HTML reports. See mock up demo.
    • Interactive charts: HTML line charts are now interactive, presenting with accurate data as you move over them. See sample.
    • Enhanced auto-deploy: now auto-recognizing failed upgrades.
      [Read more...]
    Kontrollbase – new version available with improved analytics
    +1 Vote Up -0Vote Down
    A new version of Kontrollbase – the enterprise monitoring, analytics, reporting, and historical analysis webapp for MySQL database administrators and advanced users of MySQL databases – is available for download. There are several upgrades to the reporting code with improved alert algorithms as well as a new script for auto-archiving of the statistics table based […]
    mycheckpoint (rev. 170): improved custom queries; local charting; page/swap I/O monitoring; improved HTML reports
    +2 Vote Up -0Vote Down

    Revision 170 of mycheckpoint, a MySQL monitoring solution, has been released. New and updated in this revision:

    • Improved custom queries: lifting of limitations from previous, introductory revision; better HTML presentation
    • Local, inline charting: no rendering of Google Charts, unless explicitly requested. All charts are now rendered locally using JavaScript. No data is now sent over the network.
    • Page/Swap I/O monitoring: now monitoring for page ins and outs, swap ins and outs (Linux only).
    • Improved HTML reports: several improvements on presentation (see
      [Read more...]
    What do MySQL Consultants do?
    +4 Vote Up -0Vote Down

    One role of a MySQL consultant is to review an existing production system. Sometimes you have sufficient time and access, and other times you don’t. If I am given a limited time here is a general list of things I look at.

  • Review Server architecture, OS, Memory, Disks (including raid and partition type), Network etc
  • Review server load and identify physical bottleneck
  • Look at all running processes
  • Look specifically at MySQL processes
  • Review MySQL Error Log
  • Determine MySQL version
  • Look at MySQL configuration (e.g. /etc/my.cnf)
  • Look at running MySQL Variables
  • Look at running MySQL status (x n times)
  • Look at running MySQL INNODB status (x n times) if used
  • Get Database and Schema Sizes
  • Get Database Schema
  • Review Slow Query Log
  • Capture query sample via
  •   [Read more...]
    Apache And MySQL Monitoring With Bijk On Debian Lenny
    +0 Vote Up -0Vote Down

    Apache And MySQL Monitoring With Bijk On Debian Lenny

    This tutorial describes how you can monitor your server with the tool Bijk. Bijk creates online 30 graphs about load, CPU, memory, traffic, Apache, NginX, PostreSQL and others with alerts. Bijk can be used on Debian, Ubuntu, CentOS, RedHat and Gentoo. In this article I will explain how to install Bijk on Debian.

    Fatal error: Allowed memory size of 16777216 bytes exhausted (tried to allocate 41 bytes) in /usr/share/cacti/site/lib/xml.php on line 32
    +0 Vote Up -0Vote Down

    I was trying to setup cacti on my ubuntu desktop to gather metrics from few new database servers we were planning to replace. Installed cacti using the following command

    apt-get install cacti

    Then the next step was to download and the install the cacti mysql templates from http://code.google.com/p/mysql-cacti-templates/. Thanks to Baron, was able to get this up and running fast using the templates. But had one problem though, while importing the mysql template “cacti_host_template_x_mysql_server_ht_0.8.6i-sver1.1.7.xml” cacti bombed with the below error

    Fatal error: Allowed memory size of 16777216 bytes exhausted (tried to allocate 41

      [Read more...]
    mycheckpoint (rev. 132): custom monitoring, custom charts, process list dump
    +1 Vote Up -0Vote Down

    Revision 132 of mycheckpoint has been released. New and updated in this revision:

    • Custom monitoring: monitoring & charting for user defined queries
    • HTML reports for custom monitoring
    • Process list dump upon alert notifications

    Custom monitoring & charts

    Custom monitoring allows the user to supply with a query, the results of which will be monitored.

    That is, mycheckpoint monitors the status variables, replication status, OS metrics. But it cannot by itself monitor one’s application. Which is why a user may supply with such query as:

    SELECT COUNT(*) FROM shopping_cart WHERE is_pending=1

    Such a query will tell an online store how many

      [Read more...]
    Kontrollkit – new version available for download
    +0 Vote Up -0Vote Down
    Just a quick notice to let everyone know that there is a new version of Kontrollkit available. There are some required bug fixes to the formerly new python backup script and some Solaris compatible changes to the various my.cnf files. You can download the new version here: http://kontrollsoft.com/software-downloads, or here: http://code.google.com/p/kontrollkit/
    Cloud monitoring keeps open source in cool crowd
    +0 Vote Up -0Vote Down

    One of the first special reports I wrote for 451 Group was an analysis of the open source systems management vendors on the scene — GroundWork, Hyperic, Zenoss, OpenNMS Group, Nagios Enterprises and some others. These named ones are those that made it and while there was some reckoning in the market and there have been changes, it is interesting to see these players still plugging away, pushing into new markets and powering open source for systems, network and application monitoring and management, including cloud computing environments.

    When acquired by SpringSource a year ago, there was some question as to the real value of open source systems monitoring and management

      [Read more...]
    mycheckpoint (Rev. 118): alerts, email notifications and more
    +0 Vote Up -0Vote Down

    Revision 118 of mycheckpoint has been released. New and updated in this revision:

    • Conditional alerts
    • Email notifications
    • Revised HTML reports, including 24/7 reports.
    • Updated documentation

    With this new revision mycheckpoint turns into a monitoring solution for MySQL. One can now:

    • Store measure metrics
    • Query for raw, aggregated or digested metrics
    • Generate charts for selected metrics
    • View HTML reports for selecetd metrics
    • Define alerts conditions, query for pending alerts
    • Be notified via email on raised or resolved alerts.

    Conditional alerts

    mycheckpoint is SQL oriented. As such, it allows for

      [Read more...]
    Kontrollsoft’s uptime checks now managed by Pingdom
    +0 Vote Up -0Vote Down
    Website health checks are a crucial service to an operations team. In addition to in-house monitoring and service state reporting it’s also important, even critical, to have an impartial third party to run checks to test your customer facing services. There are a lot of companies in this arean that would be glad to have [...]
    Things to monitor on MySQL, the user’s perspective
    +0 Vote Up -0Vote Down

    Working on mycheckpoint, I have the intention of adding custom monitoring. That is, letting the user define things to monitor. I have my own thoughts, I would be grateful to get more input!

    What would the user want to monitor?

    Monitoring for the number of SELECT statements per second, InnoDB locks, slave replication lag etc. is very important, and monitoring utilities provide with this information. But what does that tell the end user? Not much.

    The experienced DBA may gain a lot. The user would be more interested in completely other kind of information. In between, some information is relevant to both.

    Say we were managing an on-line store. We want to monitor the health of the database. But the health of the database is inseparable from the health of the application. I mean, having little to no disk usage is fine,

      [Read more...]
    Its a cheat! Get Linux performance information from your MySQL database without shell access.
    +6 Vote Up -0Vote Down
    System administrators familiar with the Linux operating system use the tools in the 'procps' toolset all the time. Tools which read from /proc include top, iostat, vmstat, sar and others. The files in /proc contain useful information about the performance of the system. Most of the files are documented in the Linux kernel documentation. You can also check man 5 proc.

    Most performance monitoring tools invoke other tools like iostat to collect performance information instead of reading from the /proc filesytem itself. This begs the question, what can you do if you don't have access to those tools? Perhaps you are using a hosted Linux database and have no access to the underlying shell to execute tools like iostat or top? How could you gather information about the performance of the actual system without being

      [Read more...]
    Static charts vs. interactive charts
    +1 Vote Up -1Vote Down

    I’m having my usual fun with charts. Working on mycheckpoint, I’ve generated monitoring charts using the Google Chars API. But I’ve also had chance to experiment and deploy interactive charts, JavaScript based. In particular, I used and tweaked dygraphs.

    I’d like to note some differences in using charts of both kinds. And I think it makes a very big difference.

    Static charts

    I’ll call any image-based chart by “static chart”. It’s just a static image. Example of such charts are those generated by Google Image Charts (they now also have new, interactive charts), or RRDtool. Show below is

      [Read more...]
    Kontrollkit – new version is available for download!
    +0 Vote Up -0Vote Down
    Just a quick notice to let everyone know that there is a new version of Kontrollkit available. There are two new scripts included as well as some good updates to the my.cnf files. You can download the new version here: http://kontrollsoft.com/software-downloads kt-mysql-systemcheck – generates a report for point-in-time system status that is useful for troubleshooting MySQL [...]
    A simple webpage test script in Python
    +2 Vote Up -1Vote Down

    Looking around on Google for a webpage test script returns a lot of results. Some of them are useful, some are not. In particular, for Python, the scripts on the first page of results are minimal and lacking a useful copy and paste / ready to go script that will answer the question “is my webpage available?”. So I decided to write a quick one that will give you the return code and email you as an alert if the page does not return with a 200 code (successful). You can find the script here. Update: the webserver was trying to execute the script as a .py file so I just changed it to .txt – for it to work you will want to change the .txt extension to a .py extension after you download it.

    If you are familiar with Python scripting, this script could easily be modified to post to a form so that you can

      [Read more...]
    mycheckpoint (rev. 88): mount points monitoring, improved charting, enhanced auto-deploy
    +0 Vote Up -0Vote Down

    Revision #88 of mycheckpoint is released. In this revision:

    • Disk space monitoring
    • Improved charting
    • Enhanced auto-deploy
    • And more…

    Disk space monitoring

    mycheckpoint now monitors (on Linux only) three mount points:

  • The “/” (root) mount point
  • The datadir mount point
  • The tmpdir mount point
  • It may well be the case that two of the above (or perhaps all three of them) share the same mount point. For example, if there isn’t any particular partition for “/tmp“, it is possible that the tmpdir (by default

      [Read more...]
    Previous 30 Newer Entries Showing entries 31 to 60 of 142 Next 30 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.