Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский Português 中文
Showing entries 1 to 30 of 35 Next 5 Older Entries

Displaying posts with tag: cacti (reset)

Galera data on Percona Cloud Tools (and other MySQL monitoring tools)
+0 Vote Up -0Vote Down

I was talking with a Percona Support customer earlier this week who was looking for Galera data on Percona Cloud Tools. (Percona Cloud Tools, now in free beta, is a hosted service providing access to query performance insights for all MySQL uses.)

The customer mentioned they were already keeping track of some Galera stats on Cacti, and given they were inclined to use Percona Cloud Tools more and more, they wanted to know if it was already supporting Percona XtraDB Cluster. My answer was: “No, not yet: you can install

  [Read more...]
Galera data on Percona Cloud Tools (and other MySQL monitoring tools)
+0 Vote Up -0Vote Down

I was talking with a Percona Support customer earlier this week who was looking for Galera data on Percona Cloud Tools. (Percona Cloud Tools, now in free beta, is a hosted service providing access to query performance insights for all MySQL uses.)

The customer mentioned they were already keeping track of some Galera stats on Cacti, and given they were inclined to use Percona Cloud Tools more and more, they wanted to know if it was already supporting Percona XtraDB Cluster. My answer was: “No, not yet: you can install agents in

  [Read more...]
MySQL Monitoring With Cacti Using Percona Monitoring Plugins (1-minute resolution)
+0 Vote Up -0Vote Down

Today, just like many times before, I needed to configure a monitoring server for MySQL using Cacti and awesome Percona Monitoring Templates. The only difference was that this time I wanted to get it to run with 1 min resolution (using ganglia and graphite, both with 10 sec resolution, for all the rest of our monitoring in Swiftype really spoiled me!). And that’s where the usual pain in the ass Cacti configuration gets really amplified by the million things you need to change to make it work. So, this is a short checklist post for those who need to configure a Cacti server with 1 minute resolution and setup Percona Monitoring Plugins on it.

Configuring Cacti for 60-seconds polling

First of all, we

  [Read more...]
Percona Monitoring Plugins fix: Query Response Time
+0 Vote Up -0Vote Down

After switching from the Better Cacti Templates to the Percona Monitoring Plugins we suffered from the Query Response Time and the Query Time Histogram not graphing at all.

It took me a while to figure out why our new instance wasn’t graphing: the response time query was performing and the script was picking up its values. Also the rrd files were created but for some bizarre reason all values were set to “NaN”, in rrd/cacti terms: Not a Number. If you search on that subject you will come across a lot of (forum) postings stating you need to change your graph type to “GAUGE” or change the MIN/MAX values for your data templates. Strange as this

  [Read more...]
Vote for MySQL[plus] awards 2011 !
+5 Vote Up -0Vote Down

First of all, I wish you a happy new year.
Many things happened last year, it was really exciting to be involved in the MySQL ecosystem.
I hope this enthusiasm will be increased this year, up to you !

To start the year, I propose the MySQL[plus] Awards 2011
It will only take 5 minutes to fill out these polls.
Answer with your heart first and then with your experience with some of these tools or services.

Polls will be closed January 31, so, vote now !
For “other” answers, please,  let me a comment with details.

Don’t hesitate to submit proposal for tools or services in the comments.






  [Read more...]
Version 1.1.8 of Better Cacti Templates released
+2 Vote Up -0Vote Down

I’ve released version 1.1.8 of the Better Cacti Templates project. This release includes a bunch of bug fixes and several important new graphs. There are graphs for the new response-time statistics exposed in Percona Server, and a new set of graphs for MongoDB.

There are upgrade instructions on the project wiki for this and all releases. There is also a comprehensive tutorial on

  [Read more...]
Careful how you monitor MySQL
+8 Vote Up -0Vote Down

I was recently struck by a problem which is unusual. In order to keep an eye on the database server I use nagios, cacti, merlin (http://www.mysql.com/products/enterprise/monitor.html" target="_blank) and some local scripts to monitor the database instance and ensure that it is working properly.  That normally works fine.  The different monitor processes do various things, one of which is to monitor the replication status of a slave, and warn me if the replication is not working or if it’s behind. This is done with the command SHOW SLAVE STATUS.

The server I was looking at runs some large local batch jobs aggregating data. Unfortunately, I was experiencing that replication was interfering with these batch jobs so decided to see if things would perform better if

  [Read more...]
Fatal error: Allowed memory size of 16777216 bytes exhausted (tried to allocate 41 bytes) in /usr/share/cacti/site/lib/xml.php on line 32
+0 Vote Up -0Vote Down

I was trying to setup cacti on my ubuntu desktop to gather metrics from few new database servers we were planning to replace. Installed cacti using the following command

apt-get install cacti

Then the next step was to download and the install the cacti mysql templates from http://code.google.com/p/mysql-cacti-templates/. Thanks to Baron, was able to get this up and running fast using the templates. But had one problem though, while importing the mysql template “cacti_host_template_x_mysql_server_ht_0.8.6i-sver1.1.7.xml” cacti bombed with the below error

Fatal error: Allowed memory size of 16777216 bytes exhausted (tried to allocate 41

  [Read more...]
A better way to build Cacti templates
+0 Vote Up -0Vote Down

The traditional way to build Cacti templates is through the Cacti web interface. This is an enormous amount of work, and the result is generally not very consistent or good quality. The process is too error-prone. You can export the templates as XML, but they tend to have problems such as version incompatibilities with other Cacti installations, and it’s hard to adapt them for user preferences such as different graph image sizes and polling intervals.

The way I build Cacti templates is exactly the opposite. I create a data structure in a file, which looks like many configuration file syntaxes you’ve probably worked with. It represents the graphs, templates, scripts, and so on. From this, a tool generates the XML template file, which is a universal template definition, and is a breeze to import into Cacti. It is completely consistent and

  [Read more...]
Version 1.1.7 of Better Cacti Templates released
+2 Vote Up -0Vote Down

I’ve released version 1.1.7 of the Better Cacti Templates project. This release includes a bunch of bug fixes, some new graphs for MySQL, and two new sets of graphs, for Redis graphing and for JMX graphing.

There are upgrade instructions on the project wiki for this and all releases. There is also a comprehensive tutorial on how to create your own graphs and templates with this project. Use the project issue tracker to view and report issues, and use the project mailing list to

  [Read more...]
I’ll be speaking at the O’Reilly MySQL Conference 2010
+0 Vote Up -1Vote Down

I’m speaking at the O’Reilly MySQL Conference 2010. I hope I don’t lose my voice, because I have four sessions!

  [Read more...]
Version 1.1.6 of Better Cacti Templates released
+1 Vote Up -0Vote Down

I’ve released version 1.1.6 of the Better Cacti Templates project. This release includes a bunch of bug fixes (but not all of them!) and two new sets of graphs. One set is for disk I/O on GNU/Linux, and the other is a new set of templates for OpenVZ. I’m looking for feedback on both of those. This release also has a bunch of code-level features: much better test coverage (hooray!), and a refactored ss_get_by_ssh.php that makes it much easier to create new graphs and templates. The SSH-based templates also take advantage of the same caching as the MySQL templates, which makes them a lot more efficient.

There are upgrade instructions on the project wiki for this and all releases. There is also

  [Read more...]
Vote for Cacti template enhancements
+2 Vote Up -1Vote Down

If you’d like some improvements to the Cacti templates (MySQL, Apache, Memcached, and more) I’ve been maintaining, please make your voice heard — either write to the mailing list, or post a new issue (or comment on an existing one) on the issue list. I’ve got a bunch of work underway, including a test suite for ss_get_by_ssh.php.

Related posts:

  • Version 1.1.6 of Better Cacti Templates released I’ve
  • Version 1.1.2 of improved Cacti templates released I’ve
  •   [Read more...]
    Version 1.1.4 of improved Cacti templates released
    +2 Vote Up -0Vote Down

    I’ve released version 1.1.4 of my improved Cacti templates. Unlike the prior release, which was solely bug fixes, this one includes new graphs in the MySQL template. Some of the graphs are of data that’s exposed in standard MySQL versions, but some of it is available only in Percona’s high-performance builds of the MySQL database server. If you don’t have a Percona build, those graphs will just contain nothing, but there is no detrimental effect.

    This template release is fully backwards compatible with the previous release. The upgrade process is to copy the new PHP file into place and import the new template file. You can then add the new graphs to your hosts.

    I’ve also taken the opportunity

      [Read more...]
    Version 1.1.3 of improved Cacti graphs for MySQL released
    +2 Vote Up -0Vote Down

    I’ve just released version 1.1.3 of the Cacti templates I wrote for MySQL. This is a bug-fix release only, and affects only ss_get_mysql_stats.php. To upgrade from the previous release, upgrade ss_get_mysql_stats.php. Don’t forget to save and restore your configuration options, if any. (Note that there is a feature to help with this: you can keep configuration options in ss_get_mysql_stats.php.cnf to avoid making them in ss_get_mysql_stats.php.)

    Next up: actual template changes! More graphs!

    The changelog follows.

    2009-10-24: version 1.1.3
    
            * This is a bug-fix release only, and contains no template changes.
            * To upgrade from the previous release, upgrade ss_get_mysql_stats.php.
            * MySQL 5.1 broke backwards
      [Read more...]
    Monitoring MySQL Product Options
    +0 Vote Up -0Vote Down

    I’ve had plenty of comments on specific products to Monitoring MySQL Options before providing the completed list. Here are the results from my survey to give everybody a more complete list.

    Nagios 25 xxxxxxxxxxxxxxxxxxxxxxxxx MONyog 8 xxxxxxxx Cacti 4 xxxx Munin 3 xxx MySQL Enterprise Monitor/Merlin 3 xxx   [Read more...]
    Monitoring MySQL options
    +3 Vote Up -0Vote Down

    My recent poll What alert monitoring do you use? showed 25% of the 58 respondents to bravely state they had no MySQL monitoring. I see 1 in 3, ~33% in my consulting so this is consistent.


    There is no excuse to not have some MySQL Monitoring on your production system. At the worse case, you should be logging important MySQL information for later analysis. I use my own Logging and Analyzing scripts on every client for an immediate assessment regardless of what’s available. I combine that with my modified statpack to give me immediate text based analysis,

      [Read more...]
    Flickr’s upgraded shard
    +2 Vote Up -0Vote Down

    While going about my day, I stumbled upon John Allspaw’s tweet about his experience with MySQL 5.0.51 versus Percona’s 5.0.83 highperf Percona build. For those that don’t remember John from the MySQL Conference & Expo’s, he’s the guy managing operations at Flickr, and he recently even wrote a book about webops.

    Click on the photo above, to see when the upgrade happened. Amazed?

    Haven’t tested this out myself, though I’m curious to see how this stacks up against MySQL 5.4, which is also aimed at being a high performance release. In another note, it seems

      [Read more...]
    What do you monitor in MySQL?
    +3 Vote Up -0Vote Down

    If you are unfamiliar with what to monitor in MySQL, starting with looking at what popular Monitoring products monitor. For example, the following is the list of MySQL Cacti Plugin measurements.

    Innodb Buffer Pool Activity

    • Pages Created
    • Pages Written
    • Pages Read

    Innodb Buffer Pool Pages

    • Pool Size
    • Database Pages
    • Free Pages
    • Modified Pages

    Inoodb File I/O

    • File Reads
    • Files Writes
    • Log Writes
    • File Fsyncs

    Innodb Pending I/O

    • Aio Log Ios
    • Aio Sync ios
    • Buffer Pool Flushes
    • Chkp Writes
    • Ibuf Aio Reads
    • Log Flushes
    • Log Writes
    • Normal Aio Reads
      [Read more...]
    Version 1.1.2 of improved Cacti templates released
    +0 Vote Up -0Vote Down

    I’ve packaged up and released version 1.1.2 of the Cacti templates I’ve written for MySQL, Apache, memcached, nginx etc.

    Anyone who would like to help write documentation (or do anything else, for that matter) is welcomed to participate. I’ll give commit access at the drop of a hat.

    Changelog:

    2009-05-07: version 1.1.2
    
    	* The parsing code did not handle InnoDB plugin / XtraDB (issue 52).
    	* The servername was hardcoded in ss_get_by_ssh.php (issue 57).
    	* Added Handler_ graphs (issue 47).
    	* Config files can be used instead of editing the .php file (issue 39).
    	* binary log space is now calculated without a MySQL query (issue 48).
    	* There was no easy way to force inputs to be filled (issue 45).
    	* Some graphs were partially hidden without
      [Read more...]
    Secure, easy Cacti graphing without SNMP
    +1 Vote Up -0Vote Down

    Cacti is a great tool for collecting information about systems and graphing it. However, it likes to use SNMP, and SNMP is often not desirable. Instead, I often see the need for a method that is:

    • Secure. Use trusted, well-known, encrypted communication. Do not open up new ports.
    • Zero install on the monitored system.
    • As little installation or modification on the monitoring system as possible.

    Over the last several years, I’ve slowly created more and more software to create Cacti graphs via standard POSIX command-line utilities over SSH with key-pair authentication. (I’ve also created similar software for Nagios, but that’s another matter.) The major problem with the work I’ve done is that it’s totally un-publicized.

    The system works by

      [Read more...]
    Reflections on MySQL Enterprise Monitor
    +0 Vote Up -0Vote Down

    Merlin is MySQL’s Enterprise Monitor (http://www.mysql.com/products/enterprise/monitor.html" target="_blank), a system designed to monitor a number of MySQL database servers and provide useful feedback to the DBAs as to how they are running and what things may require attention.

    It provides various things:

    • graphs of key database and server performance indicators: load average, cpu usage and mysql specific information such as number of database connections, replication delays, buffer usage statistics, etc…
    • a set of advisors which are intended to tell you if things are not configured properly and what to do to correct the problem.
    • monitoring of servers which are linked together through replication
    • the latest version of merlin (v2.0, which has been available since the beginning of the year) additionally adds via mysql proxy
      [Read more...]
    News on MySQL Cacti Templates
    +0 Vote Up -0Vote Down
    It’s been a while since I’ve sent any news about the MySQL Cacti Templates project I started a while ago. Here’s what’s new: First of all, it’s not just MySQL templates anymore. It’s a generic framework and tools for creating templates, and I’ve written templates for Apache, Memcached, etc. I just haven’t publicized [...]
    MySQL Cacti templates version 1.1.1 released
    +0 Vote Up -0Vote Down
    I’ve released version 1.1.1 of the MySQL Cacti templates I develop. The new templates work around more Cacti limitations, including the limitation on the length of the data returned from the poller script. There’s also a new graph and many other niceties since the last release. Note that there are TWO incompatible changes with [...]
    Would Tufte approve of mixing units on a graph?
    +0 Vote Up -0Vote Down
    I’ve created a set of Cacti templates for graphing stats about MySQL. While these were based on several other people’s work, there are many improvements. One of them in particular I want to bring up, and I’ll go so far as to say it ought to be a “best practice” for graphing. [...]
    Agent vs agent-less monitoring
    Employee +0 Vote Up -0Vote Down

    Baron posted something interesting about agent vs agent-less monitoring in response to Rob.

    While reading it, I couldn’t help thinking that the distinction is somewhat misleading, if not wrong.

    I’d go so far as to say that agent-less doesn’t exist as such. Why do I say such heresy?

    Trivially, you need some piece of software to collect data. With munin you configure a server that triggers scripts on the monitored servers. The set of data sources is governed by what you install in the correct directory on the monitored server. Cacti relies on SNMP heavily and

      [Read more...]
    Is agent-based or agentless monitoring best?
    +0 Vote Up -0Vote Down
    Rob Young has posted a few blog entries lately on the MySQL Enterprise monitoring software. His latest post claims that agent-based monitoring is equivalent to extensibility (MySQL Enterprise Monitor: Agent = Extensibility). I think this is conflating two completely distinct properties of a monitoring solution. Cacti is extremely extensible, with a plugin-based architecture and [...]
    Agent vs agent-less monitoring
    Employee +0 Vote Up -0Vote Down

    Baron posted something interesting about agent vs agent-less monitoring in response to Rob.

    While reading it, I couldn’t help thinking that the distinction is somewhat misleading, if not wrong.

    I’d go so far as to say that agent-less doesn’t exist as such. Why do I say such heresy?

    Trivially, you need some piece of software to collect data. With munin you configure a server that triggers scripts on the monitored servers. The set of data sources is governed by what you install in the correct directory on the monitored server. Cacti relies on SNMP heavily and

      [Read more...]
    Agent vs agent-less monitoring
    Employee +0 Vote Up -0Vote Down

    Baron posted something interesting about agent vs agent-less monitoring in response to Rob.

    While reading it, I couldn’t help thinking that the distinction is somewhat misleading, if not wrong.

    I’d go so far as to say that agent-less doesn’t exist as such. Why do I say such heresy?

    Trivially, you need some piece of software to collect data. With munin you configure a server that triggers scripts on the monitored servers. The set of data sources is governed by what you install in the correct directory on the monitored server. Cacti relies on SNMP heavily and

      [Read more...]
    MySQL Cacti templates 1.0.0 released
    +0 Vote Up -0Vote Down

    I just uploaded the 1.0.0 release of my MySQL templates for Cacti. Now there’s an actual download under the Downloads tab. I solved a number of issues in this release. The changelog:

    2008-06-01: version 1.0.0
    
    	* Fixed when SHOW MASTER LOGS has no File_size column.
    	* Fixed Cacti-version-specific problems with include files.
    	* Fixed when binary log is not enabled.
    	* Fixed some caching issues.
    	* Fixed make-template.pl issues when downloaded from SVN.
    	* Replication graph shows only slave_lag instead of Seconds_behind_master
    	* Generate a version for Cacti 0.8.6i.
    	* Support generating custom versions with make-template.pl.
    Cacti, monitoring, mysql
    Showing entries 1 to 30 of 35 Next 5 Older Entries

    Planet MySQL © 1995, 2014, Oracle Corporation and/or its affiliates   Legal Policies | Your Privacy Rights | Terms of Use

    Content reproduced on this site is the property of the respective copyright holders. It is not reviewed in advance by Oracle and does not necessarily represent the opinion of Oracle or any other party.