Home |  MySQL Buzz |  FAQ |  Feeds |  Submit your blog feed |  Feedback |  Archive |  Aggregate feed RSS 2.0 English Deutsch Español Français Italiano 日本語 Русский
Showing entries 1 to 20 of 18349 Next 20 Older Entries
Node failure handling - take 2
Employee +2 Vote Up -0Vote Down
Jonas improved the node failure handling in MySQL Cluster 7.0.9 (and 6.3.29) so here comes a re-run of the a previous blog post. And the node failure handling time has improved a lot - see below.

I created in total 11345 tables, each with 128 columns, and then hit this bug.

When all tables were created, I stopped one node and measured how long time it takes for the other node to perform the node failure handling. Here is what was written into the cluster log (look at the bold lines):

2009-11-27 13:39:21 [MgmtSrvr] ALERT -- Node 4: Node 3 Disconnected

2009-11-27 13:39:21 [MgmtSrvr] ALERT -- Node 4: Network partitioning - arbitration required

2009-11-27









  [Read more...]
More on table_cache
+0 Vote Up -0Vote Down

In my previous post I looked into how large table_cache actually can decrease performance. The “miss” path is getting more expensive very quickly as table cache growths so if you’re going to have high miss ratio anyway you’re better off with small table cache.

What I have not checked though is how does table_cache (or table_open_cache in newer version) size affects the hit path.

I started with the same test as last time – created 100000 tables and read all of them at once to make sure all table cache entries are populated. When I tried repeatedly reading 1000 empty tables with table_cache of 20000 and 2000. With Table Cache of 2000 I got about 16400 selects/sec with Table Cache of 20000 13500

  [Read more...]
Black Friday / Cyber Monday Deal – 50% off on all products! (valid only till 1st Dec 09, 23:59 PST)
+1 Vote Up -3Vote Down

Happy Holidays!

Black Friday is back. We are happy to offer a 50% flat discount on all Webyog products. Yes, you read it right, fifty percent flat discount. Hurry up, this offer is valid only till 1st Dec 09, 23:59 PST.

Still using SQLyog Community Edition? Held off buying SQLyog Enterprise Edition? This offer is literally too good to pass up. Its time to own your copy of SQLyog Enterprise with all the PowerTools. Check out what Enterprise Edition has to offer.

Worried about your MySQL server’s health? Monitor it like a PRO. Get MONyog – MySQL Monitor & Advisor. Your MySQL DBA in a box! Check what it has to offer.

Want to extend your maintenance period? Don’t think twice, head right away to

  [Read more...]
Scaling - going from 2 to X data nodes
Employee +2 Vote Up -0Vote Down
When moving from two data nodes to a bigger Cluster it is not necessarily true that you will have better performance. In fact you can get worse.

Here are some things to think about:
  • Database Load (traffic to Cluster) - if you can handle query load X on a two node cluster and move the same load X to a four data node cluster you will likely get new_load_X=0.8X, i.e., a performance degradation. This has to do with 1) buffers are not filled up fast enough so the data nodes will do "timeout" based sending or 2) that the access patterns aren't scaling. To correct 1) you need to increase the load on the cluster so that internal communication buffers fill up faster.
Access pattern related "problems":

  • For primary key operations (reads, updates, deletes) you will always go to the






  [Read more...]
MySQL Cluster 7.0.9b in Configurator and Sandbox
Employee +1 Vote Up -0Vote Down
Configurator and Sandbox scripts are updated to use 7.0.9b.

You are recommended to upgrade!

Upgrade can be performend using these scripts:
Binary distribution - Upgrade script from 7.0.* -> 7.0.9b is here.
Source distribution - Upgrade script from 7.0.* -> 7.0.9b is here.
  1. Copy the scripts to "install/"
  2. chmod u+x upgrade-script.sh
  3. ./upgrade-script.sh
After step 3) you need to run either:
  • download-binary.sh
  • download-and-compile.sh
and then
  • rolling-restart.sh











  [Read more...]
Reply to SQL is dead, Long live SQL
+0 Vote Up -0Vote Down
I read the article SQL is dead, Long live SQL and I have to say I really liked it. It spoke about the NoSQL movement and how relational database appeal to analysts.

This struck a cord with me. I always believed that what the regular applications play a small part (perhaps a very small part) of what happens to the data through out its lifetime.
After the data is inputted for the first time, it is analyzed, dissected, made sense of and placed in several reports and KPIs that are called for several times a day/week/month.

The business that paid for the application to be developed needs that data. It is not trivial to them at all. In fact, they may possibly make long term strategic decisions based on that data (in an ideal world). Hopefully, they use that data to improve how they




  [Read more...]
Versioning MySQL data: Multi-table records
+1 Vote Up -0Vote Down

In the article ‘Versioning MySQL data‘, I showed the basics of implementing a revisioning system using trigger. As Jens Schauder already pointed out, often the data of a record is spread across multiple tables, like an invoice with multiple invoice lines. Having each invoice line versioned individually isn’t really useful. Instead we want a new revision of the whole invoice on each change.

The perfect solution
Ideally a change of one or more parts of the invoice would be changed, a new revision would be created. There are several issues in actually creating this those. Detecting the change of multiple parts of the invoice at once, generating a single revision, would mean we need to know if the actions are done within the same transaction. Unfortunately there

  [Read more...]
Presentation: Drizzle is not MySQL with Changes by Brian Aker
+3 Vote Up -2Vote Down

Another video from the recent OpenSQLCamp in Portland, Oregon….Earlier today I uploaded the Lightning Talk Videos. Due to the holiday I am unsure when the rest of the videos will be ready. When they are, I will do one blog post featuring them all.

However, I have had several requests for this specific video, so here is Brian Aker speaking about Drizzle.

The slides are up at http://www.slideshare.net/brianaker/drizzle-opensql-camp, and here’s the video:

(Note, I will not do a post for each video…..but since this one is up and ready, I figured I’d do it before I leave for the holiday).

Catching up with Mark Atwood on memcached
Employee +0 Vote Up -0Vote Down
I had an opportunity to catch up with Mark Atwood last week to discuss his new role at Gear6 and some of the interesting developments currently going on around memcached, including Gearman integration and its suitability for cloud computing environments.




MySQL Cluster Community Survey
Employee +4 Vote Up -0Vote Down

If you use MySQL Cluster or think that you might want to use it in the future (especially if you’ve thought ”if only they’d add that feature then it would be ideal for my application”) then now’s your chance to influence the product roadmap.

All you have to do is follow this link to the MySQL Cluster Community Survey and give your input.

Please also mention this to anyone you know of who might have an interest in MySQL Cluster.

Thanks in advance for you help.

OpenSQLCamp Lightning Talk Videos
+3 Vote Up -0Vote Down

OpenSQLCamp was a huge success! Not many folks have blogged about what they learned there….if you missed it, all is not lost. We did take videos of most of the sessions (we only had 3 video cameras, and 4 rooms, and 2 sessions were not recorded).

All the videos have been processed, and I am working on uploading them to YouTube and filling in details for the video descriptions. Not all the videos are up right now….right now all the lightning talks are up.


  [Read more...]
Is your database schema in sync?
+1 Vote Up -0Vote Down

If you have more then a single MySQL database for your production environment, e.g. a development and test environment, or a MySQL replication topology, ensuring your schema’s are in sync can be task that requires some time if not managed correctly.

There is a tool I do use for MySQL environments called Schema Sync – a MySQL Schema Versioning and Migration Utility. There are many reasons why schema’s get out of sync. Developers may not ensure their changes are reflected in any software to be deployed, and when not tested you could end up with broken functionality. A DBA might try some different index strategies on a slave, but not the master, and never implement or revert.

While some people want the quick and hidden just sync version akin to Rails, I really like this product as it produces proper patch

  [Read more...]
Monitoring MySQL with MONyog
+1 Vote Up -0Vote Down

It just works. In absence of any MySQL monitoring for your site, I have found no solution that gets you operational as quickly and easily. MONyog can be deployed in 60 seconds, and configured in another 60 seconds. Within 5 minutes you can have visual monitoring of your MySQL environment.

MONyog is an agentless process, which is an advantage for easy install, but does not provide for monitoring redundancy in the capture of information due to agentless nature. It’s a static standalone executable which is great if you need something to work out of the box. You can easily configure multiple servers in a replication topology, or different servers in your environment. You get the ability to monitor all the usual information, with a dashboard and detailed graphs. While MONyog does provide customizations of rules for the graphs and

  [Read more...]
Running MySQL Cluster on Mac: working around a ndb_mgmd bug
Employee_Team +1 Vote Up -0Vote Down

A week ago we found a workaround for a bug in MySQL Cluster making it impossible to run a management node on MacOS X. Until the bug is fixed, you should use the --nodaemon option for the ndb_mgmd executable. Both MySQL Cluster v6.3 and v7.0 are affected.

Currently, I'm starting the management node like this:


(
cd /opt/mysql/mysql ;
./libexec/ndb_mgmd -f /opt/mysql/config.ini \
--nodaemon 2>/dev/null 1>&2 </dev/null &
)

Obviously, you'll want to change the paths.

Eventually, the bug will get fixed, but until then you got no excuse to not try MySQL Cluster on Mac!

MySQL Cluster 7.0.9 GA binaries released
Employee +1 Vote Up -0Vote Down

The GA binaries for MySQL Cluster 7.0.9 have been released – download them from http://dev.mysql.com/downloads/select.php?id=14

A summary of the changes can be found in the MySQL Cluster 7.0.9 Change Log

Analytics at Twitter
+1 Vote Up -0Vote Down

Twitter

Last week I spent some time speaking with Kevin Weil, head of analytics at Twitter. Twitter, from a technology perspective, has had a bit of a hard time due to their stability issues in their early days.  Kevin was keen to point out that he feels this was due to the incomparable growth Twitter was experiencing at the time and their constant struggle to keep up.  Kevin was also keen to show that Twitter prides themselves on striving for engineering excellence, the creation & contribution to new technologies and generally assisting in pushing the boundaries forward.  Our conversation naturally centered on analytics at Twitter.

Twitter, like many web 2.0 apps, started life as a

  [Read more...]
ZRM for MySQL Issues
+2 Vote Up -0Vote Down
I really like ZRM for MySQL Community Edition for backups. I find
it very simple to install and configure and it gets the job done. It's default settings suits most installations. The challenges arise once you need to adapt it to more complex organizations. Please note that all the issues described on this article refer to Linux installations.

What If DBAs Have No sudo?

This was the 1st challenge that I ever faced. ZRM requires full root access at least during installation and in some cases, it requires some sudo permissions to be able to manage its files as well. Some organizations don't grant these permissions to the DBAs complicating the installation. When I looked into the scripts, I didn't see any reason why they wouldn't run in the user space, other

  [Read more...]
Restore a Single Table From mysqldump
+2 Vote Up -0Vote Down
Ok, this is inspired by another post on the same subject. I would have just commented, but there was a required signup. Ew.


While the method there with juggling grants works fine, I'd like to highlight another way that I think is much simpler: use grep & sed to create a file which contains only the table you want to restore.


mysql> show tables;
+------------------+
| Tables_in_gtowey |
+------------------+
| t1 |
| t2 |
| t3 |
+------------------+
3 rows in set (0.00 sec)


# mysqldump gtowey > dump.sql

Given 3 tables in a mysqldump file, lets restore just t2


# grep -n





















  [Read more...]
webcast – DRBD and MySQL
+0 Vote Up -0Vote Down

I’ve teamed up with O’Reilly once again to do another webcast this coming January.  In it, I’ll provide a step-by-step live tutorial of setting up DRBD with MySQL on a couple of virtual servers.  After the live demo there will be time for Q&A as well, so hope you all can tune in.

Register here:  DRBD and MySQL – An HA Match Made In Heaven

memcached and the client: Database UDFs
+1 Vote Up -0Vote Down

NorthScale's own Patrick Galbraith has, for many years now, authored and maintained the MySQL, and now Drizzle, UDFs for memcached.  Last week, Patrick took this one step further with the latest release, version 1.1, which now includes support for "check and set" (a.k.a. CAS) operations.  

User Defined Functions are available for a number of different databases.  This allows some kind of stored procedure language or other triggers to execute other code imported into the DB.  In the case of the memcached UDF, this means giving stored procedures the ability to call memcached operations.

The general idea here is pretty simple.  Most applications start with a database, though it's always possible to use web services or flat files.  Regardless of where the data is

  [Read more...]
Showing entries 1 to 20 of 18349 Next 20 Older Entries

Planet MySQL © 1995-2008 MySQL AB, 2008-2009 Sun Microsystems, Inc.
Content reproduced on this site is the property of the respective copyright holders.
It is not reviewed in advance by Sun Microsystems, Inc. and does not
necessarily represent the opinion of Sun Microsystem, Inc. or any other party.