Yesterday, I used mysqlpdump to dump 300G of data. Today, as step two of the process, I need to restore that data into the new server. Every good dump tool needs a restore tool, so I wrote
mysqlprestore, which is really just a modification of mysqlpdump that will spawn off threads and run your restore in parallel, processing an output directory from mysqlpdump.

I really need to stick it in version control or something, and I’m sure there are bugs, but it’s working for me so far. Maybe we can merge the two into a single great tool?

…

Just read this article about running PHP applications on Phalanger and found it greatly interesting that PHP apps are often quite a bit faster running on Phalanger than on the Zend engine.  In fact the article states that phpBB serves up pages twice as fast from Phalanger than from Zend.

Also interesting is the existence of a managed MySQL extension for Phalanger.  This appears to be based on libmysql however.

Phalanger works great on .NET but also works on Mono.  This makes it very easy to use C# (or any other CLR language) to write some layers of your app, like data access code, while allowing you to write the UI in PHP.  With Phalanger you use the full range of managed components like Connector/Net, LinQ, generics, …

I mentioned the Gartner conference among a few of the upcoming open source events this fall. I've been to the past versions of this conference in Phoenix and in Orlando and it's a very good event for managers and newcomers to Open Source. It's not a hardcore technical conference like OSCON or the MySQL conference, but it's very good for its audience. Gartner has come a long way in recent years in helping IT organizations ramp up their use of open source with a carefully considered "best practices" approach backed by good research and thorough analysis. The Gartner guys that... READ MORE

General query logging can be very handy in MySQL on profuction server for various debugging needs. Unfortunately you can't switch it on and off without restarting server until MySQL 5.0.

What can you do in MySQL 5.0 and below ?

Use Our Patch - With this patch you can get all queries logged as slow queries (with times) and as you can change long-query-time online you can effectively enable and disable debug logging live. Note however this is not 100% equivalent for general query log - for example connects or queries with syntax errors will not be logged.

Enable logging to /dev/null You can enable queries to say "all_queries" log and symlink that to /dev/null. So when you will need to enable queries you can symlink it to something else and run "flush logs" so logs are …

If you like to compile MySQL from sources by yourself, for different needs, like debugging, testing etc, you probably can face this issue.

What I usually do to fast compile and test is

PLAIN TEXT SQL:

1. ./configure --prefix=/dir/to/mysql
2. make
3. make install

and then, for example, load the dump of InnoDB from previous version:

mysql testdatabase < dump.sql


I bet you will not notice all your tables now is MyISAM. Why?

PLAIN TEXT SQL:

1. Welcome TO the MySQL monitor.  Commands end WITH ; OR \g.
2. Your MySQL connection id IS 1
3. Server version: 5.1.21-beta-log Source distribution
4.  
5. Type 'help;' OR '\h' FOR help. Type '\c' TO clear the buffer.
6.  
7. mysql> SHOW engines;
8. …

We had our first ever MySQL User Conference in Japan this week, put on by our very own Larry Stefonic (Larry-san as we call him) and our all-star Japanese sales & marketing team.  We had several hundred people at this multi-day event and it was standing room only.  There were keynotes by Marten Mickos as well as Yukihiro Matsumoto (Matz) the author of Ruby, the director of HP Japan and the General Manager of Sumisho, one of our top …

I’m working on a project at the moment where we’re doing an upgrade and need to do the dump-and-restore method. It’s 300G, so that’s never going to be fun, but I found a tool today that helped significantly.

Multi threaded mysqldump is not an utopia any more. mysqlpdump can dump all your tables and databases in parallel so it can be much faster in systems with multiple cpu?s.

I ran mysqlpdump (with one patch I’ll send in soon to put quotes around table names) today with 16 threads on a 4 core system and did all 300G in ~3.5 hours. Additionally, since it wraps mysqldump but iterates over the tables, I got a sql file for each table, which is going to make writing a script to restore a piece of cake. It understands that I wanted to do –master-data and it had an option to gzip each sql file as it went.

All in all, I’m thrilled. kudos! And thanks for the tool.

…

I didn't realize InfoWorld was doing open source awards, until I read about it in Dave's blog.  But here they are.  And looks like MySQL won as best database.  Check out the "BOSSIE" awards.

• InfoWorld: Blog, …

Microsoft and Sun expand partnership. QNX open sources realtime operating system. Sun acquires Lustre file system. (and more)

Microsoft and Sun Expand Strategic Alliance, Microsoft / Sun Microsystems (Press Release)

QNX Publishes Neutrino Source Code and Opens Development Process, QNX Software Systems (Press Release)

Sun Microsystems Expands High Performance Computing Portfolio with Definitive Agreement to Acquire Assets of Cluster File Systems, Including the Lustre File System, Sun Microsystems (Press Release)

Microsoft and Novell Open …

I thought of a brilliant QA plan. Create sql rainbow tables! Just trust me, this system of QA will be very powerful in bug finding. Especially important will be the comparison of old/new versions of mysql. Writing a prototype now, on my day off.

Just during prototype development, I've discovered a handful of bugs. I'm testing all functions that are documented in the manual. This is alot that I've written up:

mysql> select count(*),category from func group by category;
+----------+--------------+
| count(*) | category     |
+----------+--------------+
|        6 | arithmetic   |
|        7 | bit          |
|       60 | casting      |
|       47 | comparison   |
|       52 | datetime     |
|       18 | encryption   |
|      127 | geometry     |
|       17 | information  |
|        7 | logical      |
|       32 | mathematical |
|        9 | misc         |
| …