So, back when we released our first beta in September, one of the many responses was this

The comments about the reliability / durability of the log definitely struck me as testing we needed.

It’s taken a while (we had this GA thing we were working on…), but we finally have crash and recover testing of the innodb transaction log and the slave plugin.

Here is what happens for the innodb-based log:

• Set up the test servers and start the randgen with the trx_log grammars.  I’ll point you …

Well day two here at PgEast has drawn to a close and it was another
very informative day.

Today I concentrated on the more common tasks of a Pg DBA so I attended three
talks (four if you count mine) that where rather heavy on the technical side of being a Pg DBA

Keven Kempter drew me back again with his excellent talk on Backup and recovery methods
this time giving some very good advice on how to use and abuse of pg_Dump_all and
PG_restore. He also touched on three different recipes PITR on ProstgreSQL and gave some handy
advice on when and why to use it.

I also caught another Mongo talk this time by Steve Francia it was on the application of Mongo
in a real world web retail store. He presented a very convincing argument for the NoSQL side of things in
the retail realm namely that RDBMS works great when you have but a few similar products
such as books, CDs and …

I decided to leave Rockyou because after three years of working on the Facebook platform, Reach Applications, Viral Loops, Games, Scaling, and Management. Being a Director of Engineering was cool yet management decayed my skills as a system builder-ideally in the future I can find a good balance between coding which I love and management of a process. Since I focused on management, it's like being a C++ programmer for years; this programmer does not code for a while and then is asked to build an optimal hash table within a few days. This programmer knows if he/she was in the thick of things as a Coder he/she could do it. Since he/she is rusty it will take he/she much longer. This suddenly became apparent as I was asked softball questions and I did not answer them quickly enough. Fortunately I am taxing my skills and as a result they are flooding back. My mojo is here. I am learning new things and one thing I can say is JQUERY is awesome.
…

Ronald Bradford will be presenting at two conferences in April, the O’Reilly MySQL Conference and the IOUG Collaborate 11 conference. His presentations include:

• Monday April 11 at 3:45-4:45pm in Orlando, Florida – Common MySQL Scalability Mistakes
• Wednesday April 13 at 2:00-3:00pm in Santa Clara, California – Best Practices for MySQL DBAs and Developers Part 1
• Wednesday April 13 at 3:05-3:50pm in Santa Clara, California – …

I got access to our 12-core Intel server, so I was able to do some better benchmarks to test the different group commit thread scheduling methods:

This graph shows queries-per-second as a function of number of parallel connections, for three test runs:

1. Baseline MariaDB, without group commit.
2. MariaDB with group commit, using the simple thread scheduling, where the serial part of the group commit algorithm is done by each thread signalling the next one.
3. MariaDB with group commit and optimised thread scheduling, where the first thread does the serial group commit processing for all transactions at once, in a single thread.

(see the previous post linked above for a more detailed explanation of the two thread scheduling algorithms.)

This test was run on a 12-core server with hyper-threading, memory is …

Download PDF
Presentation

Can database performance improvements be achieved with zero code changes? Learn how to use one simple advanced technique to make better MySQL indexes and improve your queries by 500% or more. Even with a highly indexed schema as shown in our 10 table join example, significant improvements in performance can be achieved.

This presentation introduces the approach for correct identification and verification of problem SQL statements and then describes the means of identifying index choices for optimization. Then discussed is not only how to apply indexes to improve query performance, but how to apply better indexes and provide even great performance gains.

This presentation …

Now that mysql 5.5 is GA, development for the performance schema continues in the mysql-trunk code base. A lot of projects have been completed already, which are worth mentioning.

New table io instrumentation

Table io is now instrumented. As the performance instrumentation is located in the MySQL layer and not inside the storage engine, this instrumentation is de facto available to all storage engines, with zero code change.

New table lock instrumentation

Table locks are also instrumented. It is a nice complement to table io, and can be enabled or disabled independently from table io. Not all table waits are io problems, some are also contention caused by locks ... and there is now a way to observe that.

New stages instrumentation

Major execution phases of a statement, called stages, are now instrumented. This instrumentation is critical to identify which part of the execution path (parser, acl, …

Here are the minutes of the meeting. They can also be found online
with the irc logs here.

Meeting Actions

• Daviey to talk with wider docs team regarding translations (deferred)
• Daviey to post another followup one euca-dhcp bug.
• SpamapS to put his version of ubuntuserver-minutes in directions for writing minutes

Natty Development

• Nothing much to report here. The Work Items Tracker for beta1 seems to suggest we are a bit behind and need to postpone some items.

  • http://people.canonical.com/~platform/workitems/natty/canonical-server-ubuntu-11.04-beta-1.h

…

If you know me, then you probably have heard of Flexviews. If not, then it might not be familiar to you. I’m giving a talk on it at the MySQL 2011 CE, and I figured I should blog about it before then. For those unfamiliar, Flexviews enables you to create and maintain incrementally refreshable materialized views.

You might be asking yourself “what is an incrementally refreshable materialized view?”. If so, then keep reading. This is the first in a multi-part series describing Flexviews.

edit:
You can find part 2 of the series here: http://www.mysqlperformanceblog.com/2011/03/25/using-flexviews-part-two-change-data-capture/

The output of …

A new version of PBMS for drizzle has been pushed up to launchpad:

drizzle_pbmsV2

I have rewritten PBMS and changed the way that BLOBs are referenced in order to make PBMS more flexible and to fix some of it's limitations. I have also removed some of the more confusing parts of the code and reorganized it in an attempt to make it easier for people to find there way around it.

So apart form some cosmetic changes what is different?

Maybe the best answer would be to say what hasn't changed: the user and engine API  and the way in which the actual data is stored on the disk remains pretty much unchanged, but everything else has changed.

The best place to start is with the BLOB URL, the old URL looked like this:
"~*1261157929~5-128-6147b252-0-0-37" the new URL looks …