One of the things that has always bothered me about replication is that the binary logs are written to disk and then read from disk.

There is are two threads which are for the most part, unaware of each other.

One thread reads the remote binary logs, and the other writes them to disk.

While the Linux page buffer CAN work to buffer these logs, the first write will cause additional disk load.

One strategy, which could seriously boost performance in some situations, would be to pre-read say 10-50MB of data and just keep it in memory.

If a slave is catching up, it could have GIGABYTES of binary log data from the master. It would then write this to disk. These reads would then NOT come from cache.

Simply using a small buffer could solve this problem.

One HACK would be to use a ram drive or tmpfs for logs. I assume that the log thread will block if the disk fills up… if it does so …

At MySQL Conference and Expo 2009, I explained how Linux I/O scheduler queue size affects MyISAM insert performance.

It is well known that Linux implemented four types of I/O schedulers (noop/deadline/anticipatory/cfq) in Linux kernel 2.6.10. The default is cfq in most distributions including RHEL, which is not so good then noop normally outperforms, but I'll talk this in other posts.

Linux I/O scheduler also has a functionality to sort incoming I/O requests in its request-queue for optimization. Queue size is configurable. Queue size is defined as "/sys/block/sdX/queue/nr_requests" then you can change queue length as follows.

# cat /sys/block/sda/queue/nr_requests
128
# echo 100000 > /sys/block/sda/queue/nr_requests

Changing queue size is even effective for noop …

OIN aims to cut the FAT. What is the point of the GPL? Black Duck takes flight. Ingres delivers Salesforce.com appliance. The ongoing fallout from Oracle-Sun. Feedback on the Bee Keeper model. And more.

Follow 451 CAOS Links live @caostheory

OIN aims to cut the FAT
# The Open Invention Network announced plans to review the Microsoft FAT patents at the center of its recent skirmish and settlement with TomTom. have been placed for prior art review on the Post-Issue …

After a turbulent week, where a few of our team were presenting workbench at this years MySQL Users Conference, we have finally uploaded the next beta packages for you to try. We’ve further improved the handling of the application. The problem with the missing table editor in the mac package is fixed in this release as well.

Please grab the package of your choice at our download page and give it a try.

I have published the very first sharable Drizzle Amazon Machine Image (AMI) for AWS EC2, based on the good feedback from my discussion at the Drizzle Developer Day on what options we should try.

This first version is a 32bit Developer instance, showcasing Drizzle and all necessary developer tools to build Drizzle from source.

What you will find on drizzle-ami/intrepid-dev32 - ami-b858bfd1

Ubuntu 8.10 Intrepid 32 bit base server installation:

• build tools
• drizzle dependencies
• bzr 1.31.1

From the respective source trees the following software is available:

• drizzle 2009.04.997
• libdrizzle 0.0.2
• gearman 0.0.4
• memcached 1.2.8
• libmemcached 0.28

Drizzle has been configured with …

Today I attended the Drizzle Developer Day which took place in the auditorium of the Sun Campus in Santa Clara.

Many of the the Drizzle core hackers as well as several other people interested in the development attended this event, hacking away and discussing various issues. Jeremy Zawodny gave a presentation about Craigslist's needs for Drizzle, Jay Pipes gave an overview over Google's protocol buffers library. I took a number of pictures, which you can find in my …

It's interesting that just as Apple announced surprisingly positive quarterly results, Microsoft announced their first decline in sales revenues in 23 years.  While Microsoft is not in any kind

read more

To follow up on Chuck’s post from earlier this week, I want to say that yes, on Monday morning I raced across the office to share the crazy news that Oracle is trying to buy MySQL Sun.  Though, I don’t remember yelling.

But, I did have a real point here and that is that the numbers that he quoted are prior to the Enterprise / Community split that happened late in 2006 and since then, the landscape has changed dramatically.

Today, there are at least 5 different major forks of MySQL to choose from (and I won’t even talk about the already complicated version and storage engine choices that most companies have to make).  I am counting MySQL Community (freely available)l MySQL Enterprise (allowing for enterprise support contracts with Sun); Our Delta  (a patched MySQL Community version); Monty Widenus’ MariaDB; and of course, Drizzle.   I’m sure there are others that I’m forgetting.  This has the …

“We’re both in the transportation business. We have a 747, and they have a Toyota.”

The comparison of Oracle’s database and MySQL, made by Oracle president Charles Phillips at the 2004 Vortex Conference was undoubtedly meant as a criticism, but it so graphically demonstrated the differing business strategies and selling-points of the two products that MySQL executives began citing it themselves.

It is also a comparison that explains how the two products could potentially co-exist within a single company, as they seem likely to do following the announcement that Sun has agreed to be acquired by Oracle.

Much of the MySQL-related coverage of the impending acquisition has focused on the likelihood of Oracle killing-off the …

On Tuesday at the MySQL Camp 2009 in Santa Clara I presented Setting up MySQL on Amazon Web Services (AWS).

This presentation assumed you know nothing about AWS, and have no account. With Internet access via a Browser and a valid Credit Card, you can have your own running Web Server on the Internet in under 10 minutes, just point and click.

We also step into some more detail online click and point and supplied command line tools to demonstrate some more advanced usage.

Getting started with MySQL in Amazon Web Services View more presentations from Ronald Bradford.