Last week we had a team meeting, where we could discuss and plan various issues and ideas for current and upcoming versions of our project.

But finally it’s time to publish new material to show what we were up to in the past weeks. We have our first dual-platform-release of the MySQL Workbench 5.1.7 alpha version.

Please note, that in terms of UI linux- and OSX- version aren’t yet on the same level of completeness. While we are nearly done having all features onboard for the linux-build, we still have some more checkmarks to fill on the osx checklist - but we are catching up. Nevertheless it’s the same codebase - especially the backend-code is the same for all platforms.

Some of you might be missing a release - 5.1.6 for Linux. No, you didn’t miss an announcement: For the purpose of unifying the releases for Linux and mac we simply didn’t publish 5.1.6 last week. It was considered an internal release only and now …

Have you ever been upset by the Linux tendancy to swap… Especially when trying to allocate a large InnoDB buffer pool.. Look at the following output:

yves@yves-laptop:~$ free
total used free shared buffers cached
Mem: 2041888 1991096 50792 0 52 954592
-/+ buffers/cache: 1036452 1005436
Swap: 975200 1308 973892

There is still 50792 + 52 + 954592 = 1005436 of free memory and Linux starts to swap!!! The reason is hidden here:

yves@yves-laptop:~$ cat /proc/sys/vm/swappiness
60

The swappiness controls the Linux to swap for the File cache. For a file server or a web server or even MySQL with MyISAM tables, the file cache is interesting but for InnoDB or NDB Cluster it is close to useless. Only put a “0″ in that proc entry (echo 0 > /proc/sys/vm/swappiness) and add …

I received an email from Tarus Balog, CEO of OpenNMS Group, on Friday, taking issue with the language I had used to describe two open source vendors (and I use that term deliberately).

Essentially Tarus objected to me using the term “open source vendor” to describe two companies with Open Core licensing strategies. His email raises a valid point about how we determine which companies are considered “open source vendors” and I wanted to use the opportunity to outline the rules I use to make that decision.

As a technical snafu at our end had prevented Tarus from leaving a comment on the blog I hope he won’t mind me using his words to explain the issue he raised.

He wrote:

“You …

I’ve been thinking about SaaS (in the form of Spinn3r) and how it relates to Open Source for the past few months and I think I’ve come to some interesting conclusions. I think SaaS might be a strong competitor to Open Source in that it’s cheaper and higher quality in a number of situations.

Apparently, I’m no the only one:

Open source is always driven by some organisation – a central body that leads community development efforts to support developers and build revenue streams. In essence, that body gives away the base code and knowledge of the community version to encourage development of the service and expand distribution; to make the software go ‘viral’.

However, I believe software as a service …

Sun reports second quarter results. Compiere reports 216% quarterly revenue growth. EnterpriseDB grows customers accounts. Hyperic and JasperSoft team up on BI for IT. Microsoft embraces Apache but resists GPL. And more.

Sun up or Sun down?
There was some comparatively good news from Sun, which reported a net loss of $209m on revenue down 10.9% at $3.2bn. As Sam Diaz at ZDnet notes, however, “after excluding one-time costs related to recent layoffs and other costs, the company posted a profit of 15 cents per share, beating analysts’ expectations of a 10 cent loss”. In regular trading, shares of Sun were up more than 5%.

Matt Asay noted the impact open …

I’ve been asked about this and realized that it may not be obvious to people who are more familiar with Windows than with Ubuntu. So here is a tip.

When learning MySQL on Ubuntu, it is helpful to be able to get to MySQL’s data directory and observe file creation and modification while you are performing database and table creation and modification, index creation and modification, etc. You can find out MySQL’s data directory by running:

show variables like ‘datadir’;

Suppose your datadir is /var/lib/mysql. And suppose you have a database called test. After opening a terminal window and type:

cd /var/lib/mysql/test/

You will likely receive an error like below:
bash: cd: /var/lib/mysql/test/: Permission denied

Now if you try the command below, as it seems logical on Ubuntu

sudo cd /var/lib/mysql/test/

You will likely get this message:

sudo: cd: command …

This is a simple mysql circular replication implementation on a single machine (just a proof of concept) which can easily be done on a broader scale. Just be aware of the cons of circular replication which mainly gets down to: once a node freaks out or stops for one reason or the other, it’s a bitch and you need to take care of IMMEDIATELY.

Download Sandbox from https://launchpad.net/mysql-sandbox/+download
Download MySQL from http://dev.mysql.com/downloads

Copy the downloaded software onto the your *nix box onto any folder of your preference called $BASEDIR

run:

cd /$BASEDIR

gunzip mysql_sandbox_X.X.XX.tar.gz
tar -xf mysql_sandbox_X.X.XX.tar

ln -s mysql_sandbox_X.X.XX sandbox

time /$BASEDIR/sandbox/make_replication_sandbox –circular=4 –topology=circular /$BASEDIR/mysql-5.1.30-linux-x86_64-glibc23.tar.gz


user@hostname $ time …

The e1000 Nic is very common and can be found in many servers.  During my last NBD cluster engagement, on a set of 5 Dell 1950 servers equipped with a quad e1000 Nic, we were trying to tune cluster performance and one of the thing that was disapointing was that the system time, to processed interrupts from the Nics, was always low.  Since neither the ndbd processes or the mysqld processes were using a significant amount of CPU, we were wondering where the bottleneck was.

Then, Michel Donais, from the client, read the Linux driver documentation and bingo!!! Those e1000 Nics throttle interrupts by default at 8000/s.  8000… it is a big limiting factor….   design to prevent DOS attacks.  We removed the throttling and… reach more than 30,000 interrupt/s and guess what, the number of transaction per second scaled with it along with the ndbd and mysqld cpu usage.  Interesting isn’t it? Then I remembered another …

Dear Lazyweb,

So, I’ve been in Chicago for a week teaching a beginner and an intermediate course on using and administering Linux machines. This week, I’ll teach an intermediate and an advanced course on Linux, and the advanced course will cover profiling and debugging. The main tools I’m covering will be valgrind and oprofile, though I’ll be going over lots of other stuff, like iostat, vmstat, strace, what’s under /proc, and some more basic stuff like sending signals and the like.

So what makes me a bit nervous is, being that the advanced students are mostly CS-degree-holding system developers, they’ll probably be expecting me to know very low-level details of how things are implemented at  the system/kernel level. I’d love to know more about that myself, and actively try to increase my knowledge in that area! Alas, most of my experience with low-level …

In MySQL 5.0, InnoDB gained the ability to use Linux Large Page support for allocating memory for the buffer pool and additional memory pool.

A few customers have asked about using it and there is virtually no documentation on what is required on Linux to enable it. I actually ended up having to read some of the Linux kernel source code to figure out some of this.

This uses the API as documented at:

http://www.mjmwired.net/kernel/Documentation/vm/hugetlbpage.txt

To set this up and use it, you first need a kernel that supports it. All of the recent RHEL kernels do by default from what I can tell. On my Ubuntu systems, I'm not seeing it enabled normally.

Then on the OS level you will need to do the following procedures:

 # Set the number of pages to be used …