I’m visiting a Pentaho customer right now whose current “transaction” volume is 200 million rows per day.  Relatively speaking, this puts their planned warehouse in the top quintile of size.  They will face significant issues with load times, data storage, processing reliability, etc.  Kettle is the tool they selected and it is working really well.  Distributed record processing using Kettle and a FOSS database is a classic case study for Martens scale out manifesto. 

This organization doesn’t have unlimited budget.  Specifically, they don’t have a telecom type budget for their telecom like volume of data.  One of the issues that has come up with their implementation has been the tradeoff between space, and keeping the …

After two months of hard work we are proud to announce a new release of XAMPP for Windows and Linux. New in both releases of XAMPP are MySQL (5.0.37), PHP (4.4.6), phpMyAdmin (2.10.0.2), and OpenSSL (0.9.8e). The Windows version also contains up-to-date versions of: FileZilla FTP Server (0.9.23), ADOdb (4.94), and Zend Optimizer (3.2.4).

With XAMPP 1.6.1 we tried to make the Windows version ready for Vista. The beta tests were very successful and most people reported a very smooth XAMPP under Vista but there were also people still having problems. Please get in touch with me if you also encounter problems on Vista. Currently please avoid installing XAMPP into the "Program files" folder.

Get the downloads and more details on the platform specific XAMPP project page.

After some long months of intensive bug fixing, it's time to pack up the stuff and head off to the MySQL Conference & Expo. Since this is actually my first MySQL (User's) Conference, it's bound to be interesting.

We've got a full schedule here, so it will definitely not be boring.

Monday, April 23, 8:30am - 5:00pm, Ballroom D (with lunch 12:00am to 1:30pm). Lars, JDD and I am going to hold a replication tutorial for a full day where we'll go over some basics on how to set up replication to work properly, but also delve into some advanced stuff like row-based replication and cluster replication to …

I've made a lot of additions and updates to the "MySQL Storage Engine for Amazon AWS S3". Available, as always, via hg.

I haven’t updated my blog in a while, so as a temporary placeholder, I’ve decided to just post a random conversation where I attempt to rewrite Sarah songs into either programming languages or pseudo code. Dorky, at best.

(23:27:29) esofluffy: so if you were to be listening to Sarah McLachlan, which song would you choose?
(23:27:39) arcology88: umm
(23:27:43) arcology88: the silence
(23:27:44) arcology88: haha
(23:27:49) esofluffy: I think I’ll go for “Hold On”
(23:28:09) esofluffy: well, instead i went for “Building a Mystery”
(23:28:19) esofluffy: I want to rewrite the song to be different.
(23:28:31) arcology88: hehe
(23:28:32) arcology88: explain
(23:29:00) esofluffy: well, first of all I’d rename it… to “Parsing a SQL_TREE”
(23:29:28) esofluffy: “cuz you’re working… on Parsing a SQL_TREE”
(23:30:26) arcology88: ahhah
…

I've posted the 0.3 release of the myhttp, Web Services Engine for MySQL. DELETE and UPDATE are now supported, and range queries now function properly. The handling of primary keys has been completely rewritten.

You can find a copy of it here:
http://download.tangent.org/myhttp_engine-0.3.tar.gz

The announcement here:
http://tangent.org/index.pl?node_id=528

I have also released mod_methods, which implements PUT, GET, HEAD, and DELETE for Apache 2.X. This allows the creation of a simple Webdav like environment to manipulate Apache 2.X webservers.

You can find a copy of it here:
http://download.tangent.org/mod_methods-0.2.tar.gz
…

The idea how to speed up nested-loops join a little I've mentioned earlier has now been promoted into a worklog entry. It is now known as WL#3724 "Short-Cutting Join Execution: Speeding up star queries" and its text is publicly available at MySQLForge.

At the moment there is only a short description, but hopefully Martin Hansson (the assigned developer) will add more content there.

After two months of hard work we are proud to announce a new release of XAMPP for Windows and Linux. New in both releases of XAMPP are MySQL (5.0.37), PHP (4.4.6), phpMyAdmin (2.10.0.2), and OpenSSL (0.9.8e). The Windows version also contains up-to-date versions of: FileZilla FTP Server (0.9.23), ADOdb (4.94), and Zend Optimizer (3.2.4).

With XAMPP 1.6.1 we tried to make the Windows version ready for Vista. The beta tests were very successful and most people reported a very smooth XAMPP under Vista but there were also people still having problems. Please get in touch with me if you also encounter problems on Vista. Currently please avoid installing XAMPP into the "Program files" folder.

Get the downloads and more details on the platform specific XAMPP project page.

It works!

mysql>
 SELECT s3id from pierce;
 +------------------------+
 | s3id                   |
 +------------------------+
 | ABASEMENT              |
 ...
 | ZIGZAG                 |
 | ZOOLOGY                |
 +------------------------+
 992 rows in set (25 min 51.73 sec)
 mysql> _

Ok, so it needs to be made a bit faster, but I have some ideas for that...

One of the keynote panels from the Web 2.0 Expo featured three entrepreneurs of companies that are heavy users of MySQL: Joe Kraus (JotSpot), Mena Trott (SixApart) and Jay Adelson (Digg).  It was one of the more interesting discussions dealing with companies at different stages of considering their independence.

• CNet: Video - To Flip or Not to Flip (excerpt)
• Red Herring: Buzz & Money
• AppScout: Web 2.0 Expo Live Blog - Panel with Batelle, Adelson, Trott, Kraus
…