I just pushed out version 0.03 of the awss3 storage engine.

There should be no user visible changes, it's all under the hood stuff.

Available via hg and tarball.

Rod Johnson, author of the Spring framework, thinks open source is hot right now, but its a “bubble” ready to burst, according to an article titled What Makes An Open Source Project Successful? by Charles Babcock.

Most open source projects are supported by an army of volunteers who buy into the hype, but “capitalism will inevitably reassert itself” and developers will find they need to put more effort into steady jobs and private lives, leaving “open source zombies”–unsupported, unmaintained projects–he predicts.

This is true, with many a project, that hasn’t built a successful ecosystem. Keep in mind that with the gazillion text editors out there, not all stand the test of time, like Emacs and vim do. Capitalism is always going to win hands down, because money in its essence is important to survival. Go …

We’ve been doing some tests with medium sized data sets lately.  We extracted around half a year of data (514M rows) from a warehouse where we’re doing a database partitioning and clustering test.
Below is an example where we copy +500M rows from one database to another one that is partitioned. (MS SQL Server to MySQL 5.1).  This is done using the following transformation.  In stead of just using one partitioned writer, we used 3 to speed up the process. (lowers latency).

Copying 500M rows is just as easy as copying a thousand, it just takes a little longer…

It would have completed the task a lot faster if we wouldn’t have been copying to a single table on DB4 at the same time. (yep, again 500M rows) This slowed down the transformation to the maximum speed of DB4.  That being said, if you still had any doubt about Pentaho Data Integration being able to copy large volumes of data, …

The presentation How to Be a Consultant has been posted to the Midlands PASS Chapter website. The presentation was given by Midlands PASS Vice President and Treasurer, Ben DeBow, of CounterLogic.com. There's a lot of great information on succeeding as an independent consultant from one who has been doing just that for a while now. It is not specific to any technology but rather focuses on the business side of being a consultant.


Technorati Tags: SQL Server | Microsoft SQL Server | …

Dirk Riehle has posted a paper on the The Economic Motivation of Open Source Software: Stakeholder Perspectives.

Let us take this article apart.


..should use open source software to grow their user communities and build an ecosystem around their products and services..


A good product is a good product. If we look at this from the stand point of the web has Livejournal been any more successful then Google because it open sourced its framework? I don't think so. Both exist because they delivered value. I've never been sure about why Brad open sourced LJ in the beginning but I don't believe it was because he thought the masses would contribute in mass to its evolution (and I speak as someone who has sent in patches and have had them accepted in the code). Open source had little to do …

What a perfect day. I'm in London today, and went to the Arsenal vs. Bolton match with Mark Shuttleworth, founder of Ubuntu. Mark isn't a big football fan, but he indulged my Arsenal fixation and even treated me like a rational human being, which I decidedly am not when it comes to football. Arsenal won 2-1. All is right in the universe.

But where the day got really interesting was over dinner at Tamarind, one of my favorite restaurants anywhere. I've long respected Mark, but over dinner I found him engaging both as a person and as a technology visionary. Here is a very real, good person who has happened to be phenomenally successful as an entrepreneur, without letting it turn him into an obnoxious Muppet.

Some of the insights I gleaned throughout the course of our dinner:

• Mark has the potential to fundamentally change the …

I would not normally blog this, but I thought it was interesting to see this appear in the MySQL forums:


We're looking for a consultant to help us write a custom storage engine that distributes data amongst many machines but abstracts this from clients who still issue regular MySQL queries.

You can look at it as a stripped down version of MySQL Cluster or a beefed up version of the FEDERATED storage engine.

Candidates must have strong knowledge of clustering and MySQL internals.



http://forums.mysql.com/read.php?8,147823

When I was in Japan last week I got to meet another one of the Storage Engine vendors. Who had joined their company to do this work?

One of my X interns.

There is a good and growing eco-system forming around this work. On Friday of …

InformationWeek's Charlie Babcock has stumbled on a great truth--the only way to build a business is to have customers. This is something that Matt and I have stressed a number of times. Revenue solves all problems :>

Says Rod Johnson of Spring/Interface21:

Instead, open source products "should be funded by their customers," the only way to ensure they that have a future, Johnson says. It's no accident that the best known enterprise open source programs, such as the MySQL database and the JBoss application server, have companies with paying customers behind them.

Link: What Makes An Open Source Project Successful?

…

I was asked in comments "nice, but its only read only right?".

Not true at all!

For example, lets create this table:


mysql> CREATE TABLE `website` (
-> `filename` varchar(125) NOT NULL DEFAULT '',
-> `contents` text,
-> PRIMARY KEY (`filename`)
-> ) ENGINE=HTTP DEFAULT CHARSET=latin1 CONNECTION="http://localhost/"
-> ;
Query OK, 0 rows affected (0.00 sec)


Now, lets insert a page:


mysql> insert into website VALUES ("index.txt", "This is a document on a website");
Query OK, 1 row affected (30.01 sec)


Read the page from curl:

[brian@zim ~]$ curl http://127.0.0.1/index.txt
This is a document on a website



…

From IM:
"So can anything be done with XML?"

Create a table:

CREATE TABLE `krow` (
`a` varchar(125) NOT NULL DEFAULT '',
`b` text,
PRIMARY KEY (`a`)
) ENGINE=HTTP DEFAULT CHARSET=latin1 CONNECTION='http://krow.livejournal.com/data/'

Now... can I extract anything?

mysql> select EXTRACTVALUE(b, '/rss/channel/title') from krow WHERE a="rss";
+--------------------------------------------------+
| EXTRACTVALUE(b, '/rss/channel/title') |
+--------------------------------------------------+
| Brian "Krow" Aker's Idle Thoughts |
+--------------------------------------------------+
1 row in set (1.29 sec)

Basically I use the new XML methods in 5.1 to extract out realtime data from 5.1.

I publicly committed mod_methods:
…