I just pushed out a significant release of the Amazon AWS S3 MySQL storage engine. There are significant stability, performance, debugging, and feature improvements.

Available via

http://hg.fallenpegasus.com/
http://fallenpegasus.com/code

Unless there are any showstoppers, this is the one that is going to the MySQL Expo next week, to be presented on Wednesday.

http://www.mysqlconf.com/cs/mysqluc2007/view/e_sess/10822

It allows one to view and manipulate Amazon's S3 storage service as tables and items by MySQL. You can keep your blobs or large varchars or truely huge datasets in S3, and then join the tables against your local ones.

If you're a …

Here is the perl script referred to by mysql-memory-usage-profile.

Downloadable: mysql_memory_profile.pl

#!/usr/bin/perl
# Version: 1 Last Change by: procter.pythian. 20070419 14:14:39
# Copyright 2007, The Pythian Group, Inc. All rights reserved.
# Hey, we work hard on this stuff!

# Feel free to use this script, un-modified, as much as you like 
#on any system. If you find issues or have comments, we would 
#welcome the opportunity to collaborate with you on it. But we 
#haven't yet decided on any formal licensing (GPL etc.) and 
#public interest will be a factor on whether we go that route.

# MySQL Memory Profiling Script

# Reference: http://www.pythian.com/blogs/431/mysql-memory-usage-profile

#MD5 Checksum 5D713DCA3702EBC91D3B1AA997E68F07 …

PBXT is a transactional storage engine, but what does the design have in common with MyISAM?

I'll be answering this and other questions during my session at the MySQL Users Conference next week:


PrimeBase XT: Design and Implementation of a Transactional Storage Engine
Date: Wednesday, April 25
Time: 10:45am - 11:45am
Location: Ballroom F


So be sure to check it out! :)

At next week’s MySQL User’s Conference, we’ll be having a number of in-depth sessions on the new MySQL transactional storage engine named Falcon. Jim Starkey, the creator of Falcon, will be leading a session on Falcon internals, another session on Falcon Concurrency Control, and a Falcon BOF.

One new delivery from the Falcon team are new performance diagnostic objects that help DBAs and developers better troubleshoot and tune a Falcon database. One of the requests I get constantly in the field is to provide more performance stats that help MySQL less of a “black box”. The Falcon team has done a nice job in answering this call and has recently provided a number of new diagnostic views into what the Falcon engine is doing. Although still in alpha and likely …

If you’re coming to the MySQL User’s Conference next week, be sure to attend the sessions on backup and recovery, especially the session on the MySQL backup roadmap and the Online Backup BOF that will be hosted by the members of the MySQL Backup team.

I got a chance this week to kick the tires of our new online backup that the team has been working on, and I’m excited about the things I see. For a quick test, I did a backup of a 9 million row archive table in one session while I fired off several inserts into that same table in another session:

*** first session - running backup ***

        
mysql> select count(*) from t1;
+----------+
| count(*) |
+----------+
|  8964018 |
+----------+
mysql> backup database bkp to 'bkp.txt'; …

Using the CodeGen_MySQL_Plugin i have now been able to create my first working fulltext plugin: gzip_fulltext

gzip_fulltext will uncompress data that was compressed with MySQLs COMPRESS() function on the fly before passing it on to the default fulltext parser. Data that is not gzip compressed will be passed on 'as is'.

Update: there were some minor compile problems with yesterdays release, these have been corrected and th download link below fixed

Continue reading "My first MySQL fulltext parser plugin"

I attended the Web 2.0 Expo held in San Francisco between April 15-18. Here are some thoughts on some of the things that caught my attention.

 Rich Internet Applications

There was a lot of talk about RIAs, many products ranging from full-blown development environments to languages, language environments etc. Some examples include Apollo (new announcement from Adobe), Django, curl (no - this is not the OSS libcurl), Silverlight (Microsoft's response to Adobe !)
So it seems that the applications are once again moving onto the desktop - after moving from fat client to the web, we have now realized that the web environment really is not rich enough for many applications. …

Heard today in a MySQL course

What are the differences between shared memory and NT pipes on Windows?

Slow and slower

It seems quite silly written here, but it’s been a funny moment.

It's going to be good, just look at the schedule! If you're not signed up yet, why? Just ask yourself that. And if you don't have a very good reason, just register and go meet lots of other MySQL users as well as many of my colleagues. It's educational (which means you can make your boss pay for it), it's fun, and yes it can even be a tad geeky if you want.

I won't be there myself this year (oh hail the absence of jetlag), but don't let that deter you in any way. Jay Pipes has been doing a great job organising this year's program.

For instance... it's fantastic that Eben Mogen is doing a keynote. Last year someone from EFF already did a talk on "what not to put in your database schema, and why" which was admittedly an obscure title, but it covered the content nicely. It's important stuff. Eben will explain all. You want to be there.
…

Inside of MySQL we do a "MySQL University" which is basically a "someone shows up and talks on a topic".

Tomorrow at 8AM PST I am going to do one on the general plugin architecture. I am told that these will eventually be put up as podcasts (and if I get a chance I will just record mine tomorrow on my own).

The slides for the talk can be found here:

http://krow.net/talks/plugins.pdf

It is a punch of pointers into the code that I will be explaining. Have fun with the slides :)