Twice recently I have had to import data from a flat file into a database — both sets of data were being imported to make better use of the data in the files. Importing a file is not that difficult using mysqlimport, particularly since in both cases the data was tab-delimited. I also could have used LOAD DATA INFILE.

The problem with mysqlimport and LOAD DATA INFILE is that you need to create the table beforehand. Often, though, I may not know the exact data types. Folks have written about PROCEDURE ANALYSE(), but they use it in the context of “you can check to see that your tables have the correct data types.”

The final release of python 2.5 is out! The list of what’s new is pretty impressive, but I’m especially happy to have the new “with” statement. Ruby has block methods, or closures, which can be used for doing very clean setup/cleanup. While full-blown Anonymous block statements were rejected from Python, the new “with” statement handles the part I care about: making it easier to write code that works correctly in the case of failures.

The 3 typical use cases are a file that needs to be closed, a lock that needs to be released, and and a database transaction that needs to be either committed or rolled back. The database case is the …

“MySQL is at the heart of revolutionary changes in the computer industry” - Tim O’Reilly

Hmmm, worthy of my Quote of the Day Section, but is it necessarily true. I believe MySQL is significant in the advancement of great opportunities in the computer industry particularly the Internet, but is it revolutionary?

The Oxford Dictionary states: revolutionary ? adjective ? involving or causing dramatic change or innovation.

Perhaps so. Any Comments Welcome.

Stolen shamelessly from the MySQL User Conference Web Site Banner.

This is a post from a few months back which somehow got stuck. I’m publishing it now as it still holds true.
I read an article today which mentioned “supernova burnout”, describing it as burnout that occurs when someone has reached the pinnacle of their career (I’m paraphrasing from memory here). The recommended solution? Find a cause that you are passionate about, and find a way to work it into your life.

Want to know what I’m passionate about? Taking care of my family. That will add purpose and meaning to any job. Something I love about working at MySQL is that I can work from home, which means I get to see my family a LOT more than I have in years past. Somehow there is just no substitute for being present.
I’m also passionate about programming, and sharing knowledge with other people. The book Code Reading: The Open Source Perspective highlights just how important it is to have access to the …

After spending a good week at my parents in rainy but relaxing florida, I flew to Toronto to speak at php|works. The conference was great fun and especially my second talk Explaing Explain went as good as I had hoped. In the talk I was mostly talking about controlling execution plans with particular focus on MySQL and PostgreSQL. I spend longer than ever on this talk so I am happy it worked out so well. I will probably submit the same talk for OSDBcon with some minor tweaks. Since I only had 60 minutes several slides are marked "skip". Maybe OSDBcon can give me two slots so that I can cover those slides as well. The other talk building portable database applications …

The PyBots project (http://pybots.org/) is a way for people to run tests for python applications using Python binaries built from the very latest source code from the Python subversion repository. The idea is brilliant, and has application far beyond the Python project.
As Grig Gheorghiu previously announced on his blog, I’ve set up a buildslave testing MySQLdb, the python connector for MySQL. I’ll probably try to set up tests for SQLAlchemy next. You can see the builder status page here, my builder is named ‘amd64 Ubuntu Dapper trunk’.
Instructions for how to set up a buildslave are on pybots.org, and you can see the buildscripts along …

Following my User Group Presentation I was asked by fellow MySQLer Kim about Logical Data Modelling (LDM), in relation to Physical Data Modelling.

Well, first the brain had to work overtime to remember when was the last time I worked on a Logical Data Model. The answer to that is 1996 doing R&D work for Oracle Corporation with their CASE repository tool, Oracle Designer, about version 1.3/1.3.2. I’ve learnt in the past 10 years to purge technical stuff from my brain, leading from the capacity in be able to remember in detail data models, data migration and data cleansing issues of projects even after leaving them 3 years eariler.

As Kim pointed out, he thinks physically, actually directly at the SQL level, then working backwards to produce an appropiate physical model. To think logically is to consider the entities and attributes and relations before considering the …

Well, now I have your attention, Slow Queries are bad (unless it’s a single user system and you don’t care). However there are worse things then slow queries in a large enterprise system.

I’ve been asked in recent weeks a number of questions which has brought this topic to discussion, as well as a current implementation I’m undertaking for a client of a purchased product.

High volume repetitive queries can have a worse effect on your system’s performance. Combined with slow queries that take locks, these queries can have an extreme effect on performance and if you don’t know your application, or have the right tools, it can be initially hard to diagonise easily.

This problem is the classic Wasting CPU cycles problem, seen it before, will see it again.

Here’s a classic example for reference. Using the current product that I’m customising and installing (I’ve not be involved …

I’ve worked for two Internet startup companies, both around 2 years each, both now long dead. The first was due to eventual lack of new VC funds, the second gross financial managment in the second year (apparently, when we were told there was no money December one year to pay us, the company that made large profits every month for over the first year, then had made losses every month for the past 12 months, but nobody knew about it. There were 5 Directors from 3 countries and nobody knew. Yeah Right!)

I’ve learnt a lot of non IT street smarts in this time. The first startup took the VC route, and after 3 rounds while I wasn’t involved in the process you pick up things. The single biggest tip here is the Bell-Mason Diagnostic. Here a few introduction references worthy of a quick review ( …

There were some rumors going around that OSDBcon might get canceled, but I was just speaking to Zak and he confirmed that S&S, the company organizing the event, is committed to making the conference happen. Last I heard there are over 30 proposals with more coming in everyday. But the more the better! This years conference is being held once again in parallel with the International PHP Conference. However I think this is suboptimal. PHP developers for the most part are actively using open source databases already. Especially the MySQL guys have no trouble reaching the PHP guys with conferences dedicated to PHP. So it would be a good idea to to think about how to best get access to other audiences, like the Java and .Net crowd.

I talked to a few people about this via email and IRC. Personally I think it would also be great to …