This post is a follow-up to my talk at JavaDeus 2008 where I showed how you can make use of Lucene inside of MySQL using an experimental branch and some triggers and stored procedures.

Since the process is not entirely obvious and the branch is very experimental, I thought it would be a nice thing to put it online. It’s pretty amazing with how little code (in Java and otherwise) you can implement a working full-text search engine that simply doesn’t get into your way :)

Note: Be advised that the MySQL server we will build is likely to crash at times. Do not use it in production! And of course, always have a safe backup of important data.

This first part will cover the basics on how the get the necessary foundation in place, configuring the server and …

Alright! Thanks to my mentor Brian I now have a semi-clean build procedure in place.
I just type 'make' and it compiles both libmemcached and mysql together nicely.

The previous setup was rather hackish and involved some bash scripts I'm not proud of, but it worked. I suppose since Google sent me a book on how to write Beautiful Code, I should really be writing code accordingly.

Just two weeks until 'midterm review' ... *panics*
I feel like I am making good progress despite my lack of time.
I'd really like to have something functional in the next two weeks, bugs are inevitable.
My mentor said that it was important to find my "Hello World!" as he put it when working on this project. I'm not sure how to define that though, it compiles, it runs, it connects to memcached, but is that Hello World worthy enough or am I worrying too much?

I'm going to stick to my goal of trying to …

When you are using pyramid replication scheme – it could be useful to have n+1 intermediate servers. The idea is to have extra bandwidth in case one of those intermediate slaves fails. For example, if you have 3 intermediate slaves named A,B and C and you have 18 end slaves named 1-18: The idea would […]

One of the projects I am working on right now needs a manual, not just man pages, but an actual manual.

My goals:

Online All documentation should be online and editable online. Anyone should be able to edit it. Anyone should be able to extend it. We live in a Wiki world, and the day and age of collaborating via controlled copies is over. (And yes, this is something I very much dislike about the MySQL Manual)

Hosted Find a hosted solution that I do not have to maintain. Maintaining software takes valuable time from me. I only keep hosting mailing lists but Google Apps lacks this feature. For a Wiki? Someone else can do it. The solution needs to be non-onerous though.

Exportable. Sometimes you want a book in your hands, and for this reason I think books in the "it is a dead tree Jim" are good things. Skip a few years into the future and it is probably going to be an …

Below are a few more pictures from the Red Hat Summit and FUDCon last week.

Just to keep you comin' back for more, below is the list of podcasts from the events that I will be posting in upcoming days:

Podcasts to come/Posted

• Jim Whitehurst -- President and CEO of Red Hat -- …

Percona is looking to hire someone to develop Maatkit, among other things.

If I weren’t having so much fun being the consulting team lead, I’d be doing it myself. (In fact, I’m still hacking on it a lot. Got some pretty fun stuff done this weekend.) I don’t know what the rest of the world thinks, but I think Maatkit is a damn enjoyable project to work on. Hopefully someone else will have the same kind of mindset and want to get paid for it, unlike poor working-on-the-weekends me.

I’m not stepping away from the project. It’s just grown a lot, and there is room and money to grow it much more. This is actually the best compliment to the project: that it is worth hiring someone to keep improving it. Lots of people are using it, and there’s a lot …

Looks like the newest release of Firefox 3 is setting new records for downloads. Clearly there was a lot of pent-up demand for a revision. In their first day as a GA release, Firefox had more than , breaking all records. The downloads have continued at a rapid clip, with over 14 million within 72 hours. That's a pretty impressive feat for a product with essentially zero marketing budget. Firefox 3 adds a raft of new features, including beefed up security, more efficient use of memory as well as many minor usability tweaks. InfoWorld's test center put it through its... READ MORE

If you're a Perl and/or Python expert (preferably both), Percona may have a job for you.

We're looking to either hire or sponsor significant development efforts for some open-source tools for MySQL, including but not limited to Maatkit and the Master-Master Replication Manager. This could be full-time or part-time, depending on the person and what seems to make the most sense. You can work remotely.

You must already be an expert coder. You don't have to be a MySQL expert, though it will help if you are at least at an intermediate level with it. You must have proven experience in test-driven development. You will be writing clean, efficient, well-tested code. Your work will be open-source and transparent to the world, and open-source experience is a plus. You can expect expert guidance and help …

One basic way of debugging the MySQL Cluster data nodes(ndbd) is with good old printf-style debugging. Ie. adding printouts of the variable you want to see, recompile, start the node(s) and run your tests. This is a bit tedious but very universal.

Support for printing is available using "ndbout", which has both C++ style and printf style. This functionality is implemented in storage/ndb/include/util/NdbOut.hpp

Here is an example from debugging BUG#37592, where I wanted to add printouts to "Dbtup::rebuild_page_free_list" to see how the pageId increases while the rebuild is running:

void
Dbtup::rebuild_page_free_list(Signal* signal)
{
  Ptr fragOpPtr;
  fragOpPtr.i = signal->theData[1];
  Uint32 pageId = signal->theData[2];
  Uint32 tail = signal->theData[3];
  ptrCheckGuard(fragOpPtr, …

Kaj's blog: http://blogs.mysql.com/kaj/2008/06/18/netbeans-as-ide-for-developing-mysql-itself/