Looks like the InnoDB plugin is completely broken with MySQL-5.1.24; at least there is no luck for me so far to set it up right. First, the Makefile is broken. Second, I tried to do a static build of InnoDB plugin with MySQL server (–enable-innodb and –with-plugin-innobase) resulted in partial InnoDB plugins (Information schema) missing the main one as shown below:

   1:  mysql> show plugins;

2:  +---------------------+--------+--------------------+---------+---------+

3:  | Name                | Status | Type               | Library | License |

4:  +---------------------+--------+--------------------+---------+---------+

5:  | …

I do not know if anyone noticed this; but there was an incompatible change from MySQL 5.1.22 to 5.1.23 in mysql_com.h file for NET structure by renaming the members last_errno and last_error to client_last_errno and client_last_error. This is really annoying as it not just breaks the compilation of lot of depending applications; and functionality will be annoy if one uses the wrong client library as there is no protocol version change. The change should have been done in …

Here is the quick notes from the session scaling heavy concurrent writes in real time by Dathan Pattishall. Its bad that he left Flickr i.e. Yahoo. Hopefully they will find a replacement, if not contact me I have few people who are interested.

• Who am I
  • since 1999 working on mysql
  • scaled many companies (FriendFinder, Friendster, Flickr, now RockYou)
  • Favorites federation, partitioning, shards, RAID-10
• Requirements
  • scale better
  • store data forever
  • associate time with the data
  • allow for …

Here is the quick notes from the session Helping InnoDB scale on servers with many cores by Mark Callaghan from Google (mcallaghan at google dot com).

• we have a team now, to help scale MySQL to do the enhancements (9 people,  I hope yahoo management reads this)
• Overview
  • describe the problems on big servers
  • work done by InnoDB community
  • ask MySQL/InnoDB to fix the problems by taking the patches
• Community team
  • InnoDB/Oracle
  • Google MySQL team
  • InnoDB community
  • Percona - Peter and Vadim
…

The Future of MySQL by Monty Widenius and Jay Pipes.

• Why this talk
  • MySQL and Sun should become more transparent
  • Easier to discuss and act when you have facts
  • when user know the limitations, they know how to go around
• Threads
  • one connection/thread doesn’t work well
  • no priority threads
  • no way to ensure we have X threads
• Symptoms
  • Too many context switches
  • we are not using multi-core efficiently
  • does not scale that well after 4-8 cores
• Solution
  • –thread-handling=pool-of-threads (6.0) …

Here are the slides and links I am using for the “Database Security Using White-Hat Google Hacking” at the 2008 MySQL Users Conference and Expo.

pdf slides

Where to Start:
http://johnny.ihackstuff.com/ghdb.php

i-hacked.com/content/view/23/42

for the impatient

Google’s Terms of Service
Google Operators

More Googlehacks to run:
Page 35 of …

From Jeff Rothschild, VP of technology, Facebook

1. The power of connectedness
2. Impact on the database
3. Our challenge 

• The power of connectedness
  • photo tagging
  • getting an email that someone tagged a photo in Facebook
  • inter tagging between friends and it continues as a network
  • outstanding growth because of the photo tagging
  • 26B photos in archive now
  • Most trafficked photos applications than anybody else
  • events, invites impact on social graph
  • Opening up the social graph to outside and create a platform and API, so other developers can make use of it (28K applications so far)
  …

Since the recovery from my recent outage, I’ve noticed that none of the normal feed sites where my posts normally show up caught the last post, so this is a test post to see what’s going on, if it was a temporary glitch, or what.

If you didn’t see the post linked above, please read it if you’re happy with your web host. I’m looking for a new one :-/

Here is the list of MySQL benchmarking tools that were discussed during the "Benchmarking tools" session today.

• mysqlslap (5.1 onwards)
• sql-bench
• supersmack
• ApacheBench
• MySQL benchmark() function
• mybench
• …

Here is the quick notes from the session “Architecture of Maria” from Monty Widenius, one of my all time favorite developer and founder of MySQL.

• Goals
  • To create ACID complaint and Multi-version concurrency control (MVCC)  transactional storage engine for MySQL
  • To replace existing replacement for MyISAM and if possible the default transactional database
  • Maria can run in both transactional and non-transactional, so its easy to replace existing transactional and non-transactional engines
  • To create a storage engine which is good for data warehousing (DW) purposes
• Why Falcon and Maria
  • two different architectures
  • different in feature, compatibility, performance
  • Target is for data warehousing …