I spend the last couple days playing with InnoDB page compression on the latest Percona build.

I’m pretty happy so far with Percona and the latest InnoDB changes.

Compression wasn’t living up to my expectations though.

I think the biggest problem is that the compression can only use one core in replication and ALTER TABLE statements.

We have an 80GB database that was running on 96GB boxes filled with RAM.

I wanted to try to run this on much smaller instances (32GB-48GB boxes) by compressing the database.

Unfortunately, after 24 hours of running an ALTER TABLE which would only use one core per table, the SQL replication thread went to 100% and started falling behind fast.

I think what might be happening is that the InnoDB page buffer is full because it can’t write to the disk fast enough which causes the insert thread to force compression of the pages in the foreground.

…

MySQL Connector/Net 6.3.1, a new version of the all-managed .NET driver
for MySQL has been released. This is an alpha release and is intended to
introduce you to the new features and enhancements we are planning. This
release should not be used in a production environment.

It is now available in source and binary form from
[http://dev.mysql.com/downloads/connector/net/6.3.html] and mirror sites
(note that not all mirror sites may be up to date at this point of time
- if you can’t find this version on some mirror, please try again later
or choose another download site.)

The new features or changes in this release are:

• Visual Studio 2010 RC support
• Nested transaction scope support

What we know may be broken
—————————-

…

Novell’s Q1. The future of OpenSolaris. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca

“Tracking the open source news wires, so you don’t have to.”

# Novell reported Linux platform revenue of $37.5m in Q1, up 6.4%.

# Internet.com reported that Novell’s Linux business broke even as Microsoft deal revenues fade.

# As the H reported Oracle exec Dan Roberts confirmed that OpenSolaris has a future at Oracle.

# Citrix acquired Paglo, launched GoToManage service.

# StatusNet …

This Thursday (March 4th, 15:00 UTC - slightly later than usual), Robin Schumacher will present MySQL Column Databases. If you're doing Data Warehouse with your databases this is a must-attend, but it's also interesting to learn what typical other scenarios there are for using column-based storage engines, and how column databases work in the first place.

For MySQL University sessions, point your browser to this page. You need a browser with a working Flash plugin. You may register for a Dimdim account, but you don't have to. (Dimdim is the conferencing system we're using for MySQL University sessions. It provides integrated voice streaming, chat, whiteboard, session recording, …

Have you ever come across a situation called NO MORE SPOOL SPACE?  My friend does and hence I studied a bit about Teradata. The query: SELECT DISTINCT fieldname FROM tablename; The error: “NO MORE SPOOL SPACE”. Correct, the problem wasn’t related to MySQL, that was for something called Teradata. Initially, I could see that query should be […]

GNUnify is one of the major annual FOSS events here in India. Organised by the students of Symbiosis Institute for Computer Science & Research and the Pune Linux Users Group (PLUG), GNUnify is an event of consequence in the Indian FOSS ecosystem. This year, the conefrence took place on Feb 19th and 20th in the wonderful city of Pune. I submitted two papers on MySQL and fortunately both of them were selected. Thanks to the organising team, who were helpful enough to schedule both sessions on the second day on request, since I would not have been able to make it on the first day. But more of that later. Let me recount the experience of …

This Thursday (March 4th, 15:00 UTC - slightly later than usual), Robin Schumacher will present MySQL Column Databases. If you're doing Data Warehouse with your databases this is a must-attend, but it's also interesting to learn what typical other scenarios there are for using column-based storage engines, and how column databases work in the first place.

For MySQL University sessions, point your browser to this page. You need a browser with a working Flash plugin. You may register for a Dimdim account, but you don't have to. (Dimdim is the conferencing system we're using for MySQL University sessions. It provides integrated voice streaming, chat, whiteboard, session recording, …

This Thursday (March 4th, 15:00 UTC - slightly later than usual), Robin Schumacher will present MySQL Column Databases. If you're doing Data Warehouse with your databases this is a must-attend, but it's also interesting to learn what typical other scenarios there are for using column-based storage engines, and how column databases work in the first place.

For MySQL University sessions, point your browser to this page. You need a browser with a working Flash plugin. You may register for a Dimdim account, but you don't have to. (Dimdim is the conferencing system we're using for MySQL University sessions. It provides integrated voice streaming, chat, whiteboard, session recording, …

I'm pleased to announce the release of Spider storage engine version 2.14(beta).
Spider is a Storage Engine for database sharding.
http://spiderformysql.com/

The main changes in this version are following.
- Add table parameter "bulk_update_mode" and "bulk_update_size".
- Add server parameter "spider_bulk_update_mode" and "spider_bulk_update_size".
This parameters are for performance improvement.
Please examine to use "spider_direct_dup_insert", if "REPLACE" and "INSERT IGNORE" are slow.
Please examine to use "spider_bulk_update_mode", if "UPDATE" and "DELETE" are slow.

Please see "99_change_logs.txt" in the download documents for checking other changes.

Enjoy!

InnoDB plugin offers an adaptative compression that is very interesting for performance.
This compression works at a table level. Like most optimization techniques it is not black or white.
You have to decide depending on IO patterns / CPU usage / Memory usage / disks constraints what tables are good candidates for compression.
I was trying to define a methodology to help decide which tables to compress to reach performance gains.
I thought I could use MySQL "show status" command or information_schema tables. Unfortunately MySQL does not offer any per tables IO statistics.
[...]