It is possible to trap all the query sent to MySQL, using tcpdump.

This will be done capturing the network traffic. Since this uses the libpcap library, we need to have root privileges.

Because tcpdump will not capture queries sent to socket file, be sure that the request you want to track will not use it.

So having clarified this obvious limitation, let us assume that all the application running locally are accessing MySQL using 127.0.0.1 on standard port 3306.

Capturing the queries to a file named all_query_tcpdump.log executing:

tcpdump -i lo port 3306 -s 2000 -w all_query_tcpdump.log

Please note that we will capture 2000 (-s 2000) headers bytes, which should be fine in the most cases.

Having done the data collection, we have now to analyze it.
For that we will use  …

Novell has announced Service Pack 1 for SUSE Linux Enterprise. LINBIT is a key contributor to this release, delivering DRBD and a number or cluster resource agents as part of Novell’s SLE High Availability Extension add-on.

This puts Novell firmly ahead of competitor Red Hat in terms of currently released and supported HA clustering solutions.  In case you haven’t noticed, Red Hat is also being questioned by customers for not shipping DRBD at this time, …

OSSCube is seeking candidates who are passionate about Open Source development to join our team of PHP Geeks.  We follow agile and standards based development methodologies and have an informal, friendly environment.  If you are a highly skilled PHPdeveloper and are looking for challenging work, OSSCube is the right company for you. Please send us your resume.

OSSCube is India’s leading Open Source software development company with expertise in outsourced product development. We are dedicated to providing solutions to businesses by leveraging the power of open source software, solutions and technologies. We have partnered with leading technology development companies such as  …

OSSCube is seeking candidates who are passionate about Open Source development to join our team of PHP Geeks.  We follow agile and standards based development methodologies and have an informal, friendly environment.  If you are a highly skilled PHPdeveloper and are looking for challenging work, OSSCube is the right company for you. Please send us your resume.

OSSCube is India’s leading Open Source software development company with expertise in outsourced product development. We are dedicated to providing solutions to businesses by leveraging the power of open source software, solutions and technologies. We have partnered with leading technology development companies such as  …

Sonali Minocha of OSSCube has added another feather in her cap by clearing PMP exam.  Project Management Professional (PMP) is a credential offered by the Project Management Institute (PMI).  By clearing PMP, Sonali has demonstrated her strong hold on key project management process such as 

1. Initiating
2. Planning
3. Executing
4. Monitoring and Controlling
5. Closing

This internationally accepted certificate will take our project success rate to the next level by employing  by applying a standardized and evolving set of project management principles as contained in PMI's PMBOK Guide.

Congrats Sonali!

I've been talking and writing a bit lately about the scaling problems I'm seeing on fast servers running lots of queries. As a rough guide, I'm seeing this in servers running 20k queries per second and higher, lots of memory, lots of CPU cores, and most queries are running faster than one millisecond; some in the 50 to 100 microsecond range.

At such speeds, how would you know if your server froze for half a second? This is not a hypothetical question. If your server freezes routinely for half a second, then it's occasionally going to freeze for much longer than that. Knowing whether it's freezing routinely for short bursts is important to know. Add just a bit more data, or add a bit more load, and suddenly things can drop off a cliff.

I had a customer a while back whose server suddenly took a 50x performance hit, overnight. He didn't know of anything that had changed. Reducing the load by half through the load balancer did not …

Previously I covered simple case with FlashCache, when data fits into cache partitions, now I am trying to test when data is bigger than cache.

But before test setup let me address some concern (which I also had). Intel X25-M has a write cache which is not battery backuped, so there is suspect you may have data loss in the case of power outage.
And in the case with FlashCache it would mean you can send your database to trash, as there is no way to recovery from that ( only restore from backup).
I personally did couple of power failure tests and there is article on this topic http://www.anandtech.com/show/2614/10. I did not see any data loss in my tests, and the article says that the write cache "..isn't used for user data because of the risk of data …

OpenSQL Camp Boston 2010 will be held at the Stata Center in Cambridge, Massachusetts, October 15-17, 2010.

The Stata Center was designed by Frank Gehry and was completed in 2005. The Stata Center houses CSAIL (The MIT Computer Science and Artifical Intelligence Laboratory) and LIDS (The MIT Laboratory for Information and Decision Systems). Some of my favorite pictures of the Stata Center were taken during construction. (I’m a member of CSAIL)

The OpenSQL Camp will be held on the first floor …

Daniel changed mk-query-digest to use much less memory. It parsed and aggregated a 2GB MySQL slow query log file in a few dozen megabytes of memory for me yesterday. Thanks to Facebook for sponsoring this work.

Alfresco launches Activiti project. Funding for NorthScale and Zend. And more.

Follow 451 CAOS Links live @caostheory on Twitter and Identi.ca
“Tracking the open source news wires, so you don’t have to.”

# Alfresco launched the Apache-licensed Activiti BPM project, led by Tom Baeyens and Joram Barrez.

# NorthScale announced $10m in series B funding, led by the Mayfield Fund, and a new CEO.

# Zend Technologies raised $9m led by Greylock Partners with participation its existing investors.

# Stephen Walli joined the CodePlex Foundation as its technical director. …