There has been no shortage of lively discussion on open source software licenses with recent shifts in the top licenses, perspectives on the licenses or lack of them for networked, SaaS and cloud-based software, increased prominence of a Microsoft open source license and concern over the openness (or closedness, depending on your perspedtive) of the latest devices. Amid all of it, we’re pleased to present our latest long-form report, CAOS 12 - The Myth of Open Source …
[Read more]There has been a significant increase in interest in the Memcached, the open source distributed memory object-caching system, in recent months, as a number of vendors look to exploit its popularity in Web 2.0 and social networking environments.
Like Hadoop, which has become the focus of a number of commercial plays, it would appear that the time is right for commercialization of Memcached. But what is it, here did it come from, and what are the chances for vendors to rake in serious cash? Here are the details.
What is it?
Pronounced mem-cash-dee, Memcached was originally created by
Danga Interactive (the developer of LiveJournal,
which was acquired by Six Apart in 2005) to speed up the
performance of dynamic Web applications by alleviating database
load. Memcached has become an industry standard for improving the
performance of dynamic websites.
The code is available from the …
[Read more]
I was curious about Google Fusion Tables, and gave it a try.
I uploaded the employees table from the employees test
database, 16 MB of data, about 300,000 rows. Since the
maximum limit per table is 100 MB, I expected interesting
results.
However, one of my first tests, with aggregation was quite
disappointing.
A simple group by gender was executed in about 30
seconds.
InnoDB on my laptop did a much better job:
select gender , count(*) from employees group by gender;
+--------+----------+
| gender | count(*) |
+--------+----------+
| M | 179973 |
| F | 120051 | …
[Read more]
Dear Kettle friends,
Will Gorman and Mike D’Amour, Senior Developers at Pentaho, are presenting Pentaho’s Google integration work at the Google I/O Developer Conference. (at the Sandbox area to be specific) Yesterday, Pentaho announced that much.
Here are a few of the integration points:
- Google maps dashboard (available in the Pentaho BI server you can download)
- A new Google Docs step was created for Pentaho Data Integration Enterprise Edition
- Running (AVI, 30MB) the …
It's interesting that just as Apple announced surprisingly positive quarterly results, Microsoft announced their first decline in sales revenues in 23 years. While Microsoft is not in any kind
At today's keynote by Mark Callaghan one of the new options he
talked about are table change logs. He mentioned they might be of
use to external applications, like Flexviews, which he mentioned
but not directly. He asked if the guy who wrote it was in the
audience, so I got to wave my hand and yell 'Flexviews!'.
I caught up with Mark at the Facebook party this evening. I had a
chance to talk to him not only about the change logs, but also
about Kickfire and the SQL chip. He asked me what I thought about
working at Kickfire and I smiled and said I love it. I think I
said "I've never been able to join a billion row table to a
hundred million row table, sort, group and get results back in
less than a minute" and I'm sure the smile never left my
face.
As far as the table change logs, he verified:
-
- The global transaction id will be stored in the table
- OLD and NEW …
There is much excitement today at the launch of MySQL 5.4, so I will relate my story about a project I contributed to this new version.
When we started looking at performance improvements for MySQL, we were interested in "low hanging fruit", or fixes and changes that could reap measurable benefits for users in the short term.
An obvious candidate at that time was the now well-known Google SMP patch. I had seen Mark Callaghan present on this at the MySQL User Conference in 2008, and was interested to investigate.
I was pretty new to InnoDB at that time, and was soon to discover that InnoDB was possibly experiencing poor scalability around its mutexes and read-write locks because InnoDB had a private implementation of adaptive mutexes and …
[Read more]
The release of the MySQL 5.4 contains patches which
increases the scalability of the MySQL Server. I am planning to
blog
about those changes in some detail over the next few days. This
blog
will give an introduction and show what the overall results we
have
achieved are.
The changes we have done in MySQL 5.4 to improve scalability
and
the ability to monitor the MySQL Server are:
1) Google SMP patch
2) Google IO patches
3) Update of many antiquated defaults in the MySQL Server
4) New InnoDB Thread Concurrency algorithm
5) Improved Spinloop in InnoDB mutexes and RW-locks
6) A couple of performance fixes backported from 6.0
7) Operating system specific optimisations
8) Ported the Google SMP patch to Solaris x86 and SPARC and
work
underway for Windows and Intel compiler as well
9) Introducing DTrace probes in the MySQL Server …
The work started when MySQL was acquired by Sun has now started
to bear
fruit. Very soon after the acquisition a Sun team was formed to
assist
the MySQL performance team on improving the scalability of the
MySQL
server. At the same time also Google have been very active in
improving
scalability of InnoDB. MySQL 5.4 scalability improvements is very
much
the result of the efforts from the MySQL Performance team, the
Sun
performance team and the Google efforts.
It's extremely fruitful to work with such a competent set of
people. The
Sun team has experience from scaling Oracle, DB2, Informix and so
forth
and knows extremely well how the interaction of software and
hardware
affects performance. The Google patches have shown themselves to
be of
excellent quality. From our internal testing we found two bugs in
the
early testing and both those had already been …
There is much excitement today at the launch of MySQL 5.4, so I will relate my story about a project I contributed to this new version.
When we started looking at performance improvements for MySQL, we were interested in "low hanging fruit", or fixes and changes that could reap measurable benefits for users in the short term.
An obvious candidate at that time was the now well-known Google SMP patch. I had seen Mark Callaghan present on this at the MySQL User Conference in 2008, and was interested to investigate.
I was pretty new to InnoDB at that time, and was soon to discover that InnoDB was possibly experiencing poor scalability around its mutexes and read-write locks because InnoDB had a private implementation of adaptive mutexes and …
[Read more]