As promised, here are more results running memcached on Sun's X2270 (Nehalem-based server). In my previous post, I mentioned that we got 350K ops/sec running a single instance of memcached at which point the throughput was hampered by the scalability issues of memcached. So we ran two instances of memcached on the same server, each using 15GB of memory and tested both 1.2.5 and 1.3.2 versions. Here are the results :

The maximum throughput was 470K ops/sec using 4 threads in memcached 1.3.2. Performance of 1.2.5 was just very slightly lower. At this throughput, the network capacity of the single 10gbe card was reached as the benchmark does a lot of small packet transfers. See my earlier post for a description of the server configuration and the benchmark. At the …

Cacti is a great tool for collecting information about systems and graphing it. However, it likes to use SNMP, and SNMP is often not desirable. Instead, I often see the need for a method that is:

• Secure. Use trusted, well-known, encrypted communication. Do not open up new ports.
• Zero install on the monitored system.
• As little installation or modification on the monitoring system as possible.

Over the last several years, I’ve slowly created more and more software to create Cacti graphs via standard POSIX command-line utilities over SSH with key-pair authentication. (I’ve also created similar software for Nagios, but that’s another matter.) The major problem with the work I’ve done is that it’s totally un-publicized.

The system works by passing command-line arguments to a local PHP script like any other Cacti script. This …

Earlier today I did the presentation Memcached Meet Flash, the pluggable engine interface, and if you missed it you can download the slides. It is kind of fun to think back on the hackathon at the users conference the last year when Toru shared his ideas about a storage interface, followed by the interesting discussion I had with Matt during the OpenSolaris summit down in Santa Clara. I didn't know back then that I would present this at the users conference this year :-)

My brother came down for my presentation and took the following picture with his iPhone during the session:

If you have any questions regarding the slides, come look me …

Memcached is the de-facto distributed caching server used to scale many web2.0 sites today. With the requirement to support a very large number of users as sites grow, memcached aids scalability by effectively cutting down on MySQL traffic and improving response times.

Memcached is a very light-weight server but is known not to scale beyond 4-6 threads. Some scalability improvements have gone into the 1.3 release (still in beta). With the new Intel Nehalem based systems improved hyper-threading providing twice as much performance as current systems, we were curious to see how memcached would perform on these systems. So we ran some tests, the results of which are shown below :

memcached 1.3.2 does scale slightly better than 1.2.5 after 4 threads. However, both versions reach their …

Memcached is the de-facto distributed caching server used to scale many web2.0 sites today. With the requirement to support a very large number of users as sites grow, memcached aids scalability by effectively cutting down on MySQL traffic and improving response times.

Memcached is a very light-weight server but is known not to scale beyond 4-6 threads. Some scalability improvements have gone into the 1.3 release (still in beta). With the new Intel Nehalem based systems improved hyper-threading providing twice as much performance as current systems, we were curious to see how memcached would perform on these systems. So we ran some tests, the results of which are shown below :

memcached 1.3.2 does scale slightly better than 1.2.5 after 4 threads. However, both versions reach their …

Memcached is the de-facto distributed caching server used to scale many web2.0 sites today. With the requirement to support a very large number of users as sites grow, memcached aids scalability by effectively cutting down on MySQL traffic and improving response times.

Memcached is a very light-weight server but is known not to scale beyond 4-6 threads. Some scalability improvements have gone into the 1.3 release (still in beta). With the new Intel Nehalem based systems improved hyper-threading providing twice as much performance as current systems, we were curious to see how memcached would perform on these systems. So we ran some tests, the results of which are shown below :

memcached 1.3.2 does scale slightly better than 1.2.5 after 4 threads. However, both versions reach their …

Topics for this podcast:

*CAOS 11 - Open to Investment
*CollabNet out with new TeamForge 5.2
*Memcached and MySQL appliances abound

iTunes or direct download (25:05, 5.8 MB)

Today I spoke with Farhan “Frank” Mashraqi, former Fotolog DBA, now working at a startup, NetEdge, working on social analytics. He’s talking about the two sessions he’s giving next week at the MySQL Conference & Expo 2009, as well as the benefits of being at the MySQL Conference & Expo.

He’s giving two talks:

1. Hadoop and MySQL: Friends with Benefits in where he will tell you about how you can combine data sets and queries, some of which run on Hadoop, and others which run on MySQL, but eventually probably end up in MySQL (he works on this cool stuff at NetEdge, the startup he’s currently attached …

I'm glad to announce the release of Memcached Functions for MySQL version 0.9. This version contains a couple bug fixes:

* Switched to using calloc() instead of malloc(), check for return value
* Changed memc_servers_set() to not create a new connection when one already exists, free first

Also added:

* memc_server_version()

mysql> select memc_server_version('127.0.0.1:11211')\G
*************************** 1. row ***************************
memc_server_version('127.0.0.1:11211'): Server: 127.0.0.1 (11211) version 1.2.6

I'm glad to get development moving along again. The book really took a ton of time, so now I can get this project moving along. Version 0.10 I'll be adding even more functionality. I'll get some ideas at the user's conference next week as well. One thing I need to get working properly is the ability to set a value in a specific …

original post

... and this is my usual plea to those mysql/web/industrial folks to try out the latest code. Help us on our quest to scale the crap out of all of your stuff. :)

Find us on the mailing list, on #memcached on freenode, or on twitter as dormando, dlsspy, tmaesaka, and trondn. :) All others are fakers.

---

Two new memcached releases are available today.

Stable …