jan.kneschke.de is back online again. The old server
got old and rusty and it has taken while to get everything setup
again.
The most important articles are online again:
The old photo-storage is disabled, but a few new pics got uploaded to flickr, e.g. from my trip to Argentina:
If you read the MySQL manual you might have seen the ORDER BY RAND() to randomize the the rows and using the LIMIT 1 to just take one of the rows.
SELECT name FROM random ORDER BY RAND() LIMIT 1;
This example works fine and is fast if you only when let's say 1000 rows. As soon as you have 10000 rows the overhead for sorting the rows becomes important. Don't forget: we only sort to throw nearly all the rows away.
I never liked it. And there are better ways to do it. Without a sorting. As long as we have a numeric primary key.
For the first examples we assume the be ID is starting at 1 and we have no holes between 1 and the maximum value of the ID.
move the work into the application
First idea: We can simplify the whole job if we calculate the ID beforehand in the application.
SELECT MAX(id) FROM random; ## generate random id in application SELECT name FROM random WHERE id = …[Read more]
Some of the common conceptions of data storage seem to have been blown out of the water.
Two things I found interesting:
In their study they found that there was no correlation between disk failure rates and utilization, environmental conditions such as temperature, or age. This means that high disk utilization or age of the disk have no significant impact on the probability that it will fail.
…
They observed that older disks had a much lower failure rates then newer disks, where the newer disks in general were less expensive.
Which makes me think that buying used HDDs off Craigslist might not be a bad idea.
One could buy cheap 15k RPM low latency disks from a few years ago and forget about the storage capacity in exchange for FAST seek time.
Of course it depends on how …
[Read more]
Talking to a coworker at MySQL:
Coworker: "The spam is just awful."
Me: "I know, I am getting hundreds of pieces a day."
Coworker: "That bad! I am just getting a dozen a day."
Me: "I just need to unsubscribe to a number of mailing
lists."
Coworker: "But all of that is important! Its company mail."
I disagree, its Spam. Sure, its not Viagra ads, but its mail I
don't need to be reading. I've been at MySQL for four years, my
role keeps changing, but my subscription list has not.
In a modern corporation people get signed up to new mailing list
all the time. Once upon time it mattered that I read everything
our connectors group did. Now? I subscribe to announcements and
see what the output is. I make a point of pinging people and
seeing what is floating up to the top of discussions, but the day
to day I just do not need to follow.
…
In the beginner's mind there are many possibilities, in the
expert's mind there are few --Shunryu Suzuki
ETL
Database
I've just finished packaging up version 0.4 of the memcached
engine for MySQL.
What is new:
* Added support for packed rows (uses less memory).
* Fixed support for IN() operations.
* Fixed bug in UPDATE when ORDER BY was given.
http://download.tangent.org/memcache_engine-0.4.tar.gz
Hurry up, submit a paper! The LinuxTag Call for Papers ends tomorrow, February 16th.
Short info about LinuxTag from the homepage:
LinuxTag 2007 opens doors from May 30 to June 2, 2007 on Berlin Expo Center under the Funkturm. We invite users and experts to learn at Europe’s leading conference and expo more about the potential of Linux, Open Source, and Free Software.
Today, the industry's most prolific open source investor announced that it has raised another fund. 350 million Euros worth. This can only be a good thing for open source.
Index, perhaps best known for its investment in Skype, but the firm has done a slew of interesting investments (last.fm, FON, Oanda, Mobissimo, etc.). Danny Rimer, one of the partners there, gets my vote as one of the top venture capital investors anywhere, and especially when it comes to open source. MySQL, Pentaho, Trolltech, SourceLabs, and Zend all got early funding from Index.
Not sure what Index does that makes it so successful, but it's got to …
[Read more]
Sorry for the dead air recently. When I'm on a database project,
I'll post regularly on things I find or other tidbits of
information I encounter during the project. Even when I'm working
on a MySQL project, I'll usually have something to say about
what's going on or what I'm learning.
But lately, I've been on an Oracle Applications project. There's
two reasons I don't like to talk about Oracle Applications
projects. First, it's strategic to the company and I don't really
want to blog about company specific things. Second, I hate
dealing with it. The patches are unbelievable, the processes on
Metalink rarely work out of the box, and the product is so overly
complex that it's extremely difficult to administer. It's just a
very laborious process that I dread every time I start something
new. And there's really nothing exciting about it. Except the day
after I upgraded to 11.5.9, 11.5.10 came out.
So stick with me. Next up …
Sun Microsystems has announced an optimized version of the rapidly growing open source AMP stack (Apache / MySQL / PHP / Perl) on the Solaris operating system. Sun has also introduced a "try and buy" program as well as programs aimed towards Web 2.0 startup companies who up until now have been developing their business on Intel or Opteron boxes running Linux.
Support for the AMP stack is a good move on Sun's part to show their ongoing commitment to open source and making Solaris 10 a healthy alternative to Linux. While Linux has greater popularity than Solaris …
[Read more]