As the years go by, data pages on disk have to get bigger. 16 KB pages were good for databases in the late 1990’s, but today’s data pages should probably be 64 KB. Page sizes go up over time because memory gets cheaper, and disks get much larger, but disks do not get very much faster.
In 1997, a Megabyte of memory cost $15, but today it costs 10 cents. A new SCSI drive held 4 GB then but 146 GB today. If cost is held constant, today’s machine has 150 times the memory and 36 times the storage of a machine from ten years ago, but the performance of disks is only about 3 times better. Disks are still about 3 inches across and turn at about 10K RPM; today’s best disk might deliver about 180 I/Os per second (IOPS), compared to 60 IOPS in 1997. And since the disk doesn’t move much faster, it makes sense — given the cheap storage both on disk and off — to transfer a bigger chunk of data back and forth with every disk access.
…
[Read more]