TPC database benchmarks—which database vendors tune specifically
for—are a useful objective comparison for buyers of databases.
Unfortunately, there is no such comparison in the cloud, and the
current cost/comparison approach used by TPC doesn’t fit the
cloud.
Here are the problems:
1. TPC doesn’t include costs that are included in the cloud:
Public cloud services bundle the costs of everything into their
pricing. TPC eliminates things like: electricity, network
connectivity, people to run the service, networking equipment
(e.g. switches, cables, internet connectivity, etc.), load
balancers, modems, Ethernet cards, etc. The public cloud is
really a total cost of ownership, while TPC costs are not. So any
cost/performance between onsite and cloud solutions compares
apples to oranges.
2. TPC assumes that the expenses included above are paid in
advance for three …
[Read more]