Don't look at an industry benchmark here, it's a real client
200 Billion records in a month and it should be transactional but not durable.
For regular workload we use LOAD DATA INFILE into partitioned InnoDB, but here we have estimated 15TB of RAID storage. This is a lot of disks and it can't no more stay inside a single server internal storage.
MariaDB 5.5 come with TokuDB storage engine for compression, but is it possible in the time frame impose by the workload?
We start benchmarking 380G of raw input data files, 6 Billion rows.
First let's check the …