I currently work for a German social networking site for business professionals called XING. As you can probably imagine, a member base of double-digit millions of users produces some pretty large amounts of data. Fortunately, for the Engineering Team this provides us with a never-ending source of interesting challenges to solve.
Not too long ago we were given the task to evaluate various technical solutions for a feature which would potentially cause up to 50 million records to be written per day. What I’d like to show you is a proof of concept that we came up with for MySQL.
For the sake of simplicity, I’ll model the problem as follows:
- There are several million hens.
- Each hen has a basket that it lays eggs into.
- Some hens lay eggs faster than others.
- A basket can only hold a specific amount of eggs.
Since …
[Read more]