Showing entries 11 to 12
« 10 Newer Entries
Displaying posts with tag: hscale (reset)
Progress on MySQL Proxy Partitioning

As posted here I started to think about possible ways to implement database sharding/partitioning.

I finally found the time to start prototyping a MySQL Proxy based solution that would allow you to analyze and rewrite queries to direct them to different databases. So this would going to be a nearly 100% transparent solution (some queries are impossible to support due to the nature of having multiple tables in different locations).

How does it work?
The main goal is to split up mysql tables and optionally put each of the resulting partitions on different mysql servers.

For now I concentrate on splitting up big tables into smaller ones within the same database. Distribution of these tables (i.e. partitions) over multiple databases would be the final goal and a lot more challenging task (think of …

[Read more]
MySQL Partitioning on Application Side

After following the scale up path (i.e. buy bigger boxes) for a while now, we definitely need to scale out as things start to become “unhandy” and simply HUGE. (See small things are better)

We are running an OLTP application with about 200 million transaction per month. Currently we have some very large tables with more than 1,5 billion rows and the total database size is about 600 GB - all InnoDB.

What we want to implement is application based sharding, i.e. splitting up the big tables and distribute them among many smaller servers. Furthermore we need to implement some sort of archiving mechanism since the db size is growing very fast. Putting old data into compressed myisam tables seems to be a good solution here.

So, how to implement this?

These solutions come into mind immediately:

[Read more]
Showing entries 11 to 12
« 10 Newer Entries