I've described this idea to a few people, but I figured I would
post it here.
I've had an idea for using Amazon AWS S3 to distribute MySQL
cluster replication data.
The existing architecture for MySQL clustering is as follows:
- The master has N slaves
- The master copies each binlog replication to each slave. If there are 7 slaves, then the master has to push the same data out it's network pipe 7 times
- The slave has a hot TCP connection to the master. The master has 7 hot TCP connections, one for each salve.
- The slave takes each replication chunk and applies it.
Here is my idea.
- For each replication chunk, the master creates a handle name for it, and also the handle name for the next chunk.
- The server copies each chuck into an S3 item, once. The item's name is it's handle, and it has a piece of S3 …