In this post, we'll take a quick look at rsync ("remote sync") and parallel rysnc—a way to increase the efficiency and speed of traditional rsync. At VividCortex, we've found each to be effective and handy at various times.
Rsync is a tool for copying files between volumes in the same or separate servers. The advantage of rsync is that instead of copying data blindly, it compares the source and destination directories, so that only the difference between the two is sent through the network (or between volumes).
Rsync can still be slow in certain situations, however—especially when there's a high volume of data that needs to be copied. In such a case, the process can take hours. Additionally, if the volume io has high latency—such as when cold Amazon EBS volumes are involved—the throughput can …[Read more]