Subsequent runs of rsync locally don't reduce data transferred

Posted by sharakan on Server Fault See other posts from Server Fault or by sharakan
Published on 2012-11-30T21:20:43Z Indexed on 2012/11/30 23:07 UTC
Read the original article Hit count: 168

Filed under:
|
|
|

I have an EC2 instance with data I want to sync to a mounted, but remote, volume, as a backup.

rsync seems like the way to go with this, so as a test I took my test file (a Postgres pg_dump file) and used rsync -v to copy it to the mounted volume:

[ec2-user work]$ rsync -v dump.sql.1 ../backup/dump.sql
dump.sql.1

sent 821704315 bytes  received 31 bytes  3416650.09 bytes/sec
total size is 821603948  speedup is 1.00

Then, I ran it again, expecting to see minimal sent/received numbers because it would just be checksums. Instead...

[ec2-user work]$ rsync -v dump.sql.1 ../backup/dump.sql
dump.sql.1

sent 821704315 bytes  received 31 bytes  3402502.47 bytes/sec
total size is 821603948  speedup is 1.00

I'm new to rsync so perhaps I'm missing something, but isn't the idea that the source and destination files are checked for differences, and then a patch is generated and applied to the destination? Why is this not reducing the amount of data 'sent' to just the size of the checksums?

Some background if it's relevant:

the mounted volume is using s3fs, mounted with s3fs <bucketname> backup.

© Server Fault or respective owner

Related posts about amazon-ec2

Related posts about rsync