Faster s3 bucket duplication

Posted by Sean McCleary on Stack Overflow See other posts from Stack Overflow or by Sean McCleary
Published on 2011-01-11T21:48:58Z Indexed on 2011/01/11 21:53 UTC
Read the original article Hit count: 146

Filed under:

I have been trying to find a better command line tool for duplicating buckets than s3cmd. s3cmd can duplicate buckets without having to download and upload each file. The command I normally run to duplicate buckets using s3cmd is:

s3cmd cp -r --acl-public s3://bucket1 s3://bucket2

This works, but it is very slow as copies each file via the API one at a time. If s3cmd could run in parallel mode, I'd be very happy.

Are there other options available as a command line tools or code that people use to duplicate buckets that are faster than s3cmd?

© Stack Overflow or respective owner

Related posts about amazon-s3