Ways to deduplicate files

Posted by User1 on Super User See other posts from Super User or by User1
Published on 2010-05-13T18:03:05Z Indexed on 2010/05/13 18:04 UTC
Read the original article Hit count: 183

I want to simply backup and archive the files on several machines. Unfortunately, the files have some large files that are the same file but stored differently on different machines. For instance, there may a few hundred photos that were copied from one computer to the other as an ad-hoc backup. Now that I want to make a common repository of files, I don't want several copies of the same photo.

If I copy all of these files to a single directory, is there a tool that can go thru and recognize duplicate files and give me a list or even delete one of the duplicates?

© Super User or respective owner

Related posts about deduplication

Related posts about backup