Arch Linux

Kardell

Member

From: London a new Babylon

Registered: 2007-02-20

Posts: 228

Looking for duplicates with similar file names

Hi All,
   I hope you are well.
I am looking for a solution, a script to find files with similar names.
It happened that I have a lot of files that instead of overwriting themselves have created a number of duplicates with 1, 2, 3, 4 number at the end.
This is not just one set of duplicates and this would be a laborious task to clean manually.

I have looked into fdupes and rmlint, but both check hashes or baseline name, but if the name is slightly different it does not consider it as a duplicate. Hashes do not match either.
Would you suggest any other alternative piece of software or script?

Thank you

---

"Those who don't know history are doomed to repeat it." Edmund Burke

HiImTye

Member

From: Halifax, NS, Canada

Registered: 2012-05-09

Posts: 1,072

Re: Looking for duplicates with similar file names

uniq is probably what you're looking for

edit: or if they just append numbers, you could just use built ins, and search for the appended numbers or strings

Last edited by HiImTye (2017-01-14 23:06:38)

loqs

Member

Registered: 2014-03-06

Posts: 17,411

Re: Looking for duplicates with similar file names

Hashes do not match either.

How can the hashes not match but the contents be identical?

Kardell

Member

From: London a new Babylon

Registered: 2007-02-20

Posts: 228

Re: Looking for duplicates with similar file names

This is streamed content and each file seems to have tiny file size difference.

Last edited by Kardell (2017-01-14 23:54:04)

---

"Those who don't know history are doomed to repeat it." Edmund Burke