You are not logged in.

#1 2022-12-29 20:28:58

Strangiato
Member
Registered: 2020-01-10
Posts: 521

Files randomly disappear after renaming or moving

Hi

I use Arch + KDE Plasma.
I have thousands of image files (mainly .jpg) stored in a ntfs partition. Sometimes several of them disappear after mass renaming, and the files that disappear not always are the renamed ones. This occurs randomly regardless the partition is mounted with ntfs-3g or ntfs3 drivers, when I use Dolphin or Nautilus file managers, with both lts and zen kernels. There is no error related to my hard disk in the kernel log and the SMART data says it is healthy. I have already ran chkdsk /f three times on Windows 7 installed on my pc but the problem always occurs again.
Another problem that happened once is that some files disappeared when moved from an EXT4 partition to the same ntfs partition. Only some of the files that I tried to move were in fact moved, some of them simply disappeared.
I have no idea what is going on and this bizarre and critical problem makes my Arch unusable to manage files.

journalctl log printed these messages when some of my files disappeared a few minutes ago:

dez 29 16:03:43 Arch-PC plasmashell[1248]: 16:03:43.954 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:03:44 Arch-PC plasmashell[1248]: 16:03:44.318 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:03:44 Arch-PC plasmashell[1248]: 16:03:44.397 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:04:07 Arch-PC plasmashell[1248]: 16:04:07.590 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:04:07 Arch-PC plasmashell[1248]: 16:04:07.915 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:04:48 Arch-PC plasmashell[1248]: 16:04:48.368 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:04:48 Arch-PC plasmashell[1248]: 16:04:48.459 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:06:05 Arch-PC plasmashell[1248]: 16:06:05.729 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:06:05 Arch-PC plasmashell[1248]: 16:06:05.821 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:06:35 Arch-PC plasmashell[1248]: 16:06:35.325 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:06:35 Arch-PC plasmashell[1248]: 16:06:35.325 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:06:35 Arch-PC plasmashell[1248]: 16:06:35.373 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:06:46 Arch-PC plasmashell[1248]: 16:06:46.515 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:06:46 Arch-PC plasmashell[1248]: 16:06:46.567 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:06:46 Arch-PC plasmashell[1248]: 16:06:46.648 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:07:02 Arch-PC plasmashell[1248]: 16:07:02.336 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:07:02 Arch-PC plasmashell[1248]: 16:07:02.372 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:07:02 Arch-PC plasmashell[1248]: 16:07:02.454 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:07:02 Arch-PC plasmashell[1248]: 16:07:02.900 DEBUG CollectionWatcher:988            Subdir "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" changed under directory "/mnt/SEAGATE/Minhas músicas" id 2
dez 29 16:07:55 Arch-PC plasmashell[761]: org.kde.klipper: Invalid or non-local url for preview:  QUrl("/mnt/SEAGATE/Minhas")
dez 29 16:07:55 Arch-PC plasmashell[761]: org.kde.klipper: Invalid or non-local url for preview:  QUrl("imagens/Revista/1995-2003")

The log mentions "CollectionWatcher", I have no idea what it is, and searching in the internet I can not find anything about it. I do not understand why the log says "'/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio' changed under directory '/mnt/SEAGATE/Minhas músicas' id 2" when "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio" and ""/mnt/SEAGATE/Minhas músicas" are completely different directories. My files disappeared from "/mnt/SEAGATE/Minhas imagens/Revista/1995-2003 (Brasil)/2002/2002.12 - Ensaio".

What can I do? If you need more info/logs, let me know.
Thanks for reading.

Offline

#2 2022-12-29 21:07:20

rab0171610@gmail.com
Member
Registered: 2022-11-05
Posts: 20

Re: Files randomly disappear after renaming or moving

Just a guess here . . .
Do you have Strawberry Music Player installed?   I don't know anything about it but from the logs, it looks like the CollectionWatcher is part of that software.  It may be scanning and creating a database in an rsync like fashion and causing issues.  If you want to manage the files yourself, I'd recommend uninstalling that, if it is indeed installed, and see if the problem persists.  Otherwise, learn how the software collection database works within the player and only manage files within the confines of the player i.e. copying, deleting, or adding songs to the database.  I don't think this is an Arch specific issue.  Try removing the player for now and consider an alternative player if that is the issue.

Offline

#3 2022-12-29 21:18:48

Strangiato
Member
Registered: 2020-01-10
Posts: 521

Re: Files randomly disappear after renaming or moving

rab0171610@gmail.com wrote:

Just a guess here . . .
Do you have Strawberry Music Player installed?   I don't know anything about it but from the logs, it looks like the CollectionWatcher is part of that software.  It may be scanning and creating a database in an rsync like fashion and causing issues.  If you want to manage the files yourself, I'd recommend uninstalling that, if it is indeed installed, and see if the problem persists.  Otherwise, learn how the software collection database works within the player and only manage files within the confines of the player i.e. copying, deleting, or adding songs to the database.  I don't think this is an Arch specific issue.  Try removing the player for now and consider an alternative player if that is the issue.

Yes, Strawberry is playing music all the time on my system, and currently I'm updating my music library. Unfortunately other muisic players are unusable for me. I have disabled "Update the collection when Strawberry starts" and "Monitor the collection for changes" in Strawberry settings for now, let's see what happens in the next hours/days. Thank you very much for your help.

Last edited by Strangiato (2022-12-29 21:19:28)

Offline

#4 2022-12-30 17:55:47

Strangiato
Member
Registered: 2020-01-10
Posts: 521

Re: Files randomly disappear after renaming or moving

It happened again, 21 .jpg files disappeared after renaming, and the journal log does not mention CollectionWatcher this time. I use Navidrome media server, it monitors "/mnt/SEAGATE/MInhas músicas" for changes. Could it cause the data loss?

dez 30 14:39:26 Arch-PC navidrome[453]: time="2022-12-30T14:39:26-03:00" level=debug msg="Scheduler: run" entry=1 next="2022-12-30 14:40:26 -0300 -03" now="2022-12-30 14:39:26.009722658 -0300 -03"
dez 30 14:39:26 Arch-PC navidrome[453]: time="2022-12-30T14:39:26-03:00" level=debug msg="Scanning folder" folder="/mnt/SEAGATE/Minhas músicas/" lastModifiedSince="2022-12-30 14:38:26.009 -0300 -03"
dez 30 14:39:26 Arch-PC navidrome[453]: time="2022-12-30T14:39:26-03:00" level=debug msg="Directory tree loaded from DB" elapsed=81.4ms total=1398
dez 30 14:39:26 Arch-PC navidrome[453]: time="2022-12-30T14:39:26-03:00" level=debug msg="Finished deleted folders check" elapsed="810.324µs" total=0
dez 30 14:39:26 Arch-PC navidrome[453]: time="2022-12-30T14:39:26-03:00" level=debug msg="No changes found in Music Folder" elapsed=217.6ms folder="/mnt/SEAGATE/Minhas músicas/"
dez 30 14:39:26 Arch-PC navidrome[453]: time="2022-12-30T14:39:26-03:00" level=debug msg="Finished reading directories from filesystem" elapsed=128ms

Navidrome: https://github.com/navidrome/navidrome

Edit:
A few minutes ago I copied 4 files located on desktop, tried to paste them to my ntfs partition, some folders present in the destination disappeared and the copied files were not pasted. What a bizarre problem. I will use Windows 7 until I find a solution. My Arch is unusable until this problem is solved. These problems begin after using the computer for several hours uninterruptedly.

Last edited by Strangiato (2022-12-30 19:20:11)

Offline

Board footer

Powered by FluxBB