[SOLVED] borg fails to backup second Windows system to USB hard drive

keepitsimpleengineer · 2017-12-01 03:30:15

So I have two Windows 10 systems on separate disks/partitions.
When I use borg to backup System a (SDD) to a USB external HDD it works fine.
When I use borg to backup System b (HDD) to the USB external HDD, I get hundreds of errors before I cancel the job, similar to these:

/run/media/ljohnson/WIN_10b/Program Files/WindowsApps/Microsoft.Office.OneNote_17.8730.20741.0_x64__8wekyb3d8bbwe/en-gb/locimages/offsym.ttf: stat: [Errno 5] Input/output error: '/run/media/ljohnson/WIN_10b/Program Files/WindowsApps/Microsoft.Office.OneNote_17.8730.20741.0_x64__8wekyb3d8bbwe/en-gb/locimages/offsym.ttf'

The disks look like this:

$ listblk    # (alias listblk='lsblk -o NAME,SIZE,UUID,OWNER,GROUP,LABEL,MOUNTPOINT')
NAME     SIZE UUID                                 OWNER GROUP   LABEL           MOUNTPOINT
sda    465.8G                                      root  disk                    
├─sda1  19.5G d7c05292-01fc-a6ac-9961-ef349991e2ac root  disk    arch_boot       /boot
├─sda2  62.5G 5a1ca848-b27c-966c-8bb5-fb498991521a root  disk    arch_root       /
├─sda3    16G cdb9e719-9cd1-47ed-911b-c6319b3c67a2 root  disk                    
├─sda4     1K                                      root  disk                    
├─sda5  29.3G 11251398-24ec-a7ed-7b81-29f22eb17943 root  disk    arch_adj        
└─sda6 338.4G 6ff811c8-7f8d-9d83-14ac-059816ad4367 root  disk    arch_home       /home
sdb    489.1G                                      root  disk                    
├─sdb1   500M E24CE6894CE65835                     root  disk    System Reserved 
└─sdb2 488.6G F2F6E76FF6E73311                     root  disk                    
sdd    931.5G                                      root  disk                    
└─sdd1 931.5G 406C7D256C7D173E                     root  disk    Win10aBU        /run/media/ljohnson/Win10aBU
sde    931.5G                                      root  disk                    
├─sde1   500M F2B64D2CB64CF321                     root  disk    System Reserved 
└─sde2   931G 10D04EC2D04EAE32                     root  disk                    /run/media/ljohnson/WIN_10b

System a is on /dev/sdb and System b is on /dev/sde
The USB drive is /dev/sdd

$ ls -l /run/media/ljohnson/Win10aBU | grep borg
drwxrwxrwx 1 ljohnson users    4096 Nov 30 17:25 borgBU
drwxrwxrwx 1 ljohnson users     552 Nov 30 18:28 borgBUb

Backups of System a is on borgBU and System b was to have been on borgBUb
Running on archlinux x86_64 using fuse 3.2.0-1 and borg 1.1.2-2
The run commnand was:

$ borg create --stats --compression zlib,5 /run/media/ljohnson/Win10aBU/borgBUb::all /run/media/ljohnson/WIN_10b/

The ntfs partitions have adquate size and check out w/o errors…

$ df -h …
Filesystem      Size  Used Avail Use% Mounted on
/dev/sde2       932G  240G  692G  26% /run/media/ljohnson/WIN_10b
/dev/sdd1       932G  216G  717G  24% /run/media/ljohnson/Win10aBU

No problems accessing System b using file manager.

I am very much at a loss to figure out what's not working, especially since System a went so well... .. .

Last edited by keepitsimpleengineer (2017-12-03 17:26:02)

keepitsimpleengineer · 2017-12-01 23:38:58

Here is output from run: https://pastebin.com/PvUd73DK

Last edited by keepitsimpleengineer (2017-12-02 00:37:26)

Xyne · 2017-12-02 01:10:44

A search for "stat: [Errno 5] Input/output error" returns several hits that indicate that the disk may be failing. Check dmesg for errors and run a test with smart. The problem may also be in the way the ntfs partition is mounted or the health of the partition (requiring a "repair"). Relevant links related to ntfs partitions:

I only briefly checked the search results. There are many more hits so you can start looking there if the above doesn't lead anywhere.

keepitsimpleengineer · 2017-12-02 22:24:46

I think I have found the difficulty. From the journal

Dec 02 13:50:20 KISE-005 ntfs-3g[1064]: Could not load plugin /usr/lib/ntfs-3g/ntfs-plugin-80000017.so: No such file or directory
Dec 02 13:50:20 KISE-005 ntfs-3g[1064]: Hint /usr/lib/ntfs-3g/ntfs-plugin-80000017.so: cannot open shared object file: No such file or directory

Little actual information about ntfs-plugin-80000017.so can be found but there are hints that it has to do with Windows 10 disk compression. This is puzzling because I did not use compression on that partition. Furthermore, I attempted to remove any compression that may be there using Disk properties in Windows,

BTW: chkdsk and S.M.A.R.T. showed no problems with the disk.

Tarqi · 2017-12-02 23:12:05

Either use the file-compression plugin from the AUR (git) or reboot into the affected system and turn off CompactOS in an admin CMD.exe:

 C:\WINDOWS\system32> compact.exe /CompactOS:never

and retry the backup. Hope it helps.

keepitsimpleengineer · 2017-12-03 17:25:16

Tarqi wrote:

Either use the file-compression plugin from the AUR (git) or reboot into the affected system and turn off CompactOS in an admin CMD.exe:
 C:\WINDOWS\system32> compact.exe /CompactOS:never
and retry the backup. Hope it helps.

Pretty much sore from this annoyance, I did both. The borg backup is now cheerfully backing up System b.

This makes me happy, thanks Tarqi... .. .

On the other hand, this still shows up in the journal:

Dec 03 08:30:40 KISE-005 ntfs-3g[1110]: Could not load plugin /usr/lib/ntfs-3g/ntfs-plugin-80000018.so: No such file or directory
Dec 03 08:30:40 KISE-005 ntfs-3g[1110]: Hint /usr/lib/ntfs-3g/ntfs-plugin-80000018.so: cannot open shared object file: No such file or directory

Tarqi · 2017-12-03 17:52:49

I remebered that windows is doing some compression for the OS behind the curtain and can't say anything about the plugin, it just showed up about upon a search for your problem and looked like it would be helpfull. Glad you solved it.

Arch Linux

#1 2017-12-01 03:30:15

[SOLVED] borg fails to backup second Windows system to USB hard drive

#2 2017-12-01 23:38:58

Re: [SOLVED] borg fails to backup second Windows system to USB hard drive

#3 2017-12-02 01:10:44

Re: [SOLVED] borg fails to backup second Windows system to USB hard drive

#4 2017-12-02 22:24:46

Re: [SOLVED] borg fails to backup second Windows system to USB hard drive

#5 2017-12-02 23:12:05

Re: [SOLVED] borg fails to backup second Windows system to USB hard drive

#6 2017-12-03 17:25:16

Re: [SOLVED] borg fails to backup second Windows system to USB hard drive

#7 2017-12-03 17:52:49

Re: [SOLVED] borg fails to backup second Windows system to USB hard drive

Board footer