deja-dup failed to restore with an unknown error.

TwoFlower · 2013-03-08 12:02:54

Hi. I recently installed arch after running sabayon linux (a gentoo based noob distro like ubuntu) for a while. Just before I wiped my hard drive to install arch, I backed up my sabayon's home directory to my external hard drive using deja dup. However when I opened up my hard drive on arch, and try to restore the backup from its location, it says:

 Restore Failed: Restore failed with an unknown error

Is there a way to fix this?

City-busz · 2013-03-08 15:40:13

Try to restore with the following command, and post the command line output if fails:

$ LANG=C DEJA_DUP_DEBUG=1 deja-dup --restore

TwoFlower · 2013-03-08 16:21:41

When I type it in it opens up the deja-dup frontend and from there it gives the aforementioned message without leaving any actual error message in the command line.

City-busz · 2013-03-09 10:23:58

Strange. Currently I don't know what is the problem. Meanwhile, you can downgrade duplicity, and try again:

# pacman -U http://arm.konnichi.com/2013/01/31/community/os/x86_64/duplicity-0.6.20-2-x86_64.pkg.tar.xz

TwoFlower · 2013-03-09 16:09:20

Okay, that worked to in extent in the sense that it got me to the next step and let me choose the date from which I wanted to back up from. But then:

 Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1403, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1396, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1330, in main
    restore(col_stats)
  File "/usr/bin/duplicity", line 624, in restore
    restore_get_patched_rop_iter(col_stats)):
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 526, in Write_ROPaths
    for ropath in rop_iter:
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 499, in integrate_patch_iters
    final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) )
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 463, in patch_seq2ropath
    assert first.difftype != "diff", patch_seq
AssertionError: [(('home', 'imran', '.kde4', 'share', 'apps', 'RecentDocuments', '01 - The Suburbs.mp3.desktop') reg)]

It failed once again. Also, is there anyway for me to just restore some files and not others? Because I accidentally forgot to ignore some big ones that take time and I'm going to delete anyway

City-busz · 2013-03-10 06:09:16

Strange. You could try to restore files with 'duplicity':

$ duplicity --gio file:///media/backup /tmp/restore

were:
- file:///media/backup is the location were the backup files are stored
- /tmp/restore is the destination

See 'man duplicity' for more options.

TwoFlower · 2013-03-10 13:07:02

The output received from the running the command as sudo;

 Import of duplicity.backends.u1backend Failed: No module named httplib2
Synchronizing remote metadata to local cache...
GnuPG passphrase: 
Copying duplicity-full-signatures.20130201T230454Z.sigtar.gpg to local cache.
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1403, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1396, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1272, in main
    sync_archive(decrypt)
  File "/usr/bin/duplicity", line 1072, in sync_archive
    copy_to_local(fn)
  File "/usr/bin/duplicity", line 1019, in copy_to_local
    gpg.GzipWriteFile(src_iter, tdp.name, size=sys.maxint)
  File "/usr/lib/python2.7/site-packages/duplicity/gpg.py", line 379, in GzipWriteFile
    gzip_file.write(new_block.data)
  File "/usr/lib/python2.7/gzip.py", line 231, in write
    self.fileobj.write( self.compress.compress(data) )
  File "/usr/lib/python2.7/site-packages/duplicity/gpg.py", line 361, in write
    result = self.fileobj.write(buf)
IOError: [Errno 28] No space left on device

City-busz · 2013-03-10 13:25:34

Okay, then run duplicity with the '--tempdir' option:

$ duplicity --tempdir=/path/to/a/large/partition --gio file:///media/backup /tmp/restore

So specify a large location with the --tempdir location. Duplicity uses the /tmp location for tempolary files by default, which can be filled really soon if you try to restore large backup.

And of course, replace /tmp/restore with e.g. ~/restore. Do not try to restore into /tmp.

Last edited by City-busz (2013-03-10 13:26:56)

TwoFlower · 2013-03-10 14:47:27

It still doesn't work which is weird because it should work because my hard drive has 265 GB of free space which should be more than enough. I type:

 sudo duplicity --tempdir=~/ --gio file:///run/media/imran/Imran/Restore /tmp/Rstr

And get:

 Import of duplicity.backends.u1backend Failed: No module named httplib2
Synchronizing remote metadata to local cache...
GnuPG passphrase: 
Copying duplicity-full-signatures.20130201T230454Z.sigtar.gpg to local cache.
Copying duplicity-full.20130201T230454Z.manifest.gpg to local cache.
Copying duplicity-inc.20130201T230454Z.to.20130214T030723Z.manifest.gpg to local cache.
Copying duplicity-inc.20130214T030723Z.to.20130222T071645Z.manifest.gpg to local cache.
Copying duplicity-inc.20130222T071645Z.to.20130226T161103Z.manifest.gpg to local cache.
Copying duplicity-new-signatures.20130201T230454Z.to.20130214T030723Z.sigtar.gpg to local cache.
Copying duplicity-new-signatures.20130214T030723Z.to.20130222T071645Z.sigtar.gpg to local cache.
Copying duplicity-new-signatures.20130222T071645Z.to.20130226T161103Z.sigtar.gpg to local cache.
Last full backup date: Sat Feb  2 02:04:54 2013
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1403, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1396, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1330, in main
    restore(col_stats)
  File "/usr/bin/duplicity", line 624, in restore
    restore_get_patched_rop_iter(col_stats)):
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 528, in Write_ROPaths
    ITR( ropath.index, ropath )
  File "/usr/lib/python2.7/site-packages/duplicity/lazy.py", line 335, in __call__
    last_branch.fast_process, args)
  File "/usr/lib/python2.7/site-packages/duplicity/robust.py", line 37, in check_common_error
    return function(*args)
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 581, in fast_process
    ropath.copy( self.base_path.new_index( index ) )
  File "/usr/lib/python2.7/site-packages/duplicity/path.py", line 425, in copy
    other.writefileobj(self.open("rb"))
  File "/usr/lib/python2.7/site-packages/duplicity/path.py", line 604, in writefileobj
    fout.write(buf)
IOError: [Errno 28] No space left on device

^CException KeyboardInterrupt in <module 'threading' from '/usr/lib/python2.7/threading.pyc'> ignored
[imran@arch ~]$ sudo duplicity --tempdir=~/ --gio file:///run/media/imran/Imran/Restore /tmp/Rstr
Import of duplicity.backends.u1backend Failed: No module named httplib2
Restore destination directory /tmp/Rstr already exists.
Will not overwrite.
[imran@arch ~]$ sudo duplicity --tempdir=~/ --gio file:///run/media/imran/Imran/Restore /tmp/Rstr
Import of duplicity.backends.u1backend Failed: No module named httplib2
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Feb  2 02:04:54 2013
GnuPG passphrase: 
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1403, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1396, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1330, in main
    restore(col_stats)
  File "/usr/bin/duplicity", line 624, in restore
    restore_get_patched_rop_iter(col_stats)):
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 528, in Write_ROPaths
    ITR( ropath.index, ropath )
  File "/usr/lib/python2.7/site-packages/duplicity/lazy.py", line 335, in __call__
    last_branch.fast_process, args)
  File "/usr/lib/python2.7/site-packages/duplicity/robust.py", line 37, in check_common_error
    return function(*args)
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 581, in fast_process
    ropath.copy( self.base_path.new_index( index ) )
  File "/usr/lib/python2.7/site-packages/duplicity/path.py", line 425, in copy
    other.writefileobj(self.open("rb"))
  File "/usr/lib/python2.7/site-packages/duplicity/path.py", line 604, in writefileobj
    fout.write(buf)
IOError: [Errno 28] No space left on device

City-busz · 2013-03-10 15:00:38

Try this:

$ mkdir ~/restored-files
$ duplicity --gio file:///run/media/imran/Imran/Restore ~/restored-files

You should able to run these command as normal user, don't need to use sudo.

TwoFlower · 2013-03-10 15:05:19

Did exactly that. I got:

 Import of duplicity.backends.u1backend Failed: No module named httplib2
Temp space has 8192 available, backup needs approx 34078720.

It is strange that it says this because at the bottom it says that I have 265 GB free space on the partition? :S

City-busz · 2013-03-10 15:23:36

Then try this:

$ duplicity --tempdir=~/ --gio file:///run/media/imran/Imran/Restore ~/restored-files

The reason of this message is the size of the /tmp dir = physical RAM + swap file, which is usually 1-8 GB.

Last edited by City-busz (2013-03-10 15:24:38)

TwoFlower · 2013-03-10 15:39:38

 Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1403, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1396, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1330, in main
    restore(col_stats)
  File "/usr/bin/duplicity", line 624, in restore
    restore_get_patched_rop_iter(col_stats)):
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 526, in Write_ROPaths
    for ropath in rop_iter:
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 499, in integrate_patch_iters
    final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) )
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 479, in patch_seq2ropath
    misc.copyfileobj( current_file, tempfp )
  File "/usr/lib/python2.7/site-packages/duplicity/misc.py", line 166, in copyfileobj
    buf = infp.read(blocksize)
  File "/usr/lib/python2.7/site-packages/duplicity/librsync.py", line 80, in read
    self._add_to_outbuf_once()
  File "/usr/lib/python2.7/site-packages/duplicity/librsync.py", line 94, in _add_to_outbuf_once
    raise librsyncError(str(e))
librsyncError: librsync error 103 while in patch cycle

Plus a bunch of lines saying that it did not have permission of the operation of putting the file there.

TwoFlower · 2013-03-10 15:43:47

Got this when running as sudo:

 Import of duplicity.backends.u1backend Failed: No module named httplib2
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Sat Feb  2 02:04:54 2013
GnuPG passphrase: 
python2: ERROR: (rs_file_copy_cb) unexpected eof on fd12
python2: ERROR: (rs_job_complete) patch job failed: unexpected end of input
Traceback (most recent call last):
  File "/usr/bin/duplicity", line 1403, in <module>
    with_tempdir(main)
  File "/usr/bin/duplicity", line 1396, in with_tempdir
    fn()
  File "/usr/bin/duplicity", line 1330, in main
    restore(col_stats)
  File "/usr/bin/duplicity", line 624, in restore
    restore_get_patched_rop_iter(col_stats)):
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 526, in Write_ROPaths
    for ropath in rop_iter:
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 499, in integrate_patch_iters
    final_ropath = patch_seq2ropath( normalize_ps( patch_seq ) )
  File "/usr/lib/python2.7/site-packages/duplicity/patchdir.py", line 479, in patch_seq2ropath
    misc.copyfileobj( current_file, tempfp )
  File "/usr/lib/python2.7/site-packages/duplicity/misc.py", line 166, in copyfileobj
    buf = infp.read(blocksize)
  File "/usr/lib/python2.7/site-packages/duplicity/librsync.py", line 80, in read
    self._add_to_outbuf_once()
  File "/usr/lib/python2.7/site-packages/duplicity/librsync.py", line 94, in _add_to_outbuf_once
    raise librsyncError(str(e))
librsyncError: librsync error 103 while in patch cycle

City-busz · 2013-03-10 15:54:53

It looks like a bug in duplicity:
https://bugs.launchpad.net/duplicity/+bug/662442

TwoFlower · 2013-03-10 16:10:57

Okay. Thank you for all your help. I'm just going to get another backup program and backup fewer things in the future.

firecat53 · 2013-03-10 17:01:29

@TwoFlower -- I'd suggest posting your question on the duplicity mailing list. They are very helpful there!

Scott

TwoFlower · 2013-03-10 19:53:00

Thanks for the suggestion firecat53. I will do that soon.

Arch Linux

#1 2013-03-08 12:02:54

deja-dup failed to restore with an unknown error.

#2 2013-03-08 15:40:13

Re: deja-dup failed to restore with an unknown error.

#3 2013-03-08 16:21:41

Re: deja-dup failed to restore with an unknown error.

#4 2013-03-09 10:23:58

Re: deja-dup failed to restore with an unknown error.

#5 2013-03-09 16:09:20

Re: deja-dup failed to restore with an unknown error.

#6 2013-03-10 06:09:16

Re: deja-dup failed to restore with an unknown error.

#7 2013-03-10 13:07:02

Re: deja-dup failed to restore with an unknown error.

#8 2013-03-10 13:25:34

Re: deja-dup failed to restore with an unknown error.

#9 2013-03-10 14:47:27

Re: deja-dup failed to restore with an unknown error.

#10 2013-03-10 15:00:38

Re: deja-dup failed to restore with an unknown error.

#11 2013-03-10 15:05:19

Re: deja-dup failed to restore with an unknown error.

#12 2013-03-10 15:23:36

Re: deja-dup failed to restore with an unknown error.

#13 2013-03-10 15:39:38

Re: deja-dup failed to restore with an unknown error.

#14 2013-03-10 15:43:47

Re: deja-dup failed to restore with an unknown error.

#15 2013-03-10 15:54:53

Re: deja-dup failed to restore with an unknown error.

#16 2013-03-10 16:10:57

Re: deja-dup failed to restore with an unknown error.

#17 2013-03-10 17:01:29

Re: deja-dup failed to restore with an unknown error.

#18 2013-03-10 19:53:00

Re: deja-dup failed to restore with an unknown error.

Board footer