Arch Linux

ccc1

Member

Registered: 2009-04-16

Posts: 111

[Solved] bedup - btrfs deduplication

Hi!

i'd like to request a pkgbuild for bedup:
https://github.com/g2p/bedup

from the btrfs-wiki (https://btrfs.wiki.kernel.org/index.php/Deduplication):

bedup implements incremental offline whole-file deduplication for Btrfs.

It works on mainline kernels (Linux 3.3 is required by the file locking implementation, 3.6 is required for cross-subvolume operation), using the clone ioctl (which exposes Btrfs' copy-on-write functionality).

An ioctl specific to deduplication was proposed in this mailing list thread (and the implementation strategy outlined much earlier by Chris Mason). Kernel help is required to simplify locking support and to deduplicate within frozen snapshots. An earlier patch was sent to the mailing list in early 2011. That patch didn't share code with the clone ioctl, and as a result it can't deduplicate compressed files or run across subvolumes; but it did bring in-kernel locking.

thanks in advance
ccc1

Edit: someone uploaded a pkbuild:
https://aur.archlinux.org/packages/bedup/

Last edited by ccc1 (2013-05-15 14:34:32)

mmq

Member

Registered: 2013-04-16

Posts: 2

Re: [Solved] bedup - btrfs deduplication

I gave it a try about a month ago, but I didn't upload the pkgbuild because I got a "WARNING: Package contains reference to $srcdir" message, so I felt like I was doing something wrong (I think this was related to python-cffi), and I was too nervous to actually test the package and see if it worked w/o destroying my filesystem.

Here's the pkgbuild in case you want to give it a try:

http://pastebin.com/MUz8kmu9

Lone_Wolf

Administrator

From: Netherlands, Europe

Registered: 2005-10-04

Posts: 15,401

Re: [Solved] bedup - btrfs deduplication

I gave it a try about a month ago, but I didn't upload the pkgbuild because I got a "WARNING: Package contains reference to $srcdir" message, so I felt like I was doing something wrong

All PKGBUILD functions (pkgver, prepare, build, check, package) are initialised with $srcdir as the current directory automagickally by makepkg.
There's no need to use $srcdir anymore in PKGBUILD

example :

in package()  replace cd "$srcdir/$_gitname-build" with cd "$_gitname-build"

Added :
scimmia is correct that the error is due to another issue, but that pkgbuild does need to get rid of deprecated stuff.

Last edited by Lone_Wolf (2013-04-16 15:23:25)

---

Disliking systemd intensely, but not satisfied with alternatives so focusing on taming systemd.

clean chroot building not flexible enough ?
Try clean chroot manager by graysky

Scimmia

Fellow

Registered: 2012-09-01

Posts: 13,729

Re: [Solved] bedup - btrfs deduplication

Lone_Wolf, that has absolutely nothing to do with what he's talking about. That warning means that a file in $pkgdir has a reference to the absolute path of $srcdir, usually because of a screwed up build system.

ccc1

Member

Registered: 2009-04-16

Posts: 111

Re: [Solved] bedup - btrfs deduplication

Here's the pkgbuild in case you want to give it a try:

http://pastebin.com/MUz8kmu9

Thanks for your pkgbuild, but i already managed to install bedup "manually". Despite that it would be still nice to have bedup in aur, since this way updating to new versions would be more comfortable ...

ccc1

ccc1

Member

Registered: 2009-04-16

Posts: 111

Re: [Solved] bedup - btrfs deduplication

I gave it a try about a month ago, but I didn't upload the pkgbuild because I got a "WARNING: Package contains reference to $srcdir" message, so I felt like I was doing something wrong (I think this was related to python-cffi), and I was too nervous to actually test the package and see if it worked w/o destroying my filesystem.

i tried your pkgbuild. Running bedup i got the following error:
Edit: The pkgbuild works fine and bedup saved me 400GB

ccc1

Last edited by ccc1 (2013-04-23 00:22:49)