root on zfs, pacman error: partition / too full

populationless · 2020-05-04 22:28:56

Hello gentlefolks,

I'm currently running arch in a VM to play around, before I install on my workstation.

While trying to install plasma, I get the following error:

# pacman -S plasma kde-applications
...
Total Installed Size:  4042.77 MiB
...
error: Partition / too full: 171008 blocks needed, 108795 blocks free

I went to check df -h and was surprised to find / still had over 80% free space left:

# df -h
Filesystem             Size  Used Avail Use% Mounted on
dev                    7.8G     0  7.8G   0% /dev
run                    7.9G  9.0M  7.8G   1% /run
rpool/ROOT/arch         16G  1.9G   14G  13% /
tmpfs                  7.9G     0  7.9G   0% /dev/shm
tmpfs                  7.9G     0  7.9G   0% /sys/fs/cgroup
tmpfs                  7.9G     0  7.9G   0% /tmp
/dev/sdb1             1009M  104M  905M  11% /efi1
/dev/sda1             1009M  104M  905M  11% /efi0
rpool/srv               14G  256K   14G   1% /srv
rpool/opt               14G  256K   14G   1% /opt
dpool/DATA/home         14G  384K   14G   1% /home
dpool/DATA/home/root    14G  512K   14G   1% /root
rpool/var/www           14G  256K   14G   1% /var/www
rpool/var/cache         16G  1.8G   14G  12% /var/cache
dpool/DATA/home/nvz     14G   81M   14G   1% /home/nvz
rpool/var/log           14G  384K   14G   1% /var/log
rpool/var/lib/nfs       14G  256K   14G   1% /var/lib/nfs
rpool/var/spool         14G  256K   14G   1% /var/spool
rpool/usr/local         14G  256K   14G   1% /usr/local
rpool/var/lib/libvirt   14G  256K   14G   1% /var/lib/libvirt
rpool/var/tmp           14G  256K   14G   1% /var/tmp
rpool/var/games         14G  256K   14G   1% /var/games
rpool/var/snap          14G  256K   14G   1% /var/snap
rpool/var/lib/docker    14G  256K   14G   1% /var/lib/docker
tmpfs                  1.6G     0  1.6G   0% /run/user/975
tmpfs                  1.6G     0  1.6G   0% /run/user/0

Knowing that zfs and df don't always play nice together, I kept on digging:

# zpool list
NAME    SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
dpool  19.5G   117M  19.4G        -         -     0%     0%  1.00x    ONLINE  -
rpool  17.5G  3.67G  13.8G        -         -     2%    20%  1.00x    ONLINE  -

# zfs list
NAME                    USED  AVAIL     REFER  MOUNTPOINT
dpool                  84.3M  13.6G      279K  /
dpool/DATA             81.1M  13.6G      279K  none
dpool/DATA/home        80.8M  13.6G      279K  /home
dpool/DATA/home/nvz    80.1M  13.6G     80.1M  /home/nvz
dpool/DATA/home/root    453K  13.6G      453K  /root
rpool                  3.67G  13.3G      192K  /
rpool/ROOT             1.89G  13.3G      192K  none
rpool/ROOT/arch        1.89G  13.3G     1.89G  /
rpool/opt               192K  13.3G      192K  /opt
rpool/srv               192K  13.3G      192K  /srv
rpool/usr               424K  13.3G      192K  /usr
rpool/usr/local         232K  13.3G      232K  /usr/local
rpool/var              1.78G  13.3G      192K  /var
rpool/var/cache        1.78G  13.3G     1.78G  /var/cache
rpool/var/games         192K  13.3G      192K  /var/games
rpool/var/lib           784K  13.3G      192K  /var/lib
rpool/var/lib/docker    192K  13.3G      192K  /var/lib/docker
rpool/var/lib/libvirt   192K  13.3G      192K  /var/lib/libvirt
rpool/var/lib/nfs       208K  13.3G      208K  /var/lib/nfs
rpool/var/log           368K  13.3G      368K  /var/log
rpool/var/snap          192K  13.3G      192K  /var/snap
rpool/var/spool         192K  13.3G      192K  /var/spool
rpool/var/tmp           256K  13.3G      256K  /var/tmp
rpool/var/www           192K  13.3G      192K  /var/www

I am perplexed. Even though I have plenty of disk space, pacman keeps telling me I'm out of space.

While researching, I came across this bug report:
https://bugs.archlinux.org/task/45070

I *think* I have the same issue, stat seems to be misreporting the actual free disk space.

# stat -f /
  File: "/"
    ID: 4abb04c0025efa3 Namelen: 255     Type: zfs
Block size: 131072     Fundamental block size: 131072
Blocks: Total: 124257     Free: 108780     Available: 108780
Inodes: Total: 27953838   Free: 27847856

According to the discussions in the bug tracker, the issue is related to ashift=12 / recordsize=128k. However, I have set ashift=13.

# zfs get recordsize rpool
NAME   PROPERTY    VALUE    SOURCE
rpool  recordsize  128K     default

# zpool get ashift rpool
NAME   PROPERTY  VALUE   SOURCE
rpool  ashift    13      local

Commenting out 'CheckSpace' in /etc/pacman.conf as suggested has allowed me to successfully install plasma for now. Output after install:

# df -h
Filesystem             Size  Used Avail Use% Mounted on
rpool/ROOT/arch         16G  5.1G   11G  34% /

# zpool list
NAME    SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
rpool  17.5G  6.88G  10.6G        -         -     3%    39%  1.00x    ONLINE  -

# zfs list
NAME                                              USED  AVAIL     REFER  MOUNTPOINT
rpool/ROOT/arch                                  5.09G  10.1G     5.07G  /

# stat -f /
  File: "/"
    ID: 4abb04c0025efa3 Namelen: 255     Type: zfs
Block size: 131072     Fundamental block size: 131072
Blocks: Total: 124075     Free: 82511      Available: 82511
Inodes: Total: 21404049   Free: 21122832

I still believe this to be a bug, though, but am unsure of how to proceed. Can someone please provide further input? Maybe I'm just missing something obvious.

Cheers,
pop

Arch Linux

#1 2020-05-04 22:28:56

root on zfs, pacman error: partition / too full

Board footer