You are not logged in.

#1 2021-04-21 22:12:36

Bronek
Member
From: London
Registered: 2014-02-14
Posts: 116

clean-chroot-manager no longer able to find local packages

I use ccm to build a series of packages which depend on each other. These are my own version `zfs-utils` and `zfs-linux` (and also my own kernel packages). The way it used to work I would do

cd zfs-utils; sudo ccm s; cd ../zfs-linux; sudo ccm s

where `cd` gets me, via symlinks, to appropriate directories with `PKGBUILD` files. Since `zfs-linux` has a dependency on `zfs-utils` which is not a standard package, the latter ccm relies on zfs-utils stored in chroot_local (and produced by the former ccm). And this used to work, but now latter `ccm s` fails:

==> Making package: zfs-linux 2.0.4_5.11.16.1-1 (Wed Apr 21 22:47:16 2021)
==> Retrieving sources...
  -> Found zfs-2.0.4.tar.gz
==> Validating source files with sha256sums...
    zfs-2.0.4.tar.gz ... Passed
==> Making package: zfs-linux 2.0.4_5.11.16.1-1 (Wed 21 Apr 2021 10:47:20 PM BST)
==> Checking runtime dependencies...
==> Installing missing dependencies...
error: target not found: zfs-utils=2.0.4
error: target not found: linux=5.11.16-1
==> ERROR: 'pacman' failed to install missing dependencies.
==> Missing dependencies:
  -> kmod
  -> zfs-utils=2.0.4
  -> linux=5.11.16-1

I am sure the `zfs-utils` package is stored in the chroot_local; I just confirmed it with:

% sudo repo-add chroot_local.db.tar.gz zfs-utils-2.0.4-1-x86_64.pkg.tar.zst
==> Extracting chroot_local.db.tar.gz to a temporary location...
==> Extracting chroot_local.files.tar.gz to a temporary location...
==> Adding package 'zfs-utils-2.0.4-1-x86_64.pkg.tar.zst'
==> WARNING: An entry for 'zfs-utils-2.0.4-1' already existed
  -> Computing checksums...
  -> Removing existing entry 'zfs-utils-2.0.4-1'...
  -> Creating 'desc' db entry...
  -> Creating 'files' db entry...
==> Creating updated database file 'chroot_local.db.tar.gz'

Any ideas?

Last edited by Bronek (2021-04-21 22:13:05)

Offline

#2 2021-04-21 22:23:06

WorMzy
Forum Moderator
From: Scotland
Registered: 2010-06-16
Posts: 10,271
Website

Re: clean-chroot-manager no longer able to find local packages

Mod note: Moving to AUR Issues.


Sakura:-
Mobo: MSI X299 TOMAHAWK ARCTIC // Processor: Intel Core i7-7820X 3.6GHz // GFX: AMD Radeon RX 5700 XT // RAM: 32GB (4x 8GB) Corsair DDR4 (@ 3000MHz) // Storage: 1x 3TB HDD, 6x 1TB SSD, 2x 120GB SSD, 1x 275GB M2 SSD

Making lemonade from lemons since 2015.

Offline

#3 2021-04-21 22:39:37

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,237
Website

Re: clean-chroot-manager no longer able to find local packages

Are you using the current version?  You mind posting this to the github issue page rather than the bbs?


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#4 2021-04-22 08:24:28

Bronek
Member
From: London
Registered: 2014-02-14
Posts: 116

Re: clean-chroot-manager no longer able to find local packages

WorMzy wrote:

Mod note: Moving to AUR Issues.

Thank you.

graysky wrote:

Are you using the current version?  You mind posting this to the github issue page rather than the bbs?

Will do; I am using current version, i.e. 2.215-1. however I am not certain that's a ccm bug as-such; I see the same problem if I rollback to 2.212-1.

The most recent upgrades on my system (before this problem started) were:

[2021-04-17T10:01:25+0100] [ALPM] transaction started
[2021-04-17T10:01:25+0100] [ALPM] upgraded aom (3.0.0-1 -> 3.0.0-2)
[2021-04-17T10:01:25+0100] [ALPM] upgraded systemd-libs (248-4 -> 248-5)
[2021-04-17T10:01:25+0100] [ALPM] upgraded ca-certificates-mozilla (3.63-1 -> 3.64-1)
[2021-04-17T10:01:25+0100] [ALPM] upgraded fio (3.25-1 -> 3.26-1)
[2021-04-17T10:01:26+0100] [ALPM] upgraded systemd (248-4 -> 248-5)
[2021-04-17T10:01:31+0100] [ALPM] upgraded linux (5.11.14-1 -> 5.11.15-1)
[2021-04-17T10:01:38+0100] [ALPM] upgraded linux-lts (5.10.30-1 -> 5.10.31-1)
[2021-04-17T10:01:38+0100] [ALPM] upgraded nss (3.63-1 -> 3.64-1)
[2021-04-17T10:01:38+0100] [ALPM] upgraded systemd-sysvcompat (248-4 -> 248-5)
[2021-04-17T10:01:38+0100] [ALPM] upgraded vulkan-icd-loader (1.2.172-1 -> 1.2.174-2)
[2021-04-17T10:01:38+0100] [ALPM] upgraded zfs-linux (2.0.4_5.11.14.1-1 -> 2.0.4_5.11.15.1-1)
[2021-04-17T10:01:38+0100] [ALPM] upgraded zfs-linux-lts (2.0.4_5.10.30.1-1 -> 2.0.4_5.10.31.1-1)
[2021-04-17T10:01:38+0100] [ALPM] transaction completed

[2021-04-18T12:14:40+0100] [ALPM] transaction started
[2021-04-18T12:14:40+0100] [ALPM] upgraded icu (68.2-1 -> 69.1-1)
[2021-04-18T12:14:40+0100] [ALPM] upgraded boost-libs (1.75.0-2 -> 1.75.0-3)
[2021-04-18T12:14:41+0100] [ALPM] upgraded certbot (1.14.0-1 -> 1.14.0-2)
[2021-04-18T12:14:41+0100] [ALPM] upgraded harfbuzz (2.8.0-1 -> 2.8.0-3)
[2021-04-18T12:14:41+0100] [ALPM] upgraded libxml2 (2.9.10-8 -> 2.9.10-9)
[2021-04-18T12:14:41+0100] [ALPM] upgraded mtools (4.0.26-1 -> 4.0.27-1)
[2021-04-18T12:14:41+0100] [ALPM] upgraded oath-toolkit (2.6.6-1 -> 2.6.6-2)
[2021-04-18T12:14:41+0100] [ALPM] upgraded smbclient (4.14.2-1 -> 4.14.2-2)
[2021-04-18T12:14:41+0100] [ALPM] upgraded samba (4.14.2-1 -> 4.14.2-2)
[2021-04-18T12:14:41+0100] [ALPM] upgraded xfsprogs (5.11.0-1 -> 5.11.0-2)
[2021-04-18T12:14:41+0100] [ALPM] transaction completed

[2021-04-21T09:05:21+0100] [ALPM] transaction started
[2021-04-21T09:05:21+0100] [ALPM] upgraded libcups (1:2.3.3op2-2 -> 1:2.3.3op2-3)
[2021-04-21T09:05:22+0100] [ALPM] upgraded smbclient (4.14.2-2 -> 4.14.3-1)
[2021-04-21T09:05:22+0100] [ALPM] upgraded cifs-utils (6.13-1 -> 6.13-2)
[2021-04-21T09:05:22+0100] [ALPM] upgraded js78 (78.9.0-1 -> 78.10.0-1)
[2021-04-21T09:05:22+0100] [ALPM] upgraded libglvnd (1.3.2-1 -> 1.3.2-2)
[2021-04-21T09:05:22+0100] [ALPM] warning: /etc/nginx/nginx.conf installed as /etc/nginx/nginx.conf.pacnew
[2021-04-21T09:05:22+0100] [ALPM] upgraded nginx (1.18.0-2 -> 1.20.0-1)
[2021-04-21T09:05:22+0100] [ALPM] upgraded openssh (8.5p1-1 -> 8.6p1-1)
[2021-04-21T09:05:24+0100] [ALPM] upgraded plex-media-server-plexpass (1.22.2.4282-1 -> 1.22.3.4392-1)
[2021-04-21T09:05:24+0100] [ALPM] upgraded protobuf (3.15.7-1 -> 3.15.8-1)
[2021-04-21T09:05:24+0100] [ALPM] upgraded python-mock (3.0.5-5 -> 3.0.5-6)
[2021-04-21T09:05:24+0100] [ALPM] upgraded samba (4.14.2-2 -> 4.14.3-1)
[2021-04-21T09:05:25+0100] [ALPM] transaction completed

Of the above, my own builds are:

  • plex-media-server-plexpass

  • samba/smbclient

  • linux

  • linux-lts

  • zfs-utils

  • zfs-linux

  • zfs-linux-lts

Everything else coming from the official repos.

So far I tried, with no success:

  • sudo ccm S

  • sudo ccm n

  • pacman -U clean-chroot-manager-2.212-1-any.pkg.tar.zst (upgraded back to 2.215-1 since that did not help)

  • manually adding `[chroot_local]` entry in `chroot/root/etc/pacman.conf` (but I do not know how to do it right, since `Server=file:///repo` isn't working)

Offline

#5 2021-04-22 08:30:49

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,237
Website

Re: clean-chroot-manager no longer able to find local packages

Can you try v2.211?  This was before I introduced the external repo feature.  Remember to make sure your config file is in sync with /usr/share/clean-chroot-manager/ccm.skel


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#6 2021-04-22 09:12:42

Bronek
Member
From: London
Registered: 2014-02-14
Posts: 116

Re: clean-chroot-manager no longer able to find local packages

Thank you, that did not help.

% sudo ccm s 
----> Attempting to build package...
==> Synchronizing chroot copy [/pkgs/chroot/root] -> [bronekk]...done
:: Synchronizing package databases...         
 core                                                                                                                        131.5 KiB  3.21 MiB/s 00:00 [##############################################################################################] 100%
 extra                                                                                                                      1607.4 KiB  8.26 MiB/s 00:00 [##############################################################################################] 100%
 community                                                                                                                     5.5 MiB  8.30 MiB/s 00:01 [##############################################################################################] 100%
:: Starting full system upgrade...    
resolving dependencies...               
looking for conflicting packages...     
                                                               
Packages (1) libgcrypt-1.9.3-1
                                                               
Total Installed Size:  1.45 MiB
Net Upgrade Size:      0.04 MiB
                                                               
:: Proceed with installation? [Y/n]   
(1/1) checking keys in keyring                                                                                                                           [##############################################################################################] 100%
(1/1) checking package integrity                                                                                                                         [##############################################################################################] 100%
(1/1) loading package files                                                                                                                              [##############################################################################################] 100%
(1/1) checking for file conflicts                                                                                                                        [##############################################################################################] 100%
(1/1) checking available disk space                                                                                                                      [##############################################################################################] 100%
:: Processing package changes...                         
(1/1) upgrading libgcrypt                                                                                                                                [##############################################################################################] 100%
:: Running post-transaction hooks...                                                                                                                                                                                                                          
(1/1) Updating the info directory file...
==> Making package: zfs-linux 2.0.4_5.11.16.1-1 (Thu Apr 22 09:38:31 2021)
==> Retrieving sources...
  -> Found zfs-2.0.4.tar.gz
==> Validating source files with sha256sums...
    zfs-2.0.4.tar.gz ... Passed
==> Making package: zfs-linux 2.0.4_5.11.16.1-1 (Thu 22 Apr 2021 09:38:34 AM BST)
==> Checking runtime dependencies...
==> Installing missing dependencies...
error: target not found: zfs-utils=2.0.4
error: target not found: linux=5.11.16-1
==> ERROR: 'pacman' failed to install missing dependencies.
==> Missing dependencies:
  -> kmod
  -> zfs-utils=2.0.4
  -> linux=5.11.16-1
==> Checking buildtime dependencies...
==> Installing missing dependencies...
error: target not found: linux-headers=5.11.16-1
==> ERROR: 'pacman' failed to install missing dependencies.
==> Missing dependencies:
  -> linux-headers=5.11.16-1
==> ERROR: Could not resolve all dependencies.
==> ERROR: Build failed, check /pkgs/chroot/bronekk/build
sudo ccm s  7.75s user 1.73s system 96% cpu 9.836 total

% pacman -Qi clean-chroot-manager
Name            : clean-chroot-manager
Version         : 2.211-2
Description     : Wrapper for managing clean chroot builds with local repo therein.
Architecture    : any
URL             : https://github.com/graysky2/clean-chroot-manager
Licenses        : MIT
Groups          : None
Provides        : None
Depends On      : devtools>=20190821-1  rsync  libarchive>=3.3.3  pacman>=5.2
Optional Deps   : None
Required By     : None
Optional For    : None
Conflicts With  : clean_chroot_manager
Replaces        : clean_chroot_manager
Installed Size  : 28.41 KiB
Packager        : Bronek Kozicki <brok@redacted-for-github.com>
Build Date      : Thu 22 Apr 2021 09:37:25 BST
Install Date    : Thu 22 Apr 2021 09:37:50 BST
Install Reason  : Explicitly installed
Install Script  : Yes
Validated By    : None

% sudo ccm l 
==> Listing out packages in buildroot repo...
total 291M
-rw-r--r-- 1 root root  16K Apr 22 09:37 clean-chroot-manager-2.211-2-any.pkg.tar.zst
-rw-r--r-- 1 root root  16K Apr 22 09:37 clean-chroot-manager-2.215-1-any.pkg.tar.zst
-rw-r--r-- 1 root root  95M Apr 21 20:49 linux-5.11.16-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 root root  29M Apr 21 20:49 linux-docs-5.11.16-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 root root  30M Apr 21 20:49 linux-headers-5.11.16-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 root root  73M Apr 21 22:01 linux-lts-5.10.32-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 root root  29M Apr 21 22:01 linux-lts-docs-5.10.32-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 root root  30M Apr 21 22:01 linux-lts-headers-5.10.32-1-x86_64.pkg.tar.zst
-rw-r--r-- 1 root root 8.3M Apr 21 22:27 zfs-utils-2.0.4-1-x86_64.pkg.tar.zst

I think my `.config/clean-chroot-manager.conf` is sane:

% grep -Ev '^#' /home/bronekk/.config/clean-chroot-manager.conf
CHROOTPATH64=/pkgs/chroot
THREADS=6
PACKAGER="Bronek Kozicki <brok@redacted-for-github.com>"
CFLAGS="-march=core2 -mtune=intel -O2 -pipe -fstack-protector-strong --param=ssp-buffer-size=4 -fdiagnostics-color"
RUNNAMCAP=

I can see it being applied in `etc/makepkg.conf` under chroot:

% tail makepkg.conf
#
PKGEXT='.pkg.tar.zst'
SRCEXT='.src.tar.gz'
BUILDDIR=/build
PKGDEST=/pkgdest
SRCPKGDEST=/srcpkgdest
SRCDEST=/srcdest
LOGDEST=/logdest
MAKEFLAGS='-j6'
PACKAGER='Bronek Kozicki <brok@redacted-for-github.com>'

The `pacman.log` under chroot ends with:

[2021-04-22T09:38:28+0100] [PACMAN] Running 'pacman -Syuu --noconfirm'
[2021-04-22T09:38:28+0100] [PACMAN] synchronizing package lists
[2021-04-22T09:38:29+0100] [PACMAN] starting full system upgrade
[2021-04-22T09:38:29+0100] [ALPM] transaction started
[2021-04-22T09:38:29+0100] [ALPM] upgraded libgcrypt (1.9.2-1 -> 1.9.3-1)
[2021-04-22T09:38:29+0100] [ALPM] transaction completed
[2021-04-22T09:38:29+0100] [ALPM] running 'texinfo-install.hook'...
[2021-04-22T09:38:35+0100] [PACMAN] Running '/usr/bin/pacman --noconfirm -S --asdeps kmod zfs-utils=2.0.4 linux=5.11.16-1'
[2021-04-22T09:38:35+0100] [PACMAN] Running '/usr/bin/pacman --noconfirm -S --asdeps linux-headers=5.11.16-1'

Offline

#7 2021-04-24 16:52:28

Bronek
Member
From: London
Registered: 2014-02-14
Posts: 116

Re: clean-chroot-manager no longer able to find local packages

I am starting to think this is not a clean-chroot-manager bug. I tried on a second system and downgraded to ccm 2.103 (from Oct 2019) and can still see the problem:

% sudo ccm l
==> Listing out packages in buildroot repo...
total 8.3M
-rw-r--r-- 1 root root 8.3M Apr 24 11:48 zfs-utils-2.0.4-1-x86_64.pkg.tar.zst

% sudo ccm s
----> Attempting to build package...  
==> Synchronizing chroot copy [/home/bronekk/pkgs/.buildroot/root] -> [bronekk]...done
:: Synchronizing package databases...                                                                                                                                                                                                                         
 core is up to date                                                                                                                                                                                                                                           
 extra                                                                                                                      1601.3 KiB  7.11 MiB/s 00:00 [##############################################################################################] 100%
 community                                                                                                                     5.5 MiB  3.82 MiB/s 00:01 [##############################################################################################] 100%
:: Starting full system upgrade...                                                                                                                                                                                                                            
 there is nothing to do               
==> Making package: zfs-linux 2.0.4_5.11.16.arch1.1-1 (Sat Apr 24 17:17:50 2021)                                                                                                                                                                              
==> Retrieving sources...                                                                                                                                                                                                                                     
  -> Found zfs-2.0.4.tar.gz        
==> Validating source files with sha256sums...                 
    zfs-2.0.4.tar.gz ... Passed                                                                                                
==> Making package: zfs-linux 2.0.4_5.11.16.arch1.1-1 (Sat 24 Apr 2021 05:18:01 PM BST)
==> Checking runtime dependencies...
==> Installing missing dependencies...                         
error: target not found: zfs-utils=2.0.4
==> ERROR: 'pacman' failed to install missing dependencies.                                                                                                                                                                                                   
==> Missing dependencies:                                                                                                                                                                                                                                     
  -> kmod                                                                                                                                                                                                                                                     
  -> zfs-utils=2.0.4                                                                                                                                                                                                                                          
  -> linux=5.11.16.arch1-1                                                                                                                                                                                                                                    
==> Checking buildtime dependencies...                                                                                                                                                                                                                        
==> Installing missing dependencies...                                                                                                                                                                                                                        
resolving dependencies...                                                                                                                                                                                                                                     
looking for conflicting packages...                                                                                                                                                                                                                           
                                                               
Packages (4) libnsl-1.3.0-2  pahole-1.21-1  python-3.9.3-1  linux-headers-5.11.16.arch1-1
                                                                                                                               
Total Installed Size:  208.89 MiB
                                                                                                                               
:: Proceed with installation? [Y/n] 
(4/4) checking keys in keyring                                                                                                                           [##############################################################################################] 100%
(4/4) checking package integrity                                                                                                                         [##############################################################################################] 100%
(4/4) loading package files                                                                                                                              [##############################################################################################] 100%
(4/4) checking for file conflicts                                                                                                                        [##############################################################################################] 100%
(4/4) checking available disk space                                                                                                                      [##############################################################################################] 100%
:: Processing package changes...                                                                                                                                                                                                                              
(1/4) installing libnsl                                                                                                                                  [##############################################################################################] 100%
(2/4) installing python                                                                                                                                  [##############################################################################################] 100%
Optional dependencies for python                                                                                                                                                                                                                              
    python-setuptools                              
    python-pip                                
    sqlite [installed]                                                                                                         
    mpdecimal: for decimal            
    xz: for lzma [installed]                                                                                                   
    tk: for tkinter   
(3/4) installing pahole                                                                                                                                  [##############################################################################################] 100%
(4/4) installing linux-headers                                                                                                                           [##############################################################################################] 100%
==> ERROR: Could not resolve all dependencies.                                                                                 
==> ERROR: Build failed, check /home/bronekk/pkgs/.buildroot/bronekk/build                                                     
sudo ccm s  23.82s user 7.13s system 98% cpu 31.437 total

% pacman -Qo `which ccm`
/usr/bin/ccm is owned by clean-chroot-manager 2.103-1

Offline

#8 2021-04-24 17:53:23

Bronek
Member
From: London
Registered: 2014-02-14
Posts: 116

Re: clean-chroot-manager no longer able to find local packages

It's a clean-chroot-manager bug after all, should be easy to fix. The bug is not when building the second packages (one with dependencies) but the first one (dependency itself), and my investigation above looked at the wrong build.

Offline

#9 2021-04-24 19:02:31

graysky
Wiki Maintainer
From: :wq
Registered: 2008-12-01
Posts: 10,237
Website

Re: clean-chroot-manager no longer able to find local packages

Yes, should be fixed now.  Please use issue on github, bbs thread doesn't make sense since we're dialoging there.


CPU-optimized Linux-ck packages @ Repo-ck  • AUR packagesZsh and other configs

Offline

#10 2021-04-24 19:20:51

HalosGhost
Forum Moderator
From: Twin Cities, MN
Registered: 2012-06-22
Posts: 1,873
Website

Re: clean-chroot-manager no longer able to find local packages

Per graysky's request, closing this thread.

All the best,

-HG

Offline

Board footer

Powered by FluxBB