Arch Linux

dakota

Member

Registered: 2016-05-20

Posts: 417

[SOLVED] Corrupted Packages after Upgrade

Rebooting after an upgrade stalls during the boot process.

pacman --root /mnt -Qkk | grep -v ', 0 altered files' > /tmp/howbadisit.txt
cat /tmp/howbadisit.txt | curl -F 'file=@-' 0x0.st # post the link you get and look at the file

list hundreds of packages with altered files: http://0x0.st/X05x.csv

What is the best approach moving forward?

Cheers,

------------------------------------------------------------------

Edits...

# pacman -Qikk systemd # chrooted
-------------------------------------------------------------------
Name            : systemd
Version         : 256.7-1
Description     : system and service manager
Architecture    : x86_64
URL             : https://www.github.com/systemd/systemd
Licenses        : LGPL-2.1-or-later  CC0-1.0  GPL-2.0-or-later  MIT-0
Groups          : None
Provides        : nss-myhostname  systemd-tools=256.7  udev=256.7
Depends On      : systemd-libs=256.7  acl  libacl.so=1-64  bash  cryptsetup  libcryptsetup.so=12-64  dbus  dbus-units  kbd  kmod  hwdata  libcap  libcap.so=2-64  libgcrypt  libxcrypt  libcrypt.so=2-64  libidn2  lz4  pam  libelf  libseccomp  libseccomp.so=2-64  util-linux  libblkid.so=1-64  libmount.so=1-64  xz  pcre2  audit  libaudit.so=1-64  openssl  libcrypto.so=3-64  libssl.so=3-64
Optional Deps   : libmicrohttpd: systemd-journal-gatewayd and systemd-journal-remote [installed]
                  quota-tools: kernel-level quota management
                  systemd-sysvcompat: symlink package to provide sysvinit binaries [installed]
                  systemd-ukify: combine kernel and initrd into a signed Unified Kernel Image
                  polkit: allow administration as unprivileged user [installed]
                  curl: systemd-journal-upload, machinectl pull-tar and pull-raw [installed]
                  gnutls: systemd-journal-gatewayd and systemd-journal-remote [installed]
                  qrencode: show QR codes
                  iptables: firewall features [installed]
                  libarchive: convert DDIs to tarballs [installed]
                  libbpf: support BPF programs [installed]
                  libpwquality: check password quality
                  libfido2: unlocking LUKS2 volumes with FIDO2 token
                  libp11-kit: support PKCS#11 [installed]
                  tpm2-tss: unlocking LUKS2 volumes with TPM2 [installed]
Required By     : base  colord  libcolord  libgudev  libpulse  mdadm  mkinitcpio  pacman  systemd-sysvcompat
Optional For    : None
Conflicts With  : nss-myhostname  systemd-tools  udev
Replaces        : nss-myhostname  systemd-tools  udev
Installed Size  : 32.46 MiB
Packager        : Christian Hesse <eworm@archlinux.org>
Build Date      : Tue Oct  8 08:47:49 2024
Install Date    : Wed Oct 30 07:36:29 2024
Install Reason  : Installed as a dependency for another package
Install Script  : Yes
Validated By    : Signature

systemd: 1547 total files, 1 altered file

Attempting next...

not chrooted
-------------------------------------------------------------------
pacman --root /mnt --cachedir /mnt/var/cache/pacman/pkg -Sy --dbonly $(pacman --root /mnt -Qnq)
pacman --root /mnt --cachedir /mnt/var/cache/pacman/pkg -S $(pacman --root /mnt -Qnq)

... needed to update the keyring first.

Now I've got...

$ sudo pacman -Qkk | grep -v ', 0 altered files' > /tmp/howbadisit.txt
-------------------------------------------------------------------
warning: intel-ucode: /boot/intel-ucode.img (Permissions mismatch)
warning: intel-ucode: /boot/intel-ucode.img (Modification time mismatch)
warning: libutempter: /usr/lib/utempter/utempter (GID mismatch)
warning: libutempter: /usr/lib/utempter/utempter (Permissions mismatch)
warning: mariadb: /usr/lib/mysql/plugin/auth_pam_tool_dir (UID mismatch)
warning: mariadb: /usr/lib/mysql/plugin/auth_pam_tool_dir (Permissions mismatch)
warning: nfs-utils: /var/lib/nfs/statd/state (UID mismatch)
warning: nfs-utils: /var/lib/nfs/statd/state (GID mismatch)
warning: nfs-utils: /var/lib/nfs/statd/state (Modification time mismatch)
warning: nfs-utils: /var/lib/nfs/statd/state (Size mismatch)
warning: nfs-utils: /var/lib/nfs/statd/state (SHA256 checksum mismatch)
warning: shadow: /usr/bin/groupmems (GID mismatch)
warning: shadow: /usr/bin/groupmems (Permissions mismatch)
warning: systemd: /var/log/journal (GID mismatch)

This all looks pretty normal, right?

I still can't boot into the system, but I think that video-related.

Thanks Seth!

Last edited by dakota (2024-10-30 17:52:22)

---

"Before Enlightenment chop wood, carry water. After Enlightenment chop wood, carry water." -- Zen proverb

seth

Member

From: Won't reply 2 private help req

Registered: 2012-09-03

Posts: 75,697

Re: [SOLVED] Corrupted Packages after Upgrade

This all looks pretty normal, right?

That's right.

I still can't boot into the system, but I think that video-related.

Do you have a system journal?
(Can you ssh into the system or reboot it w/ th https://wiki.archlinux.org/title/Keyboa … el_(SysRq) ?)
Can you boot the multi-user.target?

---

How to upload text · How to boot w/o GUI · Disable Windows Fast-Start! · Fix your xinitrc

dakota

Member

Registered: 2016-05-20

Posts: 417

Re: [SOLVED] Corrupted Packages after Upgrade

Once I got the file corruption sorted, I was able to ssh into the machine.

1. I looked at the journal. The only weird thing I saw were some nvidia errors about tainting the kernel. By that I mean that according to the journal there were no failed services and all tasks seemed to complete except the video.

2. I checked the video card. It's Pascal generation, so the latest driver should work.

3. I installed the lts kernel and nvidia-lts: no change.

4. SysRq is already enabled, and yes I can use that to reboot.

I really needed to get the machine up and running today, so I used the Arch Linux Archive to downgrade to:

        2024-10-15, same problem
        2024-10-01, same problem
        2024-09-11, the last successful upgrade, which is working now.

I'll remote-in tomorrow, grab copy of the journal, and start a new thread.

Cheers,

---

"Before Enlightenment chop wood, carry water. After Enlightenment chop wood, carry water." -- Zen proverb

seth

Member

From: Won't reply 2 private help req

Registered: 2012-09-03

Posts: 75,697

Re: [SOLVED] Corrupted Packages after Upgrade

nvidia errors about tainting the kernel

That's normal.

Add

nvidia_drm.modeset=1 nvidia_drm.fbdev=0

to the kernel parameters.
https://gitlab.archlinux.org/archlinux/ … 2115ec3e22

---

How to upload text · How to boot w/o GUI · Disable Windows Fast-Start! · Fix your xinitrc

dakota

Member

Registered: 2016-05-20

Posts: 417

Re: [SOLVED] Corrupted Packages after Upgrade

Thanks Seth.

I finally made it back onsite. On this particular machine, those kernel parameters worked and I was able to upgrade.

Cheers,

$ lspci -k -d ::03xx

21:00.0 VGA compatible controller: NVIDIA Corporation GP108 (GeForce GT 1030) (rev a1)
    Subsystem: eVga.com. Corp. Device 6336
    Kernel driver in use: nvidia
    Kernel modules: nouveau, nvidia_drm, nvidia

---

"Before Enlightenment chop wood, carry water. After Enlightenment chop wood, carry water." -- Zen proverb

seth

Member

From: Won't reply 2 private help req

Registered: 2012-09-03

Posts: 75,697

Re: [SOLVED] Corrupted Packages after Upgrade

Does it run the LTS kernel or 6.12?

---

How to upload text · How to boot w/o GUI · Disable Windows Fast-Start! · Fix your xinitrc

dakota

Member

Registered: 2016-05-20

Posts: 417

Re: [SOLVED] Corrupted Packages after Upgrade

6.12
(LTS is installed, but I did not test it.)

$ uname -a
------------------------------
Linux sascada 6.12.1-arch1-1 #1 SMP PREEMPT_DYNAMIC Fri, 22 Nov 2024 16:04:27 +0000 x86_64 GNU/Linux

$ sudo dmesg
------------------------------
[    0.000000] Linux version 6.12.1-arch1-1 (linux@archlinux) (gcc (GCC) 14.2.1 20240910, GNU ld (GNU Binutils) 2.43.0) #1 SMP PREEMPT_DYNAMIC Fri, 22 Nov 2024 16:04:27 +0000
[    0.000000] Command line: initrd=\intel-ucode.img initrd=\initramfs-linux.img root=/dev/md/array1 rw sysrq_always_enabled=1 nvidia_drm.modeset=1 nvidia_drm.fbdev=0

---

"Before Enlightenment chop wood, carry water. After Enlightenment chop wood, carry water." -- Zen proverb

seth

Member

From: Won't reply 2 private help req

Registered: 2012-09-03

Posts: 75,697

Re: [SOLVED] Corrupted Packages after Upgrade

Subsystem: eVga.com. Corp. Device 6336

External GPU? Is there an igp (intel or amd) that maybe take care of the simplydumb device?

---

How to upload text · How to boot w/o GUI · Disable Windows Fast-Start! · Fix your xinitrc

dakota

Member

Registered: 2016-05-20

Posts: 417

Re: [SOLVED] Corrupted Packages after Upgrade

External GPU? Is there an igp (intel or amd) that maybe take care of the simplydumb device?

I don't think so. How would I positively determine this?

I'm not onsite, so I can't look at the rear panel, but he online manual for the HP Z4 G4 workstation with a Xeon W-2102 2.9 GHz cpu does not show any video ports and specifically says "Integrated Graphics ... No" Also, the specs for the Xeon W-2102 don't mention integrated graphics.

Cheers,

---

"Before Enlightenment chop wood, carry water. After Enlightenment chop wood, carry water." -- Zen proverb

seth

Member

From: Won't reply 2 private help req

Registered: 2012-09-03

Posts: 75,697

Re: [SOLVED] Corrupted Packages after Upgrade

How would I positively determine this?

"lspci"
If not you need toe make extra super-duper sure that you're not currently on the simpledrm device (xorg log, glxinfo, …)

---

How to upload text · How to boot w/o GUI · Disable Windows Fast-Start! · Fix your xinitrc