You are not logged in.
- Topics: Active | Unanswered
#1 2024-06-28 19:24:49
- Mrkd1904
- Member
- Registered: 2023-11-08
- Posts: 64
Is anyone else having zstd decompression/checksum issues?
Hello,
I recently wiped and reinstalled Arch by hand; and starting from the install process (pacstrap'd, partioned by hand due to mdadm and lvm) I've been having zstd decompression issues via checksum mismatches during decompression on kernel modules for initramfs and as well as at install with pacman, making install and now configuration of the system a pain to say the least.
The issues with package installs is usually a random files such as:
dcd998d09d9819ff4d28163ab3e7cc35a05fa7cfd5b8b662a4df7d1a6422ee34 /home/LICENSE
a1d808f025dd890e406822d37a05896fcbc5cbee39e2ea23b308db39561a3e2e /home/NotoTraditionalNushu-Regular.ttf
e3d368fe0e76700da5d22a44709fffc20b10f89f3af3c8efd2f4dde42f0cc088 /home/README.md
a08e4127dad8845410bd7e7fb71d7bb4ac9e8daca468b81ecb29febaaa1f9e5b /home/analyzeHeadlessREADME.html
bb1f44fd2b33d77d43d41345c2f1b0268ab6744cfc2260ec8328f88dac9effa3 /home/jdeps-openjdk11.1.gz
7b5fccacb291b8843161120bd7603c5e569073c82923a8335baae04b493c19b4 /home/libQt6WebEngineCore.so.6
ba0101854f00913445791b3f5792518533e5967bade3cc04eea04523fd25f0ff /home/libgomp.info.gz
4009b4f9006c85e506bbd7b71f759bf973b40dc9da04865135fad7fe8317c7e2 /home/llvm-LICENSE
522bb5c8429928819ed824837462542ca5293786ae9bd152ce44867f4eae9235 /home/searchindex.js
8a446d50ed61abb570e50fa50bc20676105eb26e9ccabc9201002f8ea1dd660e /home/v8_context_snapshot.bin
ccf73465e41bb5529d40ef47aa53f93c1fa0eca3c531abdbb6d5bd250970a974 /home/vmlinux
9190fa0f44f32c7d14de6a9da31c2144faa3ecfa05f94b3d83797ed60e24bffe /home/zh-TW.pakthat are failing checksum verification at install thus stopping the install process (which i appreciate, btw). And I was wondering if anyone else is seeing these as well? The system is fresh, so as I'm concerned is up to date (installed less than 24hrs ago). I have a slew of strace's I took during attempted installation last night if anyone is interested.
Mods: if this is in the wrong subforum please excuse me and relocate if needed.
Thanks in advance
Offline
#2 2024-06-28 19:42:25
- Trilby
- Inspector Parrot
- Registered: 2011-11-29
- Posts: 30,341
- Website
Re: Is anyone else having zstd decompression/checksum issues?
The issues with package installs is usually a random files such as:...
What is all that from?? You're showing checksums of files under your home directory - packages do not contain anything under /home/.
Post the actual commands and complete output that are problematic.
"UNIX is simple and coherent" - Dennis Ritchie; "GNU's Not Unix" - Richard Stallman
Offline
#3 2024-06-28 20:11:58
- WorMzy
- Administrator
- From: Scotland
- Registered: 2010-06-16
- Posts: 12,645
- Website
Re: Is anyone else having zstd decompression/checksum issues?
Mod note: moving to NC.
Sakura:-
Mobo: MSI MAG X570S TORPEDO MAX // Processor: AMD Ryzen 9 5950X @4.9GHz // GFX: AMD Radeon RX 5700 XT // RAM: 32GB (4x 8GB) Corsair DDR4 (@ 3000MHz) // Storage: 1x 3TB HDD, 6x 1TB SSD, 2x 120GB SSD, 1x 275GB M2 SSD
Making lemonade from lemons since 2015.
Offline
#4 2024-06-28 23:54:14
- Mrkd1904
- Member
- Registered: 2023-11-08
- Posts: 64
Re: Is anyone else having zstd decompression/checksum issues?
Mrkd1904 wrote:The issues with package installs is usually a random files such as:...
What is all that from?? You're showing checksums of files under your home directory - packages do not contain anything under /home/.
Post the actual commands and complete output that are problematic.
Those are the files that failed their checksum during install. I had removed them and moved them to my /home partition so I could continue installing and investigate the files itself.
But.
When running kernel-install
[mrkd@archlinux ~]$ sudo kernel-install add-all
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: failed to load symbols from /lib/modules/6.9.7-arch1-1/kernel/sound/soc/codecs/snd-soc-rt700.ko.zst: Exec format error
/usr/lib/kernel/install.d/50-depmod.install terminated by signal SEGV.
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
depmod: ERROR: zstd: Restored data doesn't match checksum
==> Starting build: '6.9.7-hardened1-1-hardened'
-> Running build hook: [base]
-> Running build hook: [udev]
-> Running build hook: [autodetect]
-> Running build hook: [microcode]
-> Running build hook: [modconf]
-> Running build hook: [kms]
-> Running build hook: [keyboard]
==> WARNING: Possibly missing firmware for module: 'xhci_pci'
-> Running build hook: [keymap]
-> Running build hook: [consolefont]
==> WARNING: consolefont: no font found in configuration
-> Running build hook: [sd-encrypt]
==> WARNING: Possibly missing firmware for module: 'qat_420xx'
/usr/lib/initcpio/functions: line 516: add_systemd_unit: command not found
/usr/lib/initcpio/functions: line 516: add_systemd_unit: command not found
/usr/lib/initcpio/functions: line 516: add_systemd_unit: command not found
-> Running build hook: [mdadm_udev]
Custom /etc/mdadm.conf file will be used in initramfs for assembling arrays.
-> Running build hook: [block]
-> Running build hook: [filesystems]
-> Running build hook: [lvm2]
-> Running build hook: [fsck]
==> Generating module dependencies
==> Decompressing zstd-compressed firmware files
-> Fixing firmware file symlinks
==> Creating lzma-compressed initcpio image: '/tmp/kernel-install.staging.gyE4eU/initrd'
==> Initcpio image generation successful
[mrkd@archlinux ~]$ And after running
sudo pacman -Qq > pacman.txtto try and reinstall all since some libraries are seemingly missing.
[mrkd@archlinux ~]$sudo pacman -S $(cat pacman.txt)Removed package list to get it to fit in the post.
::Proceed with installation? [Y/n]
(1029/1029) checking keys in keyring [######################################################] 100%
(1029/1029) checking package integrity [######################################################] 100%
(1029/1029) loading package files [######################################################] 100%
(1029/1029) checking for file conflicts [######################################################] 100%
(1029/1029) checking available disk space [######################################################] 100%
warning: could not get file information for usr/lib/pkgconfig/aom.pc
warning: could not get file information for usr/share/licenses/aom/LICENSE
warning: could not get file information for usr/share/licenses/aom/PATENTS
warning: could not get file information for usr/share/doc/ClamAV/html/searchindex.js
warning: could not get file information for usr/share/doc/ClamAV/html/sitemap.xml
warning: could not get file information for usr/share/doc/ClamAV/html/theme-dawn.js
warning: could not get file information for usr/share/doc/ClamAV/html/theme-tomorrow_night.js
warning: could not get file information for usr/share/doc/ClamAV/html/tomorrow-night.css
warning: could not get file information for usr/share/man/man1/clambc.1.gz
warning: could not get file information for usr/share/man/man1/clamconf.1.gz
warning: could not get file information for usr/share/man/man1/clamdscan.1.gz
warning: could not get file information for usr/share/man/man1/clamdtop.1.gz
warning: could not get file information for usr/share/man/man1/clamscan.1.gz
warning: could not get file information for usr/share/man/man1/clamsubmit.1.gz
warning: could not get file information for usr/share/man/man1/freshclam.1.gz
warning: could not get file information for usr/share/man/man1/sigtool.1.gz
warning: could not get file information for usr/share/man/man5/clamav-milter.conf.5.gz
warning: could not get file information for usr/share/man/man5/clamd.conf.5.gz
warning: could not get file information for usr/share/man/man5/freshclam.conf.5.gz
warning: could not get file information for usr/share/man/man8/clamav-milter.8.gz
warning: could not get file information for usr/share/man/man8/clamd.8.gz
warning: could not get file information for usr/share/man/man8/clamonacc.8.gz
warning: could not get file information for usr/share/perl5/core_perl/warnings/
warning: could not get file information for usr/share/perl5/core_perl/warnings/register.pm
warning: could not get file information for usr/share/perl5/site_perl/
warning: could not get file information for usr/share/fonts/noto/NotoTraditionalNushu-Regular.ttf
warning: could not get file information for usr/share/fonts/noto/NotoZnamennyMusicalNotation-Regular.ttf
warning: could not get file information for usr/share/licenses/noto-fonts/
warning: could not get file information for usr/share/licenses/noto-fonts/LICENSE
warning: could not get file information for usr/share/qt6/translations/qtwebengine_locales/zh-TW.pak
warning: could not get file information for usr/share/doc/dnsx/README.md
warning: could not get file information for usr/share/man/man1/jdeps-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/jinfo-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/jjs-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/jmap-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/jps-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/jrunscript-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/jstack-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/jstat-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/jstatd-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/keytool-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/pack200-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/rmic-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/rmid-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/rmiregistry-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/serialver-openjdk11.1.gz
warning: could not get file information for usr/share/man/man1/unpack200-openjdk11.1.gz
:: Processing package changes...
( 1/1029) reinstalling linux-api-headers [######################################################] 100%
( 2/1029) reinstalling tzdata [######################################################] 100%
( 3/1029) reinstalling iana-etc [######################################################] 100%
( 4/1029) reinstalling filesystem [######################################################] 100%
warning: directory permissions differ on /root/
filesystem: 700 package: 750
( 5/1029) reinstalling glibc [######################################################] 100%
Generating locales...
Generation complete.
( 6/1029) reinstalling a52dec [######################################################] 100%
( 7/1029) reinstalling gcc-libs [######################################################] 100%
( 8/1029) reinstalling ncurses [######################################################] 100%
( 9/1029) reinstalling readline [######################################################] 100%
( 10/1029) reinstalling bash [######################################################] 100%
( 11/1029) reinstalling gtest [######################################################] 100%
( 12/1029) reinstalling abseil-cpp [######################################################] 100%
( 13/1029) reinstalling libffi [######################################################] 100%
( 14/1029) reinstalling libsysprof-capture [######################################################] 100%
( 15/1029) reinstalling bzip2 [######################################################] 100%
( 16/1029) reinstalling zlib [######################################################] 100%
( 17/1029) reinstalling pcre2 [######################################################] 100%
( 18/1029) reinstalling sqlite [######################################################] 100%
( 19/1029) reinstalling util-linux-libs [######################################################] 100%
( 20/1029) reinstalling glib2 [######################################################] 100%
( 21/1029) reinstalling icu [######################################################] 100%
( 22/1029) reinstalling xz [######################################################] 100%
( 23/1029) reinstalling libxml2 [######################################################] 100%
( 24/1029) reinstalling libaccounts-glib [######################################################] 100%
( 25/1029) reinstalling brotli [######################################################] 100%
( 26/1029) reinstalling e2fsprogs [######################################################] 100%
( 27/1029) reinstalling gdbm [######################################################] 100%
( 28/1029) reinstalling openssl [######################################################] 100%
( 29/1029) reinstalling libsasl [######################################################] 100%
( 30/1029) reinstalling libldap [######################################################] 100%
( 31/1029) reinstalling keyutils [######################################################] 100%
( 32/1029) reinstalling libevent [######################################################] 100%
( 33/1029) reinstalling libverto [######################################################] 100%
( 34/1029) reinstalling krb5 [######################################################] 100%
( 35/1029) reinstalling libcap-ng [######################################################] 100%
( 36/1029) reinstalling audit [######################################################] 100%
( 37/1029) reinstalling expat [######################################################] 100%
( 38/1029) reinstalling libtirpc [######################################################] 100%
( 39/1029) reinstalling pambase [######################################################] 100%
( 40/1029) reinstalling libxcrypt [######################################################] 100%
( 41/1029) reinstalling libnsl [######################################################] 100%
( 42/1029) reinstalling pam [######################################################] 100%
( 43/1029) reinstalling libcap [######################################################] 100%
( 44/1029) reinstalling libgpg-error [######################################################] 100%
( 45/1029) reinstalling libgcrypt [######################################################] 100%
( 46/1029) reinstalling lz4 [######################################################] 100%
( 47/1029) reinstalling zstd [######################################################] 100%
( 48/1029) reinstalling systemd-libs [######################################################] 100%
( 49/1029) reinstalling dbus [######################################################] 100%
( 50/1029) reinstalling double-conversion [######################################################] 100%
( 51/1029) reinstalling libpng [######################################################] 100%
( 52/1029) reinstalling graphite [######################################################] 100%
( 53/1029) reinstalling harfbuzz [######################################################] 100%
( 54/1029) reinstalling freetype2 [######################################################] 100%
( 55/1029) reinstalling fontconfig [######################################################] 100%
Rebuilding fontconfig cache...
( 56/1029) reinstalling libb2 [######################################################] 100%
( 57/1029) reinstalling gmp [######################################################] 100%
( 58/1029) reinstalling libtasn1 [######################################################] 100%
( 59/1029) reinstalling nettle [######################################################] 100%
( 60/1029) reinstalling libp11-kit [######################################################] 100%
( 61/1029) reinstalling libunistring [######################################################] 100%
( 62/1029) reinstalling libidn2 [######################################################] 100%
( 63/1029) reinstalling gnutls [######################################################] 100%
( 64/1029) reinstalling libdaemon [######################################################] 100%
( 65/1029) reinstalling avahi [######################################################] 100%
( 66/1029) reinstalling libcups [######################################################] 100%
( 67/1029) reinstalling libpciaccess [######################################################] 100%
( 68/1029) reinstalling libdrm [######################################################] 100%
( 69/1029) reinstalling xcb-proto [######################################################] 100%
( 70/1029) reinstalling xorgproto [######################################################] 100%
( 71/1029) reinstalling libxdmcp [######################################################] 100%
( 72/1029) reinstalling libxau [######################################################] 100%
( 73/1029) reinstalling libxcb [######################################################] 100%
( 74/1029) reinstalling libx11 [######################################################] 100%
( 75/1029) reinstalling libxext [######################################################] 100%
( 76/1029) reinstalling acl [######################################################] 100%
( 77/1029) reinstalling attr [######################################################] 100%
( 78/1029) reinstalling coreutils [######################################################] 100%
( 79/1029) reinstalling findutils [######################################################] 100%
( 80/1029) reinstalling p11-kit [######################################################] 100%
( 81/1029) reinstalling ca-certificates-utils [######################################################] 100%
( 82/1029) reinstalling ca-certificates-mozilla [######################################################] 100%
( 83/1029) reinstalling ca-certificates [######################################################] 100%
( 84/1029) reinstalling libnghttp2 [######################################################] 100%
( 85/1029) reinstalling libnghttp3 [######################################################] 100%
( 86/1029) reinstalling libpsl [######################################################] 100%
( 87/1029) reinstalling libssh2 [######################################################] 100%
( 88/1029) reinstalling curl [######################################################] 100%
( 89/1029) reinstalling libelf [######################################################] 100%
( 90/1029) reinstalling libxfixes [######################################################] 100%
( 91/1029) reinstalling libxshmfence [######################################################] 100%
( 92/1029) reinstalling libxxf86vm [######################################################] 100%
( 93/1029) reinstalling libedit [######################################################] 100%
( 94/1029) reinstalling llvm-libs [######################################################] 100%
( 95/1029) reinstalling lm_sensors [######################################################] 100%
( 96/1029) reinstalling default-cursors [######################################################] 100%
( 97/1029) reinstalling wayland [######################################################] 100%
( 98/1029) reinstalling libomxil-bellagio [######################################################] 100%
( 99/1029) reinstalling mesa [######################################################] 100%
( 100/1029) reinstalling libglvnd [######################################################] 100%
( 101/1029) reinstalling libice [######################################################] 100%
( 102/1029) reinstalling mtdev [######################################################] 100%
( 103/1029) reinstalling libevdev [######################################################] 100%
( 104/1029) reinstalling device-mapper [######################################################] 100%
( 105/1029) reinstalling popt [######################################################] 100%
( 106/1029) reinstalling json-c [######################################################] 100%
( 107/1029) reinstalling argon2 [######################################################] 100%
( 108/1029) reinstalling cryptsetup [######################################################] 100%
( 109/1029) reinstalling dbus-broker [######################################################] 100%
( 110/1029) reinstalling dbus-broker-units [######################################################] 100%
( 111/1029) reinstalling kbd [######################################################] 100%
( 112/1029) reinstalling kmod [######################################################] 100%
( 113/1029) reinstalling hwdata [######################################################] 100%
( 114/1029) reinstalling libseccomp [######################################################] 100%
( 115/1029) reinstalling file [######################################################] 100%
( 116/1029) reinstalling shadow [######################################################] 100%
( 117/1029) reinstalling util-linux [######################################################] 100%
( 118/1029) reinstalling systemd [######################################################] 100%
( 119/1029) reinstalling libgudev [######################################################] 100%
( 120/1029) reinstalling libwacom [######################################################] 100%
( 121/1029) reinstalling libinput [######################################################] 100%
( 122/1029) reinstalling libjpeg-turbo [######################################################] 100%
( 123/1029) reinstalling duktape [######################################################] 100%
( 124/1029) reinstalling libproxy [######################################################] 100%
( 125/1029) reinstalling libsm [######################################################] 100%
( 126/1029) reinstalling xkeyboard-config [######################################################] 100%
( 127/1029) reinstalling libxkbcommon [######################################################] 100%
( 128/1029) reinstalling libxkbcommon-x11 [######################################################] 100%
( 129/1029) reinstalling md4c [######################################################] 100%
( 130/1029) reinstalling shared-mime-info [######################################################] 100%
( 131/1029) reinstalling tslib [######################################################] 100%
( 132/1029) reinstalling vulkan-headers [######################################################] 100%
( 133/1029) reinstalling xcb-util-renderutil [######################################################] 100%
( 134/1029) reinstalling xcb-util [######################################################] 100%
( 135/1029) reinstalling xcb-util-image [######################################################] 100%
( 136/1029) reinstalling xcb-util-cursor [######################################################] 100%
( 137/1029) reinstalling xcb-util-keysyms [######################################################] 100%
( 138/1029) reinstalling xcb-util-wm [######################################################] 100%
( 139/1029) reinstalling libxt [######################################################] 100%
( 140/1029) reinstalling libxmu [######################################################] 100%
( 141/1029) reinstalling xorg-xset [######################################################] 100%
( 142/1029) reinstalling xorg-xprop [######################################################] 100%
( 143/1029) reinstalling xdg-utils [######################################################] 100%
( 144/1029) reinstalling qt6-translations [######################################################] 100%
( 145/1029) reinstalling qt6-base [######################################################] 100%
( 146/1029) reinstalling libaccounts-qt [######################################################] 100%
( 147/1029) reinstalling qt6-declarative [######################################################] 100%
error: could not extract /usr/lib/qt6/qmltyperegistrar (Zstd decompression failed: Restored data doesn't match checksum)
error: problem occurred while upgrading qt6-declarative
error: could not commit transaction
error: failed to commit transaction (transaction aborted)
Errors occurred, no packages were upgraded.
[mrkd@archlinux ~]$ Offline
#5 2024-06-29 07:14:18
- seth
- Member
- Registered: 2012-09-03
- Posts: 61,640
Re: Is anyone else having zstd decompression/checksum issues?
If at this point you give the system a moment and try to "pacman -S qt6-declarative", do you end up w/ the same error?
md5sum /var/cache/pacman/pkg/qt6-declarative*If the package is ok it's either your CPU, RAM or disk.
Offline
#6 2024-06-29 13:26:48
- Mrkd1904
- Member
- Registered: 2023-11-08
- Posts: 64
Re: Is anyone else having zstd decompression/checksum issues?
If at this point you give the system a moment and try to "pacman -S qt6-declarative", do you end up w/ the same error?
md5sum /var/cache/pacman/pkg/qt6-declarative*If the package is ok it's either your CPU, RAM or disk.
Neg, installing the package explicitly worked fine.
I have originally attempted install on a gen5 NVMe, but thinking the issue was due to compatibility I moved it over to a Samsung 990 pro and it persisted. I've already run through three separate pairs of DDR5 with the same issues, BIOs is at stock.
Which leads me to: I'm using a 13900ks for cpu, and given the plethora of persistent issues, and the subsequent dart throwing Intel has tried to rectify said issues; I'm leaning more towards the cpu.
About a week ago I updated to the most recent BIOs on my board (Gigabyte Z790 Aorus Master X), and I guess one of the issues that Intel has finally uncovered was a flaw in their eTVB microcode lib/algorithm. Which was part of the reason why I labeled my post the way I did. Because if they changed something in the microcode that isn't sympotico with some of the compression libs I shouldn't be the only one running into this, if that new microcode has found its' way into Arch's repo by now. What's more likely is a mixture of the reactionary BIOs updates along with anything upstream trying to fix the issues.
Offline
#7 2024-06-29 14:59:40
- seth
- Member
- Registered: 2012-09-03
- Posts: 61,640
Re: Is anyone else having zstd decompression/checksum issues?
I'm leaning more towards the cpu.
Yes, also see https://www.radgametools.com/oodleintel.htm
Offline
#8 2024-06-29 18:27:35
- Mrkd1904
- Member
- Registered: 2023-11-08
- Posts: 64
Re: Is anyone else having zstd decompression/checksum issues?
I'm leaning more towards the cpu.
Yes, also see https://www.radgametools.com/oodleintel.htm
Solid article - Thank you for posting.
I attempted the workarounds stated in the article (which, ironically move away from the "default settings" it originally recommends) to no avail. And further, that article was published in April, and Gigayte has published two BIOs since then trying to alleviate the problem. The last thing I want to do is RMA the cpu, for obvious reasons. But I'll keep my ear to the ground to see if anyone else has the same issues as I find it atypical that their "fix" is now breaking more hardware than fixing, or now rendering what were working cpu's to barely working cpu's. Does Arch pull in cpu microcode from the Linux repo or straight from Intel? I'd be interested to take a peek at the diff from the last couple commits to see what changed.
Thank you
Offline
#9 2024-06-29 22:07:31
- seth
- Member
- Registered: 2012-09-03
- Posts: 61,640
Re: Is anyone else having zstd decompression/checksum issues?
See the upstream URL of https://archlinux.org/packages/extra/any/intel-ucode/ - you can also try https://aur.archlinux.org/packages/intel-ucode-git
Can you downgrade the UEFI ansd see whether that stabilizes the situation?
Offline
#10 2024-07-01 12:56:34
- Mrkd1904
- Member
- Registered: 2023-11-08
- Posts: 64
Re: Is anyone else having zstd decompression/checksum issues?
See the upstream URL of https://archlinux.org/packages/extra/any/intel-ucode/ - you can also try https://aur.archlinux.org/packages/intel-ucode-git
Can you downgrade the UEFI ansd see whether that stabilizes the situation?
Interestingly enough the last commit, which was more than a month ago, only had a couple lines of code pertaining to Pentium processors. So, my suspicion is that there's some sort of mismatch with what Intel may have shipped to the motherboard manufacturers that hasn't squared with the software components downstream on Linux just yet.
I'm avoiding downgrading the UEFI as my motherboard (and most commercial motherboards still have) had a set of seven vulnerabilities at the UEFI level that were being actively targeted. That, paired with the fact that I also got back up on Windows on this machine and I haven't had it manifest the same issues even under benchmarking conditions, yet. I know it's nuanced, but if the CPU was bad as a piece of hardware on the system it should be manifesting regardless of OS, correct?
I'm also going to clone the intel-ucode-git aur repo to see if I can get a positive reaction and reach out to Intel and Gigabyte today to at least create a ticket and see if they have anything to add.
I appreciate your help, btw.
Thank you
Offline
#11 2024-07-01 14:28:09
- seth
- Member
- Registered: 2012-09-03
- Posts: 61,640
Re: Is anyone else having zstd decompression/checksum issues?
if the CPU was bad as a piece of hardware on the system it should be manifesting regardless of OS, correct?
The CPU isn't "a piece of hardware", the microdode patches patch out bugs of the HW 
Also access patterns/stress level (maybe temperature and voltage) matter (causing the non-deterministic behavior)
Have you tried to disable the spectre mitigations?
https://wiki.archlinux.org/title/Improv … itigations
Offline
#12 2024-07-01 17:40:39
- Mrkd1904
- Member
- Registered: 2023-11-08
- Posts: 64
Re: Is anyone else having zstd decompression/checksum issues?
if the CPU was bad as a piece of hardware on the system it should be manifesting regardless of OS, correct?
The CPU isn't "a piece of hardware", the microdode patches patch out bugs of the HW
Also access patterns/stress level (maybe temperature and voltage) matter (causing the non-deterministic behavior)Have you tried to disable the spectre mitigations?
https://wiki.archlinux.org/title/Improv … itigations
I have not. And hopefully it will not be necessary; It took a few (4) reboots, but cloning and then makepkg'ing the intel-ucode-git package seems to alleviate the teethy part of the issues. Or it could be a combination of the settings I've changed as well as the aur version of the ucode.
For future reference is anyone in the future stumbles across this, and take these all with a grain of salt since I'm unsure what the secret sauce actually was. But:
Disabled "Intel Default Settings"
Increased load line to turbo (for all three loadline calibrations)
Set VCORE to adaptive
Increased VCORE offset +.010
Increased ring offset +.010
Increased E core (atom) frequency to 45 across all cores (was 43)
Enabled AVX2 with an offset of 2
RAM at JEDEC
Enabled thermal protection
Enabled hyperthreading
Enabled undervolt protection
As well as a few other ancillary settings that are default on even by Intel's "default" settings, but I'm going to have to edit into this here when i remember or when i reboot to double check.
I've since been able to reinstall all packages and get through 7z benchmarks without decoding errors, as well as get through compressing initramfs without module decompression issues.
Hopefully I'm not taking a victory lap too soon; will update if this ends up just being a fluke.
Thanks again for the help.
Offline