[SOLVED] Computer freezes, forgets all commands including ls, shutdown

arclyn · 2024-05-31 02:58:14

KDE 6 wayland user, Linux-Zen kernel.

Been having this problem for about a month where after a few hours of use, my machine suddenly becomes nonfunctional in a really weird way. Icons and images stop loading, the desktop background goes black, and eventually the whole system crashes and I have to hard reset.

It takes keyboard input during this time, but none of my shortcuts to open programs function. When I managed to have a terminal up during this, I couldn't run any commands - couldn't open a new firefox window, couldn't use ls, couldn't use shutdown. The only thing that seemed to work was echo. I tried seeing if something messed with my PATH, but echo $PATH showed there was no change, and reassigning PATH to the normal value didn't work either.

Trying to switch to another TTY just shows a black screen with an underscore in the top left. A login prompt never appears.

I tried reinstalling my OS but am running into the same problem immediately. There's not much installed on this new system, basically just plasma 6 and steam.

journalctl -b -1 isn't much help because whatever causes the system to explode also prevents any errors from being printed to the error log (trying to use that command myself just results in "bash: systemd-cat: command not found") and without any identifiable errors I'm pretty lost here.

I really like KDE and would prefer not to have to switch to another DE to use Arch. Any ideas where to look or what's going on?

Thanks in advance.

here's the last bit of my journal before the whole machine crashes, in case there's something here I missed.

May 30 08:36:00 LSTR-3 sudo[200407]:   arclyn : TTY=pts/2 ; PWD=/home/arclyn ; USER=root ; COMMAND=/usr/bin/pacman --sync --noconfirm -- extra/java-runtime-common extra/libnet extra/java-environment-common extra/jdk-openjdk
May 30 08:36:00 LSTR-3 sudo[200407]: pam_unix(sudo:session): session opened for user root(uid=0) by arclyn(uid=1000)
May 30 08:36:03 LSTR-3 pressure-vessel-adverb[200558]: setlocale "en_US.UTF-8": No such file or directory
May 30 08:36:03 LSTR-3 pressure-vessel-adverb[200558]: pressure-vessel-locale-gen: Missing locale en_US.UTF-8
May 30 08:36:03 LSTR-3 pressure-vessel-adverb[200558]: pressure-vessel-locale-gen: Generating locale en_US.UTF-8...
May 30 08:36:03 LSTR-3 pressure-vessel-adverb[200558]: pressure-vessel-locale-gen: Generated locale en_US.UTF-8 successfully
May 30 08:36:03 LSTR-3 pressure-vessel-adverb[200558]: W: Container startup will be faster if missing locales are created at OS level
May 30 08:36:06 LSTR-3 sudo[200407]: pam_unix(sudo:session): session closed for user root
May 30 08:36:06 LSTR-3 sudo[200735]:   arclyn : TTY=pts/2 ; PWD=/home/arclyn ; USER=root ; COMMAND=/usr/bin/pacman --database --asdeps -- java-runtime-common libnet java-environment-common jdk-openjdk
May 30 08:36:06 LSTR-3 sudo[200735]: pam_unix(sudo:session): session opened for user root(uid=0) by arclyn(uid=1000)
May 30 08:36:06 LSTR-3 sudo[200735]: pam_unix(sudo:session): session closed for user root
May 30 08:36:09 LSTR-3 pressure-vessel-adverb[201656]: setlocale "en_US.UTF-8": No such file or directory
May 30 08:36:09 LSTR-3 pressure-vessel-adverb[201656]: pressure-vessel-locale-gen: Missing locale en_US.UTF-8
May 30 08:36:09 LSTR-3 pressure-vessel-adverb[201656]: pressure-vessel-locale-gen: Generating locale en_US.UTF-8...
May 30 08:36:09 LSTR-3 pressure-vessel-adverb[201656]: pressure-vessel-locale-gen: Generated locale en_US.UTF-8 successfully
May 30 08:36:09 LSTR-3 pressure-vessel-adverb[201656]: W: Container startup will be faster if missing locales are created at OS level
May 30 08:36:11 LSTR-3 sudo[205523]:   arclyn : TTY=pts/2 ; PWD=/home/arclyn ; USER=root ; COMMAND=/usr/bin/pacman --upgrade --noconfirm -- /home/arclyn/.cache/paru/clone/jotasync/jotasync-0.4.1-1-any.pkg.tar.zst
May 30 08:36:11 LSTR-3 sudo[205523]: pam_unix(sudo:session): session opened for user root(uid=0) by arclyn(uid=1000)
May 30 08:36:11 LSTR-3 sudo[205523]: pam_unix(sudo:session): session closed for user root
May 30 08:36:12 LSTR-3 sudo[205533]:   arclyn : TTY=pts/2 ; PWD=/home/arclyn ; USER=root ; COMMAND=/usr/bin/pacman --database --asexplicit -- jotasync
May 30 08:36:12 LSTR-3 sudo[205533]: pam_unix(sudo:session): session opened for user root(uid=0) by arclyn(uid=1000)
May 30 08:36:12 LSTR-3 sudo[205533]: pam_unix(sudo:session): session closed for user root
May 30 08:36:12 LSTR-3 pressure-vessel-adverb[205472]: setlocale "en_US.UTF-8": No such file or directory
May 30 08:36:12 LSTR-3 pressure-vessel-adverb[205472]: pressure-vessel-locale-gen: Missing locale en_US.UTF-8
May 30 08:36:12 LSTR-3 pressure-vessel-adverb[205472]: pressure-vessel-locale-gen: Generating locale en_US.UTF-8...
May 30 08:36:12 LSTR-3 pressure-vessel-adverb[205472]: pressure-vessel-locale-gen: Generated locale en_US.UTF-8 successfully
May 30 08:36:12 LSTR-3 pressure-vessel-adverb[205472]: W: Container startup will be faster if missing locales are created at OS level
May 30 08:36:21 LSTR-3 pressure-vessel-adverb[205751]: setlocale "en_US.UTF-8": No such file or directory
May 30 08:36:21 LSTR-3 pressure-vessel-adverb[205751]: pressure-vessel-locale-gen: Missing locale en_US.UTF-8
May 30 08:36:21 LSTR-3 pressure-vessel-adverb[205751]: pressure-vessel-locale-gen: Generating locale en_US.UTF-8...
May 30 08:36:21 LSTR-3 pressure-vessel-adverb[205751]: pressure-vessel-locale-gen: Generated locale en_US.UTF-8 successfully
May 30 08:36:21 LSTR-3 pressure-vessel-adverb[205751]: W: Container startup will be faster if missing locales are created at OS level
May 30 08:36:58 LSTR-3 sudo[205950]:   arclyn : TTY=pts/2 ; PWD=/home/arclyn ; USER=root ; COMMAND=/usr/bin/pacman --sync -- extra/openjdk8-src extra/openjdk8-doc extra/java-atk-wrapper-openjdk8
May 30 08:36:58 LSTR-3 sudo[205950]: pam_unix(sudo:session): session opened for user root(uid=0) by arclyn(uid=1000)
May 30 08:37:06 LSTR-3 sudo[205950]: pam_unix(sudo:session): session closed for user root
May 30 08:38:04 LSTR-3 sudo[213725]:   arclyn : TTY=pts/2 ; PWD=/home/arclyn ; USER=root ; COMMAND=/usr/bin/pacman --upgrade --noconfirm -- /home/arclyn/.cache/paru/clone/jdk8-openj9-bin/jdk8-openj9-bin-8.u402.b06-1-x86_64.pkg.tar.zst
May 30 08:38:04 LSTR-3 sudo[213725]: pam_unix(sudo:session): session opened for user root(uid=0) by arclyn(uid=1000)
May 30 08:38:04 LSTR-3 sudo[213725]: pam_unix(sudo:session): session closed for user root
May 30 08:38:04 LSTR-3 sudo[213734]:   arclyn : TTY=pts/2 ; PWD=/home/arclyn ; USER=root ; COMMAND=/usr/bin/pacman --database --asexplicit -- jdk8-openj9-bin
May 30 08:38:04 LSTR-3 sudo[213734]: pam_unix(sudo:session): session opened for user root(uid=0) by arclyn(uid=1000)
May 30 08:38:04 LSTR-3 sudo[213734]: pam_unix(sudo:session): session closed for user root
May 30 08:38:26 LSTR-3 rtkit-daemon[963]: Supervising 7 threads of 5 processes of 1 users.
May 30 08:38:26 LSTR-3 rtkit-daemon[963]: Supervising 7 threads of 5 processes of 1 users.
May 30 08:38:26 LSTR-3 rtkit-daemon[963]: Supervising 7 threads of 5 processes of 1 users.
May 30 08:38:26 LSTR-3 rtkit-daemon[963]: Supervising 7 threads of 5 processes of 1 users.
May 30 08:38:33 LSTR-3 kwin_wayland_wrapper[199710]: [174.036] [PARSE ERROR] Unknown DCS escape code: zz
May 30 08:38:33 LSTR-3 kwin_wayland_wrapper[199710]: [174.036] [PARSE ERROR] Unknown CSI code: 'm' with start_modifier: '␀' and end_modifier: '%' and parameters: '0'
May 30 08:38:58 LSTR-3 kwin_wayland_wrapper[199710]: [198.805] [PARSE ERROR] The application is trying to use xterm's modifyOtherKeys. This is superseded by the kitty keyboard protocol: [url]https://sw.kovidgoyal.net/kitty/keyboard-protocol/[/url] the application should be updated to use that
May 30 08:38:58 LSTR-3 kwin_wayland_wrapper[199710]: [198.814] [PARSE ERROR] The application is trying to use xterm's modifyOtherKeys. This is superseded by the kitty keyboard protocol: [url]https://sw.kovidgoyal.net/kitty/keyboard-protocol/[/url] the application should be updated to use that
May 30 08:38:58 LSTR-3 kwin_wayland_wrapper[199710]: [198.814] [PARSE ERROR] The application is trying to use xterm's modifyOtherKeys. This is superseded by the kitty keyboard protocol: [url]https://sw.kovidgoyal.net/kitty/keyboard-protocol/[/url] the application should be updated to use that
May 30 08:39:14 LSTR-3 sudo[213972]:   arclyn : TTY=pts/2 ; PWD=/home/arclyn ; USER=root ; COMMAND=/usr/bin/pacman --sync -- rsync
May 30 08:39:14 LSTR-3 sudo[213972]: pam_unix(sudo:session): session opened for user root(uid=0) by arclyn(uid=1000)
May 30 08:39:15 LSTR-3 systemd[1]: Reloading requested from client PID 214005 ('systemctl') (unit user@1000.service)...
May 30 08:39:15 LSTR-3 systemd[1]: Reloading...
May 30 08:39:15 LSTR-3 systemd[1]: Reloading finished in 149 ms.
May 30 08:39:16 LSTR-3 sudo[213972]: pam_unix(sudo:session): session closed for user root
May 30 08:40:37 LSTR-3 NetworkManager[704]: <info>  [1717083637.8905] device (wlp5s0): set-hw-addr: set MAC address to 72:98:13:67:E6:E6 (scanning)
May 30 08:47:30 LSTR-3 NetworkManager[704]: <info>  [1717084050.8865] device (wlp5s0): set-hw-addr: set MAC address to BA:E2:8C:4B:89:52 (scanning)
May 30 08:54:23 LSTR-3 NetworkManager[704]: <info>  [1717084463.8896] device (wlp5s0): set-hw-addr: set MAC address to C2:BC:E6:AB:A6:EB (scanning)
May 30 08:57:24 LSTR-3 NetworkManager[704]: <info>  [1717084644.6173] dhcp6 (enp6s0): state changed new lease, address=2600:1700:38d5:48e0::2a
May 30 08:57:24 LSTR-3 systemd[1]: Starting Network Manager Script Dispatcher Service...
May 30 08:57:24 LSTR-3 systemd[1]: Started Network Manager Script Dispatcher Service.
May 30 08:57:34 LSTR-3 systemd[1]: NetworkManager-dispatcher.service: Deactivated successfully.
May 30 09:01:16 LSTR-3 NetworkManager[704]: <info>  [1717084876.8796] device (wlp5s0): set-hw-addr: set MAC address to C2:8B:57:67:3C:12 (scanning)
May 30 09:07:25 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket] Setting connection state to WILL_RECONNECT
May 30 09:07:25 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket] [WS CLOSED] (false, 1006, ) retrying in 2.38 seconds.
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket] Setting connection state to CONNECTING
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket] [CONNECT] wss://gateway-us-east1-c.discord.gg, encoding: json, version: 9, compression: zlib-stream
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket] [CONNECTED] wss://gateway-us-east1-c.discord.gg/?encoding=json&v=9&compress=zlib-stream in 134 ms
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket] Setting connection state to RESUMING
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket] [RESUME] resuming session 9ba48a6b76d189a67c0197aa98b98974, seq: 48469
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket] [HELLO] via
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] gateway-prd-us-east1-c-bn7x: 0, heartbeat interval: 41250, took 134 ms
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket]
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] gateway-prd-us-east1-c-bn7x: 6.006
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] |  id_created: 0
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] |  session_lookup_time: 2.34
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] |  session_lookup_finished: 0.01
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] |  discord-sessions-prd-1-119: 0.05
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket] Setting connection state to SESSION_ESTABLISHED
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [Flux] Dispatching CONNECTION_RESUMED
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [GatewayZstdStore] Attempting to enable zstd but it is not supported
May 30 09:07:28 LSTR-3 discord-screenaudio[23368]: [discord] [GatewaySocket] [RESUMED] took 248ms, replayed 0 events, new seq: 48474
May 30 09:08:09 LSTR-3 NetworkManager[704]: <info>  [1717085289.8846] device (wlp5s0): set-hw-addr: set MAC address to 22:DF:00:8A:D3:AA (scanning)
May 30 09:12:41 LSTR-3 discord-screenaudio[23368]: [discord] [HTTPUtils] rateLimitExpirationHandler: removing key for /users/@me/survey
May 30 09:15:02 LSTR-3 NetworkManager[704]: <info>  [1717085702.8876] device (wlp5s0): set-hw-addr: set MAC address to 2A:0F:36:CD:53:2D (scanning)
May 30 09:18:37 LSTR-3 rtkit-daemon[963]: Supervising 7 threads of 5 processes of 1 users.
May 30 09:18:37 LSTR-3 rtkit-daemon[963]: Supervising 7 threads of 5 processes of 1 users.
May 30 09:21:55 LSTR-3 NetworkManager[704]: <info>  [1717086115.8906] device (wlp5s0): set-hw-addr: set MAC address to 46:2A:6A:19:47:02 (scanning)
May 30 09:27:04 LSTR-3 NetworkManager[704]: <info>  [1717086424.2394] dhcp6 (enp6s0): state changed new lease, address=2600:1700:38d5:48e0::2a
May 30 09:27:04 LSTR-3 systemd[1]: Starting Network Manager Script Dispatcher Service...
May 30 09:27:04 LSTR-3 systemd[1]: Started Network Manager Script Dispatcher Service.
May 30 09:27:14 LSTR-3 systemd[1]: NetworkManager-dispatcher.service: Deactivated successfully.
May 30 09:28:48 LSTR-3 NetworkManager[704]: <info>  [1717086528.8836] device (wlp5s0): set-hw-addr: set MAC address to 42:9E:1B:97:46:69 (scanning)
May 30 09:33:07 LSTR-3 NetworkManager[704]: <info>  [1717086787.2459] dhcp4 (enp6s0): state changed new lease, address=192.168.1.64
May 30 09:33:07 LSTR-3 systemd[1]: Starting Network Manager Script Dispatcher Service...
May 30 09:33:07 LSTR-3 systemd[1]: Started Network Manager Script Dispatcher Service.
May 30 09:33:17 LSTR-3 systemd[1]: NetworkManager-dispatcher.service: Deactivated successfully.
May 30 09:35:41 LSTR-3 NetworkManager[704]: <info>  [1717086941.8806] device (wlp5s0): set-hw-addr: set MAC address to 6A:E9:3A:EC:61:46 (scanning)

Last edited by arclyn (2024-06-03 01:07:06)

seth · 2024-05-31 08:05:38

journalctl -b -1 isn't much help because whatever causes the system to explode also prevents any errors from being printed to the error log (trying to use that command myself just results in "bash: systemd-cat: command not found") and without any identifiable errors I'm pretty lost here.

Is "whatever" you, your finger and the power button?
=> https://wiki.archlinux.org/title/Keyboa … el_(SysRq)

However, you might also loose the root partition (disk IO errors or it's fallign off the bus)
Please post your complete system journal for the boot:

sudo journalctl -b | curl -F 'file=@-' 0x0.st

and ideally -1 after restarting w/ the sysrq.

If we're assuming your root partition bails, see https://wiki.archlinux.org/title/Solid_ … leshooting and https://wiki.archlinux.org/title/Power_ … Management
Since 6.9 a bunch of drives - in retrospect a bit overoptimistically - get med_power_with_dipm, there're a couple of threads itr.
Itr the LTS kernel would not be affected.

arclyn · 2024-05-31 20:01:05

Here's the log from boot: https://0x0.st/XNU6.txt

I saved an old full crash log (the full log for the snippet I posted earlier) so here's that: https://0x0.st/XNGq.txt

I set up the options to get SysRq rebooting working so I'll be able to do that next time the crash occurs, and I'll post that full log. I can't nail how to replicate it and it takes anywhere from 30 minutes to 6 hours to occur.

I recognize that hard-resetting is much worse than using SysRq but at the time it wasn't set up on the new install and while the last log is printed to the journal at 9:35, I didn't actually shut down the computer until about 16:00 that day - there really is something preventing logs from being printed to the journal besides my hard-reset.

seth · 2024-05-31 21:01:37

https://0x0.st/XNGq.txt is 229MB with an enourmous amount of dolphin/kio messages (concerning your files, I've not bothered to read through them, but they might expose sensitive information)

Filtering away dolphin and koko gets us a handy 2MB, you've zswap enabled but no swap to back it, an nvme but there're no errors, neither traces of disk, bus or OOM issues in that journal preserved. Unfortunately.

arclyn · 2024-06-01 02:15:43

journal after using sysrq to shut down: https://0x0.st/XNd2.txt

seth · 2024-06-01 06:28:47

The sysrq doesn't show up in the journal … you did the entier REISUB sequence w/ a short delay between the stages?
Or just straight up Alt+SysRq+b ?

You're able to switch the VT and use the sysrq, so the kernel responds - if the disk sync failed you're looking at an nvme issue - try to disable APST and usign the software IOMMU

arclyn · 2024-06-01 16:41:41

I did the whole REISUB sequence with about a 3-second gap between each keypress. After the GUI exited and I saw logs on my screen I did see that more logs were being printed to the console as I entered in the SUB portion of the sequence, but they didn't get printed to the journal. Next time I get a chance, I'll manually copy down the logs I see as I enter in REISUB and post them.

seth · 2024-06-01 18:43:00

seth wrote:

you're looking at an nvme issue - try to disable APST and using the software IOMMU hmm

nvme_core.default_ps_max_latency_us=0 iommu=soft

https://wiki.archlinux.org/title/Kernel_parameters
See whether that stabilizes the system.

arclyn · 2024-06-03 01:04:36

That seems to have stabilized it. Marking as solved.

Thanks for your help!

seth · 2024-06-03 06:45:05

See whether you can re-activate the IOMMU w/o crashing the system.

arclyn · 2024-06-05 06:40:23

system seems stable after removing `iommu=soft`

Arch Linux

#1 2024-05-31 02:58:14

[SOLVED] Computer freezes, forgets all commands including ls, shutdown

#2 2024-05-31 08:05:38

Re: [SOLVED] Computer freezes, forgets all commands including ls, shutdown

#3 2024-05-31 20:01:05

Re: [SOLVED] Computer freezes, forgets all commands including ls, shutdown

#4 2024-05-31 21:01:37

Re: [SOLVED] Computer freezes, forgets all commands including ls, shutdown

#5 2024-06-01 02:15:43

Re: [SOLVED] Computer freezes, forgets all commands including ls, shutdown

#6 2024-06-01 06:28:47

Re: [SOLVED] Computer freezes, forgets all commands including ls, shutdown

#7 2024-06-01 16:41:41

Re: [SOLVED] Computer freezes, forgets all commands including ls, shutdown

#8 2024-06-01 18:43:00

Re: [SOLVED] Computer freezes, forgets all commands including ls, shutdown

#9 2024-06-03 01:04:36

Re: [SOLVED] Computer freezes, forgets all commands including ls, shutdown

#10 2024-06-03 06:45:05

Re: [SOLVED] Computer freezes, forgets all commands including ls, shutdown

#11 2024-06-05 06:40:23

Re: [SOLVED] Computer freezes, forgets all commands including ls, shutdown

Board footer