You are not logged in.

#1 2020-11-07 07:23:37

bcarraghan
Member
Registered: 2018-05-26
Posts: 7

Occasional Hard Crash AMD RX 5700 XT

I'm trying to figure out why I am getting hard system crashes in games. It doesn't happen often -maybe once every couple days. Looking at the logs it looks like it is caused from the graphic card.

Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm] Skip scheduling IBs!
Nov 07 01:55:39 bjcdesktop01 kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* got no status for stream 000000009bf1113a on acrtc000000009b987b86
Nov 07 01:55:39 bjcdesktop01 kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* got no status for stream 000000002aafcaca on acrtc00000000f5b96baf
Nov 07 01:55:39 bjcdesktop01 kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* got no status for stream 000000009bf1113a on acrtc000000009b987b86
Nov 07 01:55:39 bjcdesktop01 kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* got no status for stream 000000002aafcaca on acrtc00000000f5b96baf
Nov 07 01:55:40 bjcdesktop01 kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* got no status for stream 000000009bf1113a on acrtc000000009b987b86
Nov 07 01:55:40 bjcdesktop01 kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* got no status for stream 000000002aafcaca on acrtc00000000f5b96baf
Nov 07 01:56:05 bjcdesktop01 kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* got no status for stream 000000009bf1113a on acrtc000000009b987b86
Nov 07 01:56:05 bjcdesktop01 kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* got no status for stream 000000002aafcaca on acrtc00000000f5b96baf
Nov 07 01:56:10 bjcdesktop01 kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* got no status for stream 000000009bf1113a on acrtc000000009b987b86
Nov 07 01:56:10 bjcdesktop01 kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* got no status for stream 000000002aafcaca on acrtc00000000f5b96baf
Nov 07 01:56:13 bjcdesktop01 systemd-logind[553]: Power key pressed.
Nov 07 01:56:13 bjcdesktop01 systemd-logind[553]: Powering Off...
Nov 07 01:56:13 bjcdesktop01 systemd-logind[553]: System is powering down.

As you can see there are amdgpu errors right before I was forced to push the power button.

Running mesa graphics drivers. (mesa, lib32-mesa, xf86-video-amdgpu, vulkan-radeon, lib32-vulkan-radeon, mesa-vdpau, lib32-mesa-vdpau)
xorg + xmonad (no displaymanager, running xorg under logged in user)
2 1440p monitors 144hz/75hz
Running latest kernel.

My monitor configuration:

Section "Monitor"
    Identifier  "HDMI-1"
    Modeline "2560x1440_144"  592.00  2560 2568 2600 2666  1440 1465 1473 1543 +hsync -vsync
    Option "PreferredMode" "2560x1440_144"
    Option "Primary" "true"
EndSection

Section "Monitor"
    Identifier "DP-1"
    Modeline "2560x1440_75"   295.12   2560 2568 2600 2640   1440 1478 1486 1492 +hsync -vsync
    Option "PreferredMode" "2560x1440_75"
    Option "Primary" "false"
    Option "RightOf" "HDMI-1"
EndSection

Just to note my "DP-1" monitor flickers after xorg starts for a few seconds.

Does anyone have any ideas on what might be causing this or where to begin looking for a resolution? Thanks!

Last edited by bcarraghan (2020-11-07 07:48:57)

Offline

#2 2020-11-10 16:45:48

totonebadass
Member
Registered: 2020-06-24
Posts: 6

Re: Occasional Hard Crash AMD RX 5700 XT

I'm getting drm:amdgpu_dm_atomic_commit_tail [amdgpu] crashes as well with my 5700XT, but my GPU recovers and gnome restarts.
I also have multiple monitors.

It usually happens while playing video (chrome - youtube, teams - while in call).

I've tried all fixes I could find, including : blacklisting intel i915 driver (my cpu has Intel® UHD Graphics 630 integrated graphics), messing with card power management (see arch amdgpu wiki page), disabling vsync, reducing refresh rate (one of my monitors supports 240Hz), enabled vulkan backend in chrome using flags. I haven't tried setting DRI level to 2

Nov 10 15:56:19 lenovo kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* Waiting for fences timed out!
Nov 10 15:56:19 lenovo kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* Waiting for fences timed out!
Nov 10 15:56:24 lenovo kernel: [drm:amdgpu_dm_atomic_commit_tail [amdgpu]] *ERROR* Waiting for fences timed out!
Nov 10 15:56:24 lenovo kernel: [drm:amdgpu_job_timedout [amdgpu]] *ERROR* ring gfx_0.0.0 timeout, but soft recovered
Nov 10 15:56:24 lenovo gnome-shell[2187]: [2902:2902:1110/155624.376274:ERROR:gpu_service_impl.cc(1129)] Exiting GPU process because some drivers can't recover from errors. GPU process will restart shortly.
Nov 10 15:56:24 lenovo gnome-shell[2187]: [9356:9356:1110/155624.528704:ERROR:sandbox_linux.cc(374)] InitializeSandbox() called with multiple threads in process gpu-process.
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE)
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) Backtrace:
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 0: /usr/lib/Xorg (xorg_backtrace+0x53) [0x55d8998b1bd3]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 1: /usr/lib/Xorg (0x55d89976b000+0x151a15) [0x55d8998bca15]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 2: /usr/lib/libc.so.6 (0x7f786a28f000+0x3d6a0) [0x7f786a2cc6a0]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 3: /usr/lib/dri/radeonsi_dri.so (0x7f7867dca000+0x8112b8) [0x7f78685db2b8]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 4: /usr/lib/dri/radeonsi_dri.so (0x7f7867dca000+0x822ca8) [0x7f78685ecca8]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 5: /usr/lib/dri/radeonsi_dri.so (0x7f7867dca000+0xaf762c) [0x7f78688c162c]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 6: /usr/lib/dri/radeonsi_dri.so (0x7f7867dca000+0xe37abf) [0x7f7868c01abf]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 7: /usr/lib/dri/radeonsi_dri.so (0x7f7867dca000+0xb0585c) [0x7f78688cf85c]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 8: /usr/lib/dri/radeonsi_dri.so (0x7f7867dca000+0x13c26f) [0x7f7867f0626f]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 9: /usr/lib/dri/radeonsi_dri.so (0x7f7867dca000+0x13cd93) [0x7f7867f06d93]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 10: /usr/lib/dri/radeonsi_dri.so (0x7f7867dca000+0x2d52cd) [0x7f786809f2cd]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 11: /usr/lib/dri/radeonsi_dri.so (0x7f7867dca000+0x2d537e) [0x7f786809f37e]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 12: /usr/lib/xorg/modules/libglamoregl.so (0x7f7869544000+0x23860) [0x7f7869567860]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 13: /usr/lib/xorg/modules/libglamoregl.so (0x7f7869544000+0x15350) [0x7f7869559350]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 14: /usr/lib/xorg/modules/libglamoregl.so (0x7f7869544000+0x186be) [0x7f786955c6be]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 15: /usr/lib/xorg/modules/libglamoregl.so (0x7f7869544000+0x1c20e) [0x7f786956020e]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 16: /usr/lib/Xorg (0x55d89976b000+0xc8b0f) [0x55d899833b0f]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 17: /usr/lib/xorg/modules/libglamoregl.so (0x7f7869544000+0x1da7f) [0x7f7869561a7f]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 18: /usr/lib/Xorg (0x55d89976b000+0xcfd88) [0x55d89983ad88]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 19: /usr/lib/Xorg (0x55d89976b000+0x3a165) [0x55d8997a5165]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 20: /usr/lib/libc.so.6 (__libc_start_main+0xf2) [0x7f786a2b7152]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) 21: /usr/lib/Xorg (_start+0x2e) [0x55d8997a55ae]
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE)
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) Segmentation fault at address 0x7f78586b8000
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE)
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: Fatal server error:
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) Caught signal 11 (Segmentation fault). Server aborting
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE)
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE)
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: Please consult the The X.Org Foundation support
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]:          at http://wiki.x.org
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]:  for help.
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE) Please also check the log file at "/home/octavian/.local/share/xorg/Xorg.1.log" for additional information.
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (EE)
Nov 10 15:56:24 lenovo /usr/lib/gdm-x-session[1273]: (II) AIGLX: Suspending AIGLX clients for VT switch
Nov 10 15:56:24 lenovo gdm-password][997]: pam_unix(gdm-password:session): session closed for user octavian
                                               #0  0x00007f78685c87b9 n/a (radeonsi_dri.so + 0x7fe7b9)
                                               #1  0x00007f78685dce8a n/a (radeonsi_dri.so + 0x812e8a)
                                               #2  0x00007f78685ee768 n/a (radeonsi_dri.so + 0x824768)
                                               #3  0x00007f78688c162c n/a (radeonsi_dri.so + 0xaf762c)
                                               #4  0x00007f7868c01abf n/a (radeonsi_dri.so + 0xe37abf)
                                               #5  0x00007f78688d2133 n/a (radeonsi_dri.so + 0xb08133)
                                               #6  0x00007f7867f1f547 n/a (radeonsi_dri.so + 0x155547)
                                               #7  0x00007f7867f1f600 n/a (radeonsi_dri.so + 0x155600)
                                               #8  0x00007f786a7d6181 n/a (amdgpu_drv.so + 0x1b181)
                                               #9  0x00007f786a7cc6d7 n/a (amdgpu_drv.so + 0x116d7)
                                               #16 0x00007f78685db2b8 n/a (radeonsi_dri.so + 0x8112b8)
                                               #17 0x00007f78685ecca8 n/a (radeonsi_dri.so + 0x822ca8)
                                               #18 0x00007f78688c162c n/a (radeonsi_dri.so + 0xaf762c)
                                               #19 0x00007f7868c01abf n/a (radeonsi_dri.so + 0xe37abf)
                                               #20 0x00007f78688cf85c n/a (radeonsi_dri.so + 0xb0585c)
                                               #21 0x00007f7867f0626f n/a (radeonsi_dri.so + 0x13c26f)
                                               #22 0x00007f7867f06d93 n/a (radeonsi_dri.so + 0x13cd93)
                                               #23 0x00007f786809f2cd n/a (radeonsi_dri.so + 0x2d52cd)
                                               #24 0x00007f786809f37e n/a (radeonsi_dri.so + 0x2d537e)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)
                                               #1  0x00007f786829e13c n/a (radeonsi_dri.so + 0x4d413c)
                                               #2  0x00007f786829e038 n/a (radeonsi_dri.so + 0x4d4038)

Offline

#3 2020-11-10 18:15:22

totonebadass
Member
Registered: 2020-06-24
Posts: 6

Re: Occasional Hard Crash AMD RX 5700 XT

Updated to mesa 20.2.2-2

If I still get crashes will create issue on https://gitlab.freedesktop.org/mesa/mesa/-/issues, since it looks like a mesa bug. Suggest the OP does the same.

Last edited by totonebadass (2020-11-10 18:16:00)

Offline

#4 2020-11-10 19:28:04

totonebadass
Member
Registered: 2020-06-24
Posts: 6

Re: Occasional Hard Crash AMD RX 5700 XT

It crashed again after updating to latest version....

Offline

#5 2020-11-10 20:50:18

Jan09
Member
Registered: 2020-11-10
Posts: 1

Re: Occasional Hard Crash AMD RX 5700 XT

Hello,

my system crashes too.

My mouse freez and the system is very very slow.

If I downgrade to Kernel 5.8.14-arch1-1 the system don't freez.

In my opinion it is the Kernel 5.9.x

Offline

#6 2020-11-12 04:30:40

totonebadass
Member
Registered: 2020-06-24
Posts: 6

Re: Occasional Hard Crash AMD RX 5700 XT

Jan09 wrote:

...
If I downgrade to Kernel 5.8.14-arch1-1 the system don't freez.

In my opinion it is the Kernel 5.9.x

Thanks for the suggestion , Jan09.
I will try your solution.

PS: I created a bug report with mesa: https://gitlab.freedesktop.org/mesa/mesa/-/issues/3784
PS2: I've just read some posts suggesting that kernel 5.9.x has some more issues (saw some usb / bluetooth mice that stopped working on 5.9). probably best to downgrade for now.

Last edited by totonebadass (2020-11-12 04:49:25)

Offline

#7 2020-11-12 07:21:20

totonebadass
Member
Registered: 2020-06-24
Posts: 6

Re: Occasional Hard Crash AMD RX 5700 XT

Downgrading doesn't help in my case, it happened again after downgrading.

Offline

#8 2021-01-19 01:17:38

frankyboy_
Member
Registered: 2014-10-27
Posts: 5

Re: Occasional Hard Crash AMD RX 5700 XT

nobody of posters stated mobo, after trying a lot of fixes i found fix that resolved my occasional hard crash with 5700xt. (my mobo is gigabyte x570)
i've switched in bios Settings > miscellaneous > pciex16 slot config & pcie slot config set to gen4
bios settings

p.s. current kernel parameters are amdgpu.ppfeaturemask=0xffffffff amdgpu.noretry=0 amdgpu.lockup_timeout=1000 amdgpu.gpu_recovery=1 amdgpu.audio=0, but i am testing atm without them and everything seems fine smile

Last edited by frankyboy_ (2021-01-19 01:19:31)

Offline

#9 2021-01-21 22:52:49

m6x
Member
From: Germany
Registered: 2020-04-01
Posts: 19

Re: Occasional Hard Crash AMD RX 5700 XT

I started getting these crashes and graphical glitches several days ago (errors: "amdgpu ring gfx timeout" using the "amdvlk" vulkan driver, or something with "parser -125" using the "radv" vulkan driver). Not sure which updated package is responsible that this started happening, I had no problems before. So I spent a few hours troubleshooting. After trying a ton of stuff with no results, I tried switching the kernel from the zen kernel which I used all the time to the regular Arch stable kernel (currently 5.10.9). And the problems disappeared. It's been a few days without crashes now. Usually, the crashes would happen a couple of minutes into any game. I don't know the underlying issue, but in case you have this problem as well and nothing works for you, try changing the kernel.

Last edited by m6x (2021-01-21 22:56:12)


int pi = 3;

Offline

#10 2021-02-24 20:01:09

entropie
Member
From: Germany
Registered: 2020-07-02
Posts: 11
Website

Re: Occasional Hard Crash AMD RX 5700 XT

I have been suffering from this problem for a month now. Switching the PCI-e slot to gen2 solved it for me now on my Vega 64. (Gen4 I dont have and Gen3 resulted in games not starting). Only downside is, I can start a game only once per boot, after that it will start but the game process will go to idle and nothing happens.

I tried different kernels and mesa versions, no chance. Maybe microcode related or something completly different.

Offline

Board footer

Powered by FluxBB