Arch Linux

borillion

Member

Registered: 2022-01-03

Posts: 1

MSI-X570 Godlike motherboard & TB4 Card configuration problems

Having trouble getting my desktop Link : MEG-X570-GODLIKE and the thunderbolt 4 PCIe add-in card Link : Asus ThunderboltEX- 4 work together.

My intention is to enable the Thunderbolt card and plugin my eGPU with attached monitors, but I am unable to set command-line parameters that result in a successful boot with the card enabled, and have it narrowed down to 2 states using marked PCIe_E3 :

cmdline = pcie_ports=native pci=assign-busses,hpbussize=0x33,realloc,hpmmiosize=128M,hpmmioprefsize=16G

1. No PCI command-line parameters, successful boot but no BAR address space to support ePGU plugin.
** This is expected behavior.

Link to dmesg output : no_parameters.dmesg

[ 1960.483787] pcieport 0000:25:01.0: pciehp: Slot(1): Card present
[ 1960.633110] pci 0000:27:00.0: [8086:1578] type 01 class 0x060400
[ 1960.633227] pci 0000:27:00.0: enabling Extended Tags
[ 1960.633466] pci 0000:27:00.0: supports D1 D2
[ 1960.633467] pci 0000:27:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[ 1960.633677] pci 0000:27:00.0: 8.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x4 link at 0000:25:01.0 (capable of 31.504 Gb/s with 8.0 GT/s PCIe x4 link)
[ 1960.633780] pci 0000:27:00.0: Adding to iommu group 45
[ 1960.633995] pci 0000:27:00.0: No bus number available for hot-added bridge
[ 1960.633998] pcieport 0000:25:01.0: bridge window [io  0x1000-0x0fff] to [bus 27] add_size 1000
[ 1960.634001] pcieport 0000:25:01.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 27] add_size 200000 add_align 100000
[ 1960.634002] pcieport 0000:25:01.0: bridge window [mem 0x00100000-0x000fffff] to [bus 27] add_size 200000 add_align 100000
[ 1960.634006] pcieport 0000:25:01.0: BAR 14: no space for [mem size 0x00200000]
[ 1960.634007] pcieport 0000:25:01.0: BAR 14: failed to assign [mem size 0x00200000]
[ 1960.634009] pcieport 0000:25:01.0: BAR 15: no space for [mem size 0x00200000 64bit pref]
[ 1960.634010] pcieport 0000:25:01.0: BAR 15: failed to assign [mem size 0x00200000 64bit pref]
[ 1960.634011] pcieport 0000:25:01.0: BAR 13: no space for [io  size 0x1000]
[ 1960.634011] pcieport 0000:25:01.0: BAR 13: failed to assign [io  size 0x1000]
[ 1960.634013] pcieport 0000:25:01.0: BAR 14: no space for [mem size 0x00200000]
[ 1960.634013] pcieport 0000:25:01.0: BAR 14: failed to assign [mem size 0x00200000]
[ 1960.634015] pcieport 0000:25:01.0: BAR 15: no space for [mem size 0x00200000 64bit pref]
[ 1960.634015] pcieport 0000:25:01.0: BAR 15: failed to assign [mem size 0x00200000 64bit pref]
[ 1960.634016] pcieport 0000:25:01.0: BAR 13: no space for [io  size 0x1000]
[ 1960.634017] pcieport 0000:25:01.0: BAR 13: failed to assign [io  size 0x1000]
[ 1960.634018] pcieport 0000:25:01.0: PCI bridge to [bus 27]

2. Command-line parameters set, boot failure and rootfs (initramfs) prompt, there seems to be misconfiguration of PCIe, neither the SATA or NVMe controller show up in dmesg.

Link to dmesg output : rootfs_initramfs_failure.dmesg

[    0.869035] pci_bus 0000:00: max bus depth: 5 pci_try_num: 6
[    0.869041] pci 0000:02:02.0: BAR 13: no space for [io  size 0x2000]
[    0.869042] pci 0000:02:02.0: BAR 13: failed to assign [io  size 0x2000]
[    0.869043] pci 0000:02:01.0: PCI bridge to [bus 03]
[    0.869048] pci 0000:02:01.0:   bridge window [mem 0xfcb00000-0xfcbfffff]
[    0.869057] pci 0000:04:00.0: BAR 13: no space for [io  size 0x2000]
[    0.869057] pci 0000:04:00.0: BAR 13: failed to assign [io  size 0x2000]
[    0.869059] pci 0000:05:01.0: BAR 14: no space for [mem size 0x08000000]
[    0.869059] pci 0000:05:01.0: BAR 14: failed to assign [mem size 0x08000000]
[    0.869060] pci 0000:05:01.0: BAR 15: no space for [mem size 0x400000000 64bit pref]
[    0.869061] pci 0000:05:01.0: BAR 15: failed to assign [mem size 0x400000000 64bit pref]
[    0.869062] pci 0000:05:03.0: BAR 14: no space for [mem size 0x08000000]
[    0.869062] pci 0000:05:03.0: BAR 14: failed to assign [mem size 0x08000000]
[    0.869063] pci 0000:05:03.0: BAR 15: no space for [mem size 0x400000000 64bit pref]
[    0.869064] pci 0000:05:03.0: BAR 15: failed to assign [mem size 0x400000000 64bit pref]
[    0.869064] pci 0000:05:01.0: BAR 13: no space for [io  size 0x1000]
[    0.869065] pci 0000:05:01.0: BAR 13: failed to assign [io  size 0x1000]
[    0.869065] pci 0000:05:03.0: BAR 13: no space for [io  size 0x1000]
[    0.869066] pci 0000:05:03.0: BAR 13: failed to assign [io  size 0x1000]

I can produce a third state if I move the card to the slot marked as PCIe_E2, this appears to cause a misconfiguration of the devices connected to the abridge.

Link to dmesg output : realloc_failure.dmesg

AMD-Vi: Completion-Wait loop timed out
AMD-Vi: Completion-Wait loop timed out
ata5.00: exception Emask 0x20 SAct 0x800000 SErr 0xc0000 action 0x6 frozen
ata5.00: irq_stat 0x20000000, host bus error
ata5: SError: { CommWake 10B8B }
ata5.00: failed command: WRITE FPDMA QUEUED
ata5.00: cmd 61/08:b8:00:00:65/00:00:74:00:00/40 tag 23 ncq dma 4096 out
         res 40/00:b8:00:00:65/00:00:74:00:00/40 Emask 0x20 (host bus error)
AMD-Vi: Completion-Wait loop timed out
ata5.00: status: { DRDY }
ata5: hard resetting link
AMD-Vi: Completion-Wait loop timed out
AMD-Vi: Completion-Wait loop timed out
iommu ivhd0: AMD-Vi: Event logged [IOTLB_INV_TIMEOUT device=18:00.0 address=0x100215a60]
ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
ata5.00: configured for UDMA/133
ata5: EH complete
EXT4-fs (md127): Remounting filesystem read-only
EXT4-fs error (device md127): ext4_find_extent:927: inode #120129627: comm pool-tracker-mi: pblk 961527758 bad header/extent: invalid magic - magic 0, entries 0, max 0(0), depth 0(0)
EXT4-fs error (device md127): ext4_find_extent:927: inode #120129627: comm pool-tracker-mi: pblk 961527758 bad header/extent: invalid magic - magic 0, entries 0, max 0(0), depth 0(0)
EXT4-fs error (device md127): ext4_find_extent:927: inode #120129627: comm pool-tracker-mi: pblk 961527758 bad header/extent: invalid magic - magic 0, entries 0, max 0(0), depth 0(0)
EXT4-fs error (device md127): ext4_find_extent:927: inode #120129627: comm pool-tracker-mi: pblk 961527758 bad header/extent: invalid magic - magic 0, entries 0, max 0(0), depth 0(0)