You are not logged in.

Pages: 1

#1 2024-12-07 15:35:34

amigrewal
Member
Registered: 2024-12-03
Posts: 5

Wayland + Nvidia + Dual GPU + Vulkan - Not use correct GPU

Using frogging family 565 nvidia drivers and arch 6.12. I'll start by saying everything works perfectly in X11, only Wayland has a problem. I'm struggling to find a solution to something that is clearly a config problem somewhere, im just unsure where.

My setup is two GPUs, a 3090 and a 4060ti. Only 1 display, connected to the 3090. The 4060 is there for AI workloads and doesn't output to anything. I've been using vkcube as my test to get this all working right(as often loading a game or even worse chrome will cause the entire system to just lock up).

output of vkcube --gpu_number 0:

Selected GPU 0: NVIDIA GeForce RTX 3090, type: DiscreteGpu
Could not find both graphics and present queues

output of vkcube --gpu_number 1:

Selected GPU 1: NVIDIA GeForce RTX 4060 Ti, type: DiscreteGpu

and the output looks like this:

XBWs58L.png

It seems to be displaying the X11 login that starts on the 4060. Starting games has a similar result and will default to the 4060 instead of the 3090. I've found this thread https://bbs.archlinux.org/viewtopic.php?id=290973 which led me to set the env variable MESA_VK_DEVICE_SELECT. When set to the 4060 i can run vkcube without any params and it'll give me the same result as above. When set to the 3090 i get the same problem as above.

vulkaninfo --summary:

Devices:
========
GPU0:
        apiVersion         = 1.3.289
        driverVersion      = 565.57.1.0
        vendorID           = 0x10de
        deviceID           = 0x2204
        deviceType         = PHYSICAL_DEVICE_TYPE_DISCRETE_GPU
        deviceName         = NVIDIA GeForce RTX 3090
        driverID           = DRIVER_ID_NVIDIA_PROPRIETARY
        driverName         = NVIDIA
        driverInfo         = 565.57.01
        conformanceVersion = 1.3.8.2
        deviceUUID         = 54b241af-197a-8255-b708-aa5bfec65234
        driverUUID         = a40eb34f-a796-5990-89ac-95d78eb83699
GPU1:
        apiVersion         = 1.3.289
        driverVersion      = 565.57.1.0
        vendorID           = 0x10de
        deviceID           = 0x2803
        deviceType         = PHYSICAL_DEVICE_TYPE_DISCRETE_GPU
        deviceName         = NVIDIA GeForce RTX 4060 Ti
        driverID           = DRIVER_ID_NVIDIA_PROPRIETARY
        driverName         = NVIDIA
        driverInfo         = 565.57.01
        conformanceVersion = 1.3.8.2
        deviceUUID         = 7bafb50d-082b-e397-4f1c-55a7be31e789
        driverUUID         = a40eb34f-a796-5990-89ac-95d78eb83699

One thing worth mentioning is when i physically remove the 4060 and try vkcube with just the 3090 in it all works perfectly.

Last edited by amigrewal (2024-12-08 14:37:57)

Offline

#2 2024-12-08 11:46:24

Lone_Wolf
Administrator
From: Netherlands, Europe
Registered: 2005-10-04
Posts: 13,447

Re: Wayland + Nvidia + Dual GPU + Vulkan - Not use correct GPU

Moderator Note
Forum has a limit of 250×250 pixels for pictures.
Please edit your post asap to comply with our guidelines.

End of moderator note.

Does this happen also with linux-lts kernel ?
What wayland compositor are you using ?
Does it work under X ?

Please post full outputs of

$ lspci -k
$ vulkaninfo --summary
$ MESA_VK_DEVICE_SELECT=list vulkaninfo

Disliking systemd intensely, but not satisfied with alternatives so focusing on taming systemd.

clean chroot building not flexible enough ?
Try clean chroot manager by graysky

Offline

#3 2024-12-08 14:43:27

amigrewal
Member
Registered: 2024-12-03
Posts: 5

Re: Wayland + Nvidia + Dual GPU + Vulkan - Not use correct GPU

Sorry fixed the original post to be inline with the guidelines.

Not tried the LTS kernel, will give that a go shortly. As mentioned everything works perfectly under X, just not under wayland.

In terms of compositor inxi -Gxx provides these results:

Graphics:
  Device-1: NVIDIA AD106 [GeForce RTX 4060 Ti] vendor: ASUSTeK driver: nvidia
    v: 565.57.01 arch: Lovelace pcie: speed: 2.5 GT/s lanes: 8 ports:
    active: none empty: DP-1, DP-2, DP-3, HDMI-A-1 bus-ID: 09:00.0
    chip-ID: 10de:2803
  Device-2: NVIDIA GA102 [GeForce RTX 3090] vendor: ZOTAC driver: nvidia
    v: 565.57.01 arch: Ampere pcie: speed: 8 GT/s lanes: 16 ports: active: none
    off: DP-6 empty: DP-4,DP-5,HDMI-A-2 bus-ID: 43:00.0 chip-ID: 10de:2204
  Display: wayland server: X.org v: 1.21.1.14 with: Xwayland v: 24.1.4
    compositor: kwin_wayland driver: X: loaded: nvidia
    unloaded: modesetting,vesa alternate: fbdev,nouveau,nv
    gpu: nvidia,nvidia-nvswitch display-ID: 0
  Monitor-1: DP-6 model: Samsung LC49G95T res: 3840x1080 dpi: 82
    diag: 1239mm (48.8")
  API: EGL v: 1.5 platforms: device: 0 drv: nvidia device: 1 drv: nvidia
    gbm: drv: nvidia surfaceless: drv: nvidia wayland: drv: nvidia x11:
    drv: nvidia
  API: OpenGL v: 4.6.0 vendor: nvidia v: 565.57.01 glx-v: 1.4
    direct-render: yes renderer: NVIDIA GeForce RTX 3090/PCIe/SSE2
    display-ID: :0.0
  API: Vulkan v: 1.3.295 surfaces: xcb,xlib,wayland device: 0
    type: discrete-gpu driver: nvidia device-ID: 10de:2204 device: 1
    type: discrete-gpu driver: nvidia device-ID: 10de:2803

lspci -k

00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Root Complex
        Subsystem: ASRock Incorporation Device 1450
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) I/O Memory Management Unit
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) I/O Memory Management Unit
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Kernel driver in use: pcieport
00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Kernel driver in use: pcieport
00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Kernel driver in use: pcieport
00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
        Kernel driver in use: pcieport
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
        Kernel driver in use: pcieport
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
        Subsystem: ASRock Incorporation Device ffff
        Kernel driver in use: piix4_smbus
        Kernel modules: i2c_piix4, sp5100_tco
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
        Subsystem: ASRock Incorporation Device ffff
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
        Kernel driver in use: k10temp
        Kernel modules: k10temp
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
00:19.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 0
00:19.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 1
00:19.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 2
00:19.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 3
        Kernel driver in use: k10temp
        Kernel modules: k10temp
00:19.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 4
00:19.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 5
00:19.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 6
00:19.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Data Fabric: Device 18h; Function 7
01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset USB 3.1 xHCI Controller (rev 02)
        Subsystem: ASMedia Technology Inc. Device 1142
        Kernel driver in use: xhci_hcd
01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset SATA Controller (rev 02)
        Subsystem: ASMedia Technology Inc. Device 1062
        Kernel driver in use: ahci
01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] X399 Series Chipset PCIe Bridge (rev 02)
        Subsystem: ASMedia Technology Inc. Device 0201
        Kernel driver in use: pcieport
02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
        Subsystem: ASMedia Technology Inc. Device 3306
        Kernel driver in use: pcieport
02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
        Subsystem: ASMedia Technology Inc. Device 3306
        Kernel driver in use: pcieport
02:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
        Subsystem: ASMedia Technology Inc. Device 3306
        Kernel driver in use: pcieport
02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
        Subsystem: ASMedia Technology Inc. Device 3306
        Kernel driver in use: pcieport
02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] 300 Series Chipset PCIe Port (rev 02)
        Subsystem: ASMedia Technology Inc. Device 3306
        Kernel driver in use: pcieport
03:00.0 Ethernet controller: Aquantia Corp. AQtion AQC107 NBase-T/IEEE 802.3an Ethernet Controller [Atlantic 10G] (rev 02)
        Subsystem: ASRock Incorporation Device d107
        Kernel driver in use: atlantic
        Kernel modules: atlantic
04:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
        Subsystem: ASRock Incorporation Device 1539
        Kernel driver in use: igb
        Kernel modules: igb
05:00.0 Network controller: Intel Corporation Dual Band Wireless-AC 3168NGW [Stone Peak] (rev 10)
        Subsystem: Intel Corporation Device 2110
        Kernel driver in use: iwlwifi
        Kernel modules: iwlwifi
06:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
        Subsystem: ASRock Incorporation Device 1539
        Kernel driver in use: igb
        Kernel modules: igb
08:00.0 Non-Volatile memory controller: Kingston Technology Company, Inc. NV2 NVMe SSD [E21T] (DRAM-less)
        Subsystem: Kingston Technology Company, Inc. NV2 NVMe SSD [E21T] (DRAM-less)
        Kernel driver in use: nvme
        Kernel modules: nvme
09:00.0 VGA compatible controller: NVIDIA Corporation AD106 [GeForce RTX 4060 Ti] (rev a1)
        Subsystem: ASUSTeK Computer Inc. Device 898d
        Kernel driver in use: nvidia
        Kernel modules: nouveau, nvidia_drm, nvidia
09:00.1 Audio device: NVIDIA Corporation AD106M High Definition Audio Controller (rev a1)
        Subsystem: ASUSTeK Computer Inc. Device 898d
        Kernel driver in use: snd_hda_intel
        Kernel modules: snd_hda_intel
0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function
        Subsystem: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function
0a:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor (PSP) 3.0 Device
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor (PSP) 3.0 Device
        Kernel driver in use: ccp
        Kernel modules: ccp
0a:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Zeppelin USB 3.0 xHCI Compliant Host Controller
        Subsystem: Advanced Micro Devices, Inc. [AMD] Device d102
        Kernel driver in use: xhci_hcd
0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function
        Subsystem: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function
0b:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
        Subsystem: ASRock Incorporation Device ffff
        Kernel driver in use: ahci
0b:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) HD Audio Controller
        Subsystem: ASRock Incorporation Device 1221
        Kernel driver in use: snd_hda_intel
        Kernel modules: snd_hda_intel
40:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Root Complex
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Root Complex
40:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) I/O Memory Management Unit
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) I/O Memory Management Unit
40:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
40:01.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Kernel driver in use: pcieport
40:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Kernel driver in use: pcieport
40:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
40:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
40:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) PCIe GPP Bridge
        Kernel driver in use: pcieport
40:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
40:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
40:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
        Kernel driver in use: pcieport
40:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-1fh) PCIe Dummy Host Bridge
40:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Internal PCIe GPP Bridge 0 to Bus B
        Kernel driver in use: pcieport
41:00.0 Non-Volatile memory controller: Sandisk Corp SanDisk Extreme Pro / WD Black 2018/SN750/PC SN720 NVMe SSD
        Subsystem: Sandisk Corp SanDisk Extreme Pro / WD Black 2018/SN750/PC SN720 NVMe SSD
        Kernel driver in use: nvme
        Kernel modules: nvme
42:00.0 Non-Volatile memory controller: Samsung Electronics Co Ltd NVMe SSD Controller PM9A1/PM9A3/980PRO
        Subsystem: Samsung Electronics Co Ltd SSD 980 PRO
        Kernel driver in use: nvme
        Kernel modules: nvme
43:00.0 VGA compatible controller: NVIDIA Corporation GA102 [GeForce RTX 3090] (rev a1)
        Subsystem: ZOTAC International (MCO) Ltd. Device 1613
        Kernel driver in use: nvidia
        Kernel modules: nouveau, nvidia_drm, nvidia
43:00.1 Audio device: NVIDIA Corporation GA102 High Definition Audio Controller (rev a1)
        Subsystem: ZOTAC International (MCO) Ltd. Device 1613
        Kernel driver in use: snd_hda_intel
        Kernel modules: snd_hda_intel
44:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function
        Subsystem: Advanced Micro Devices, Inc. [AMD] Zeppelin/Raven/Raven2 PCIe Dummy Function
44:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor (PSP) 3.0 Device
        Subsystem: Advanced Micro Devices, Inc. [AMD] Family 17h (Models 00h-0fh) Platform Security Processor (PSP) 3.0 Device
        Kernel driver in use: ccp
        Kernel modules: ccp
44:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Zeppelin USB 3.0 xHCI Compliant Host Controller
        Subsystem: Advanced Micro Devices, Inc. [AMD] Device 145c
        Kernel driver in use: xhci_hcd
45:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function
        Subsystem: Advanced Micro Devices, Inc. [AMD] Zeppelin/Renoir PCIe Dummy Function
45:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
        Subsystem: ASRock Incorporation Device ffff
        Kernel driver in use: ahci

vulkaninfo --summary

==========
VULKANINFO
==========

Vulkan Instance Version: 1.3.295


Instance Extensions: count = 23
-------------------------------
VK_EXT_acquire_drm_display             : extension revision 1
VK_EXT_acquire_xlib_display            : extension revision 1
VK_EXT_debug_report                    : extension revision 10
VK_EXT_debug_utils                     : extension revision 2
VK_EXT_direct_mode_display             : extension revision 1
VK_EXT_display_surface_counter         : extension revision 1
VK_EXT_surface_maintenance1            : extension revision 1
VK_EXT_swapchain_colorspace            : extension revision 4
VK_KHR_device_group_creation           : extension revision 1
VK_KHR_display                         : extension revision 23
VK_KHR_external_fence_capabilities     : extension revision 1
VK_KHR_external_memory_capabilities    : extension revision 1
VK_KHR_external_semaphore_capabilities : extension revision 1
VK_KHR_get_display_properties2         : extension revision 1
VK_KHR_get_physical_device_properties2 : extension revision 2
VK_KHR_get_surface_capabilities2       : extension revision 1
VK_KHR_portability_enumeration         : extension revision 1
VK_KHR_surface                         : extension revision 25
VK_KHR_surface_protected_capabilities  : extension revision 1
VK_KHR_wayland_surface                 : extension revision 6
VK_KHR_xcb_surface                     : extension revision 6
VK_KHR_xlib_surface                    : extension revision 6
VK_LUNARG_direct_driver_loading        : extension revision 1

Instance Layers: count = 10
---------------------------
VK_LAYER_INTEL_nullhw             INTEL NULL HW                1.1.73   version 1
VK_LAYER_MESA_device_select       Linux device selection layer 1.3.211  version 1
VK_LAYER_MESA_overlay             Mesa Overlay layer           1.3.211  version 1
VK_LAYER_MESA_screenshot          Mesa Screenshot layer        1.3.211  version 1
VK_LAYER_NV_optimus               NVIDIA Optimus layer         1.3.289  version 1
VK_LAYER_NV_optimus               NVIDIA Optimus layer         1.3.289  version 1
VK_LAYER_VALVE_steam_fossilize_32 Steam Pipeline Caching Layer 1.3.207  version 1
VK_LAYER_VALVE_steam_fossilize_64 Steam Pipeline Caching Layer 1.3.207  version 1
VK_LAYER_VALVE_steam_overlay_32   Steam Overlay Layer          1.3.207  version 1
VK_LAYER_VALVE_steam_overlay_64   Steam Overlay Layer          1.3.207  version 1

Devices:
========
GPU0:
        apiVersion         = 1.3.289
        driverVersion      = 565.57.1.0
        vendorID           = 0x10de
        deviceID           = 0x2204
        deviceType         = PHYSICAL_DEVICE_TYPE_DISCRETE_GPU
        deviceName         = NVIDIA GeForce RTX 3090
        driverID           = DRIVER_ID_NVIDIA_PROPRIETARY
        driverName         = NVIDIA
        driverInfo         = 565.57.01
        conformanceVersion = 1.3.8.2
        deviceUUID         = 54b241af-197a-8255-b708-aa5bfec65234
        driverUUID         = a40eb34f-a796-5990-89ac-95d78eb83699
GPU1:
        apiVersion         = 1.3.289
        driverVersion      = 565.57.1.0
        vendorID           = 0x10de
        deviceID           = 0x2803
        deviceType         = PHYSICAL_DEVICE_TYPE_DISCRETE_GPU
        deviceName         = NVIDIA GeForce RTX 4060 Ti
        driverID           = DRIVER_ID_NVIDIA_PROPRIETARY
        driverName         = NVIDIA
        driverInfo         = 565.57.01
        conformanceVersion = 1.3.8.2
        deviceUUID         = 7bafb50d-082b-e397-4f1c-55a7be31e789
        driverUUID         = a40eb34f-a796-5990-89ac-95d78eb83699

MESA_VK_DEVICE_SELECT=list vulkaninfo

selectable devices:
  GPU 0: 10de:2803 "NVIDIA GeForce RTX 4060 Ti" discrete GPU 0000:09:00.0
  GPU 1: 10de:2204 "NVIDIA GeForce RTX 3090" discrete GPU 0000:43:00.0

Offline

#4 2024-12-09 11:09:00

Lone_Wolf
Administrator
From: Netherlands, Europe
Registered: 2005-10-04
Posts: 13,447

Re: Wayland + Nvidia + Dual GPU + Vulkan - Not use correct GPU

09:00.0 VGA compatible controller: NVIDIA Corporation AD106 [GeForce RTX 4060 Ti] (rev a1)
        Subsystem: ASUSTeK Computer Inc. Device 898d
        Kernel driver in use: nvidia
        Kernel modules: nouveau, nvidia_drm, nvidia
09:00.1 Audio device: NVIDIA Corporation AD106M High Definition Audio Controller (rev a1)
        Subsystem: ASUSTeK Computer Inc. Device 898d
        Kernel driver in use: snd_hda_intel
        Kernel modules: snd_hda_intel

43:00.0 VGA compatible controller: NVIDIA Corporation GA102 [GeForce RTX 3090] (rev a1)
        Subsystem: ZOTAC International (MCO) Ltd. Device 1613
        Kernel driver in use: nvidia
        Kernel modules: nouveau, nvidia_drm, nvidia
43:00.1 Audio device: NVIDIA Corporation GA102 High Definition Audio Controller (rev a1)
        Subsystem: ZOTAC International (MCO) Ltd. Device 1613
        Kernel driver in use: snd_hda_intel
        Kernel modules: snd_hda_intel

Both cards advertise themself as normal videocards .

Under X it's possible to fake a monitor for cards that need one but don't have one connected, no idea if nvidia wayland driver allows that.

Can you borrow a 2nd monitor to verify if that solves the issue ?

If it does, an alternative might be a hardware device that fakes a monitor. There are hdmi devices that fake a monitor if none is connected .

Disliking systemd intensely, but not satisfied with alternatives so focusing on taming systemd.

clean chroot building not flexible enough ?
Try clean chroot manager by graysky

Offline

#5 2024-12-09 13:14:55

seth
Member
Registered: 2012-09-03
Posts: 62,017

Re: Wayland + Nvidia + Dual GPU + Vulkan - Not use correct GPU

So the output is connected to the 3090 but running vkcube on that complains about "Could not find both graphics and present queues" while running vkcube on the stale 4060 gets you some jackson pollock painting.
Also inxi lists the 4060 as 1st and the 3090 as second GPU

Sanity check: are you accidentally running the wayland compositor on the 4060?

qdbus6 org.kde.KWin /KWin supportInformation

Does it help to export "KWIN_DRM_DEVICES=/dev/dri/card2:/dev/dri/card1" to the session? (I suspect the simplydumb device flipping the order)
You can check /sys/class/drm/card*/device/device for which card is which.

How to upload text · How to boot w/o GUI · Disable Windows Fast-Start! · Fix your xinitrc

Offline

#6 2024-12-11 00:13:01

amigrewal
Member
Registered: 2024-12-03
Posts: 5

Re: Wayland + Nvidia + Dual GPU + Vulkan - Not use correct GPU

Lone_Wolf wrote:

Both cards advertise themself as normal videocards .

Under X it's possible to fake a monitor for cards that need one but don't have one connected, no idea if nvidia wayland driver allows that.

Can you borrow a 2nd monitor to verify if that solves the issue ?

If it does, an alternative might be a hardware device that fakes a monitor. There are hdmi devices that fake a monitor if none is connected .

My monitor has PBP so i tried putting the 4060 in as a second display and that didn't change anything.I tried re-ordering the GPUs into different PCIe slots to see if that made any difference and it didn't seem to either. Though i did notice something odd. When i connect a display to the second GPU it finds it at boot and then promptly ignores it. Surprisingly it doesn't show up even when doing xrandr --listmonitors. What i found was if i re-ordered the devices the care in PCIe slot zero was the only one listed as having a monitor, even if both are connected. I'm not sure if thats helpful or not but i found it a bit odd.

seth wrote:

Sanity check: are you accidentally running the wayland compositor on the 4060?

qdbus6 org.kde.KWin /KWin supportInformation

Seems like its running on the 3090 correctly.

KWin Support Information:
The following information should be used when requesting support on e.g. https://discuss.kde.org.
It provides information about the currently running instance, which options are used,
what OpenGL driver and which effects are running.
Please post the information provided underneath this introductory text to a paste bin service
like https://paste.kde.org instead of pasting into support threads.

==========================

Version
=======
KWin version: 6.2.4
Qt Version: 6.8.1
Qt compile version: 6.8.1
XCB compile version: 1.17.0

Operation Mode: Xwayland

Build Options
=============
KWIN_BUILD_DECORATIONS: yes
KWIN_BUILD_TABBOX: yes
KWIN_BUILD_ACTIVITIES: yes
HAVE_X11_XCB: yes
HAVE_GLX: yes

X11
===
Vendor: The X.Org Foundation
Vendor Release: 12401004
Protocol Version/Revision: 11/0
SHAPE: yes; Version: 0x11
RANDR: yes; Version: 0x14
DAMAGE: yes; Version: 0x11
Composite: yes; Version: 0x4
RENDER: yes; Version: 0xb
XFIXES: yes; Version: 0x50
SYNC: yes; Version: 0x31
GLX: yes; Version: 0x0

Decoration
==========
Plugin: org.kde.breeze
Theme: Breeze
Plugin recommends border size: None
onAllDesktopsAvailable: false
alphaChannelSupported: true
closeOnDoubleClickOnMenu: false
decorationButtonsLeft: 0, 2
decorationButtonsRight: 6, 3, 4, 5
borderSize: 0
gridUnit: 10
font: Noto Sans,10,-1,0,400,0,0,0,0,0,0,0,0,0,0,1
smallSpacing: 2
largeSpacing: 10

Output backend
==============
Name: DRM
Atomic Mode Setting on GPU 0: true

Cursor
======
themeName: breeze_cursors
themeSize: 24

Options
=======
focusPolicy: ClickToFocus
xwaylandCrashPolicy: 1
xwaylandMaxCrashCount: 3
nextFocusPrefersMouse: false
clickRaise: true
autoRaise: false
autoRaiseInterval: 0
delayFocusInterval: 0
shadeHover: false
shadeHoverInterval: 250
separateScreenFocus: true
placement: 5
activationDesktopPolicy: SwitchToOtherDesktop
focusPolicyIsReasonable: true
borderSnapZone: 10
windowSnapZone: 10
centerSnapZone: 0
snapOnlyWhenOverlapping: false
edgeBarrier: 100
cornerBarrier: 1
rollOverDesktops: false
focusStealingPreventionLevel: 1
operationTitlebarDblClick: 5000
operationMaxButtonLeftClick: 5000
operationMaxButtonMiddleClick: 5015
operationMaxButtonRightClick: 5014
commandActiveTitlebar1: MouseRaise
commandActiveTitlebar2: MouseNothing
commandActiveTitlebar3: MouseOperationsMenu
commandInactiveTitlebar1: MouseActivateAndRaise
commandInactiveTitlebar2: MouseNothing
commandInactiveTitlebar3: MouseOperationsMenu
commandWindow1: MouseActivateRaiseAndPassClick
commandWindow2: MouseActivateAndPassClick
commandWindow3: MouseActivateAndPassClick
commandWindowWheel: MouseNothing
commandAll1: MouseUnrestrictedMove
commandAll2: MouseToggleRaiseAndLower
commandAll3: MouseUnrestrictedResize
keyCmdAllModKey: 16777250
condensedTitle: false
electricBorderMaximize: true
electricBorderTiling: true
electricBorderCornerRatio: 0.25
borderlessMaximizedWindows: false
killPingTimeout: 5000
compositingMode: 1
useCompositing: true
hiddenPreviews: 1
glSmoothScale: 2
glStrictBinding: true
glStrictBindingFollowsDriver: true
glPreferBufferSwap: AutoSwapStrategy
glPlatformInterface: 2
windowsBlockCompositing: true
allowTearing: true

Screen Edges
============
desktopSwitching: false
desktopSwitchingMovingClients: false
cursorPushBackDistance: 1x1
timeThreshold: 75
reActivateThreshold: 350
actionTopLeft: 0
actionTop: 0
actionTopRight: 0
actionRight: 0
actionBottomRight: 0
actionBottom: 0
actionBottomLeft: 0
actionLeft: 0

Screens
=======
Number of Screens: 1

Screen 0:
---------
Name: DP-6
Enabled: 1
Geometry: 0,0,2560x1440
Scale: 1
Refresh Rate: 119998
Adaptive Sync: incapable

Compositing
===========
Compositing is active
Compositing Type: OpenGL
OpenGL vendor string: NVIDIA Corporation
OpenGL renderer string: NVIDIA GeForce RTX 3090/PCIe/SSE2
OpenGL version string: 3.1.0 NVIDIA 565.77
OpenGL platform interface: EGL
OpenGL shading language version string: 1.40 NVIDIA via Cg compiler
Driver: NVIDIA
Driver version: 565.77
GPU class: Unknown
OpenGL version: 3.1
GLSL version: 1.40
X server version: 1.24.1
Linux kernel version: 6.12.3
Direct rendering: Requires strict binding: no
Virtual Machine:  no
OpenGL 2 Shaders are used

Loaded Effects:
---------------
shakecursor
screenshot
outputlocator
colorpicker
zoom
screenedge
blur
contrast
sessionquit
login
logout
slidingpopups
windowaperture
slide
fullscreen
squash
fadingpopups
scale
maximize
frozenapp
dialogparent
windowview
tileseditor
overview
highlightwindow
blendchanges
startupfeedback
systembell
screentransform
kscreen

Currently Active Effects:
-------------------------
blur
contrast
scale

Effect Settings:
----------------
shakecursor:

screenshot:

outputlocator:

colorpicker:

zoom:
zoomFactor: 1.2
mousePointer: 0
mouseTracking: 0
focusTrackingEnabled: false
textCaretTrackingEnabled: false
focusDelay: 350
moveFactor: 20
targetZoom: 1

screenedge:

blur:

contrast:

sessionquit:
pluginId: sessionquit
isActiveFullScreenEffect: false

login:
pluginId: login
isActiveFullScreenEffect: false

logout:
pluginId: logout
isActiveFullScreenEffect: false

slidingpopups:
slideInDuration: 200
slideOutDuration: 200

windowaperture:
pluginId: windowaperture
isActiveFullScreenEffect: false

slide:
horizontalGap: 45
verticalGap: 20
slideBackground: true

fullscreen:
pluginId: fullscreen
isActiveFullScreenEffect: false

squash:
pluginId: squash
isActiveFullScreenEffect: false

fadingpopups:
pluginId: fadingpopups
isActiveFullScreenEffect: false

scale:
pluginId: scale
isActiveFullScreenEffect: false

maximize:
pluginId: maximize
isActiveFullScreenEffect: false

frozenapp:
pluginId: frozenapp
isActiveFullScreenEffect: false

dialogparent:
pluginId: dialogparent
isActiveFullScreenEffect: false

windowview:
activeView: 
delegate: 
animationDuration: 300
ignoreMinimized: false
mode: 
partialActivationFactor: 0
gestureInProgress: false
searchText: 
selectedIds: 

tileseditor:
activeView: 
delegate: 
animationDuration: 200

overview:
activeView: 
delegate: 
animationDuration: 300
ignoreMinimized: false
filterWindows: true
organizedGrid: true
overviewPartialActivationFactor: 0
overviewGestureInProgress: false
transitionPartialActivationFactor: 0
transitionGestureInProgress: false
gridPartialActivationFactor: 0
gridGestureInProgress: false
desktopOffset: 
searchText: 

highlightwindow:

blendchanges:

startupfeedback:
type: 1

systembell:

screentransform:

kscreen:


Loaded Plugins:
---------------
BounceKeysPlugin
KeyNotificationPlugin
StickyKeysPlugin
buttonsrebind
eis
krunnerintegration
nightlight
screencast

Available Plugins:
------------------
BounceKeysPlugin
KeyNotificationPlugin
StickyKeysPlugin
buttonsrebind
eis
krunnerintegration
nightlight
screencast
seth wrote:

Does it help to export "KWIN_DRM_DEVICES=/dev/dri/card2:/dev/dri/card1" to the session? (I suspect the simplydumb device flipping the order)
You can check /sys/class/drm/card*/device/device for which card is which.

The export doesn't seem to help, results still the same.
Results of the drm/card*/device/device folder:

09 is the 4060 and 43 is the 3090 so it does seem flipped.

-r--r--r-- 1 root root 4096 Dec 10 19:09 /sys/class/drm/card0/device/device
lrwxrwxrwx 1 root root    0 Dec 10 18:54 /sys/class/drm/card0-DP-1/device/device -> ../../../0000:09:00.0
lrwxrwxrwx 1 root root    0 Dec 10 18:54 /sys/class/drm/card0-DP-2/device/device -> ../../../0000:09:00.0
lrwxrwxrwx 1 root root    0 Dec 10 18:54 /sys/class/drm/card0-DP-3/device/device -> ../../../0000:09:00.0
lrwxrwxrwx 1 root root    0 Dec 10 18:54 /sys/class/drm/card0-HDMI-A-1/device/device -> ../../../0000:09:00.0
-r--r--r-- 1 root root 4096 Dec 10 19:09 /sys/class/drm/card1/device/device
lrwxrwxrwx 1 root root    0 Dec 10 18:54 /sys/class/drm/card1-DP-4/device/device -> ../../../0000:43:00.0
lrwxrwxrwx 1 root root    0 Dec 10 18:54 /sys/class/drm/card1-DP-5/device/device -> ../../../0000:43:00.0
lrwxrwxrwx 1 root root    0 Dec 10 18:54 /sys/class/drm/card1-DP-6/device/device -> ../../../0000:43:00.0
lrwxrwxrwx 1 root root    0 Dec 10 18:54 /sys/class/drm/card1-HDMI-A-2/device/device -> ../../../0000:43:00.0
-r--r--r-- 1 root root 4096 Dec 10 19:09 /sys/class/drm/renderD128/device/device
-r--r--r-- 1 root root 4096 Dec 10 19:09 /sys/class/drm/renderD129/device/device

Offline

#7 2024-12-11 08:15:30

seth
Member
Registered: 2012-09-03
Posts: 62,017

Re: Wayland + Nvidia + Dual GPU + Vulkan - Not use correct GPU

For reference (this problem exists a lot)
https://bbs.archlinux.org/viewtopic.php?id=290973
https://bbs.archlinux.org/viewtopic.php?id=300614

So kwin/wayland runs on the 3090, kwin/x11 works as expected… what does kwin/xwayland say?

glxinfo -B

Also the 3090?

Also

It seems to be displaying the X11 login that starts on the 4060.

does kwin/X11 (only) work because it's generally running on the 4060?
Why? xorg.conf?

How to upload text · How to boot w/o GUI · Disable Windows Fast-Start! · Fix your xinitrc

Offline

Pages: 1

Board footer

Powered by FluxBB