Arch Linux

rampart

Member

Registered: 2018-01-21

Posts: 12

NVIDIA driver issues - Server board with Riser

I am unable to get arch to correctly detect and use a nvidia GTX 1060 card.  So far I have tried the nvidia package, nvidia-beta, nvidia-lts, and the nvidia installer from their site (attempted after the other two failed and uninstalled).  I have a server board with the card plugged into a riser.  There is not another on-board PCI slot that I can use.

dmesg is showing:

[    0.947730] nvidia: loading out-of-tree module taints kernel.
[    0.947739] nvidia: module license 'NVIDIA' taints kernel.
[    0.947740] Disabling lock debugging due to kernel taint
[    0.964762] nvidia-nvlink: Nvlink Core is being initialized, major device number 246
[    0.964929] NVRM: No NVIDIA graphics adapter found!
[    0.965005] nvidia-nvlink: Unregistered the Nvlink Core, major device number 246

modprobe nvidia -vv yields:

insmod /lib/modules/4.14.13-1-ARCH/kernel/drivers/video/nvidia.ko 
modprobe: INFO: Failed to insert module '/lib/modules/4.14.13-1-ARCH/kernel/drivers/video/nvidia.ko': No such device
modprobe: ERROR: could not insert 'nvidia': No such device
modprobe: INFO: context 0xb33410 released

I tried adding pcie_port_pm=off to my kernel parameters as suggested by the trouble shooting section of the wiki.  I have already uninstalled nouveau and turned off on-board graphics in the bios (I've tested with the option on and off).  I've checked out other forum posts, the wiki, and I think I'm running out of ideas to try out to get to the root of the problem unless I overlooked something while reading.  Any help is appreciated.

Last edited by rampart (2018-01-21 01:50:10)

vi2nano

Member

Registered: 2014-11-27

Posts: 8

Re: NVIDIA driver issues - Server board with Riser

Just asking, but It works on other OS's correctly?
Can you post output of:
lspci
pacman -Qqe | grep "nvidia"

Sorry I can't format it better posting from my not so smart phone.

rampart

Member

Registered: 2018-01-21

Posts: 12

Re: NVIDIA driver issues - Server board with Riser

lspci:

00:00.0 Host bridge: Intel Corporation 5520 I/O Hub to ESI Port (rev 22)
00:01.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root Port 1 (rev 22)
00:09.0 PCI bridge: Intel Corporation 7500/5520/5500/X58 I/O Hub PCI Express Root Port 9 (rev 22)
00:0a.0 PCI bridge: Intel Corporation 7500/5520/5500/X58 I/O Hub PCI Express Root Port 10 (rev 22)
00:10.0 PIC: Intel Corporation 7500/5520/5500/X58 Physical and Link Layer Registers Port 0 (rev 22)
00:10.1 PIC: Intel Corporation 7500/5520/5500/X58 Routing and Protocol Layer Registers Port 0 (rev 22)
00:11.0 PIC: Intel Corporation 7500/5520/5500 Physical and Link Layer Registers Port 1 (rev 22)
00:11.1 PIC: Intel Corporation 7500/5520/5500 Routing & Protocol Layer Register Port 1 (rev 22)
00:13.0 PIC: Intel Corporation 7500/5520/5500/X58 I/O Hub I/OxAPIC Interrupt Controller (rev 22)
00:14.0 PIC: Intel Corporation 7500/5520/5500/X58 I/O Hub System Management Registers (rev 22)
00:14.1 PIC: Intel Corporation 7500/5520/5500/X58 I/O Hub GPIO and Scratch Pad Registers (rev 22)
00:14.2 PIC: Intel Corporation 7500/5520/5500/X58 I/O Hub Control Status and RAS Registers (rev 22)
00:14.3 PIC: Intel Corporation 7500/5520/5500/X58 I/O Hub Throttle Registers (rev 22)
00:15.0 PIC: Intel Corporation 7500/5520/5500/X58 Trusted Execution Technology Registers (rev 22)
00:16.0 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.1 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.2 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.3 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.4 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.5 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.6 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:16.7 System peripheral: Intel Corporation 5520/5500/X58 Chipset QuickData Technology Device (rev 22)
00:1a.0 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #4
00:1a.1 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #5
00:1a.2 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #6
00:1a.7 USB controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #2
00:1c.0 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 1
00:1c.4 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 5
00:1c.5 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Root Port 6
00:1d.0 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #1
00:1d.1 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #2
00:1d.2 USB controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI Controller #3
00:1d.7 USB controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI Controller #1
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 90)
00:1f.0 ISA bridge: Intel Corporation 82801JIR (ICH10R) LPC Interface Controller
00:1f.2 IDE interface: Intel Corporation 82801JI (ICH10 Family) 4 port SATA IDE Controller #1
00:1f.3 SMBus: Intel Corporation 82801JI (ICH10 Family) SMBus Controller
00:1f.5 IDE interface: Intel Corporation 82801JI (ICH10 Family) 2 port SATA IDE Controller #2
01:00.0 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
01:00.1 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
fe:00.0 Host bridge: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture Generic Non-Core Registers (rev 05)
fe:00.1 Host bridge: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture System Address Decoder (rev 05)
fe:02.0 Host bridge: Intel Corporation Xeon 5500/Core i7 QPI Link 0 (rev 05)
fe:02.1 Host bridge: Intel Corporation Xeon 5500/Core i7 QPI Physical 0 (rev 05)
fe:02.4 Host bridge: Intel Corporation Xeon 5500/Core i7 QPI Link 1 (rev 05)
fe:02.5 Host bridge: Intel Corporation Xeon 5500/Core i7 QPI Physical 1 (rev 05)
fe:03.0 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller (rev 05)
fe:03.1 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Target Address Decoder (rev 05)
fe:03.2 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller RAS Registers (rev 05)
fe:03.4 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Test Registers (rev 05)
fe:04.0 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Control Registers (rev 05)
fe:04.1 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Address Registers (rev 05)
fe:04.2 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Rank Registers (rev 05)
fe:04.3 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Thermal Control Registers (rev 05)
fe:05.0 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Control Registers (rev 05)
fe:05.1 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Address Registers (rev 05)
fe:05.2 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Rank Registers (rev 05)
fe:05.3 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Thermal Control Registers (rev 05)
fe:06.0 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Control Registers (rev 05)
fe:06.1 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Address Registers (rev 05)
fe:06.2 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Rank Registers (rev 05)
fe:06.3 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Thermal Control Registers (rev 05)
ff:00.0 Host bridge: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture Generic Non-Core Registers (rev 05)
ff:00.1 Host bridge: Intel Corporation Xeon 5500/Core i7 QuickPath Architecture System Address Decoder (rev 05)
ff:02.0 Host bridge: Intel Corporation Xeon 5500/Core i7 QPI Link 0 (rev 05)
ff:02.1 Host bridge: Intel Corporation Xeon 5500/Core i7 QPI Physical 0 (rev 05)
ff:02.4 Host bridge: Intel Corporation Xeon 5500/Core i7 QPI Link 1 (rev 05)
ff:02.5 Host bridge: Intel Corporation Xeon 5500/Core i7 QPI Physical 1 (rev 05)
ff:03.0 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller (rev 05)
ff:03.1 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Target Address Decoder (rev 05)
ff:03.2 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller RAS Registers (rev 05)
ff:03.4 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Test Registers (rev 05)
ff:04.0 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Control Registers (rev 05)
ff:04.1 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Address Registers (rev 05)
ff:04.2 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Rank Registers (rev 05)
ff:04.3 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 0 Thermal Control Registers (rev 05)
ff:05.0 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Control Registers (rev 05)
ff:05.1 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Address Registers (rev 05)
ff:05.2 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Rank Registers (rev 05)
ff:05.3 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 1 Thermal Control Registers (rev 05)
ff:06.0 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Control Registers (rev 05)
ff:06.1 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Address Registers (rev 05)
ff:06.2 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Rank Registers (rev 05)
ff:06.3 Host bridge: Intel Corporation Xeon 5500/Core i7 Integrated Memory Controller Channel 2 Thermal Control Registers (rev 05)

pacman -Qqe | grep "nvidia"

nvidia

As an update, I've also tried rolling back to different kernel versions and trying that with no luck.  Current kernel has been re-updated to most recent version.  I haven't tested on other OSes, and I would have to buy an eGPU enclosure to test on my laptop.

Last edited by rampart (2018-01-21 22:48:53)

loqs

Member

Registered: 2014-03-06

Posts: 19,113

Re: NVIDIA driver issues - Server board with Riser

@rampart which device in the lspci output do believe is for the nvidia GPU?

rampart

Member

Registered: 2018-01-21

Posts: 12

Re: NVIDIA driver issues - Server board with Riser

It's plugged into one of the PCI Express ports, but it's not detected and not in lspci at all.  Any thoughts on steps to take to determine better why it's undetected whether the issue is hardware vs software.  I'm thinking the riser card may be bad.  I've also tried the echoing one in the /sys/ paths for the pci express ports to remove the device and then echoing 1 into rescan to try and detect the card.

So for example:

echo 1 > /sys/bus/pci/devices/0000\:00\:1c.0/remove
echo 1 > /sys/bus/pci/rescan 

Last edited by rampart (2018-01-21 23:15:58)

loqs

Member

Registered: 2014-03-06

Posts: 19,113

Re: NVIDIA driver issues - Server board with Riser

Have you any other available hardware you could switch with the the GPU to test the riser card?

rampart

Member

Registered: 2018-01-21

Posts: 12

Re: NVIDIA driver issues - Server board with Riser

Unfortunately I don't.

V1del

Forum Moderator

Registered: 2012-10-16

Posts: 25,435

Re: NVIDIA driver issues - Server board with Riser

From a quick googler (I know nothing about riser cards) it may be necessary to change some PCI related settings in your firmware, I'd suggest you look there and/or google for information on riser compatibility with your mainboard.

rampart

Member

Registered: 2018-01-21

Posts: 12

Re: NVIDIA driver issues - Server board with Riser

@V1del

I looked in the bios setup menu and didn't see much about PCI settings, and I am not very familiar with firmware other than downloading firmware from manufacturers.  Any advice on the kind of things I should be researching for changing PCI firmware settings.  The riser card is supposed to be the right one for my motherboard, but I wouldn't doubt that a change or update to bios or firmware might do the trick if it's not a hardware issue.  I've looked a little bit into setpci, but I'm not sure the extent to what my options are command wise for messing with pci devices and their settings.

Last edited by rampart (2018-01-22 01:35:50)

V1del

Forum Moderator

Registered: 2012-10-16

Posts: 25,435

Re: NVIDIA driver issues - Server board with Riser

I am talking about firmware updates from your vendor, nothing OS specific, e.g. I stumbled over this post[1] and maybe you'd have to do something similar

[1] https://github.com/nanopool/Claymore-Du … -317022819

rampart

Member

Registered: 2018-01-21

Posts: 12

Re: NVIDIA driver issues - Server board with Riser

@V1del, thanks that definitely helps.  Unlink the board in that post, I can't plug directly in, I'm riser only.  But I have a new card to test on the way, and looking into whether there are presence pins or other settings related to the riser definitely gives me some new avenues to check.  I didn't see anything in the bios menu, but I'll check if there are jumpers on the riser card itself or upgraded/different firmware for the card.  The card and motherboard are both Intel so I would have hoped things would be relatively straightforward.  Thanks for your thoughts.