You are not logged in.

#1 2016-01-26 21:50:12

pfilz0
Member
Registered: 2015-03-26
Posts: 17

RAID10 file corruption under high load [SOLVED]

Hi all,

We've bought a workstation (HP Z840) at work to do some number crunching. There are two of us doing simulations and sometimes we both run our code at the same time. When we do that, I noticed that some files written to the harddrive are corrupted. My best guess would be that there is some io buffer that gets flooded when too much data is written to the disk, but then why does it never happen when only one of us is running his code at the time?

Here is the relevant output from journalctl:

Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: scan devices: complete
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         scan devices: end devices complete
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         break from end device scan: ioc_status(0x0022), loginfo(0x310f0400)
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         scan devices: end devices start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         scan devices: volumes complete
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         break from volume scan: ioc_status(0x0022), loginfo(0x00000000)
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         scan devices: volumes start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         scan devices: phys disk complete
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         break from phys disk scan:ioc_status(0x0022), loginfo(0x00000000)
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         scan devices phys disk start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         scan devices: expanders complete
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         break from expander scan: ioc_status(0x0022), loginfo(0x310f0400)
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0:         scan devices: expanders start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: scan devices: start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: removing unresponding devices: complete
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: removing unresponding devices: expanders
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: removing unresponding devices: volumes
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: removing unresponding devices: end-devices
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: removing unresponding devices: start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: _base_fault_reset_work: hard reset: success
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for expanders: complete
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for expanders: start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for responding raid volumes: complete
Jan 26 03:24:16 MPC2029 kernel: scsi target0:1:0: handle(0x0081), wwid(0x0146e08058d82202)
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for raid volumes: start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for end-devices: complete
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:7: handle(0x0010), sas_addr(0x4433221107000000), enclosure logical id(0x50014380328cd9b8), slot(7)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:6: handle(0x000f), sas_addr(0x4433221106000000), enclosure logical id(0x50014380328cd9b8), slot(6)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:5: handle(0x000e), sas_addr(0x4433221105000000), enclosure logical id(0x50014380328cd9b8), slot(5)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:4: handle(0x000d), sas_addr(0x4433221104000000), enclosure logical id(0x50014380328cd9b8), slot(4)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:5: handle(0x000e), sas_addr(0x4433221105000000), enclosure logical id(0x50014380328cd9b8), slot(5)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:4: handle(0x000d), sas_addr(0x4433221104000000), enclosure logical id(0x50014380328cd9b8), slot(4)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:2: handle(0x000c), sas_addr(0x4433221103000000), enclosure logical id(0x50014380328cd9b8), slot(3)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:3: handle(0x000b), sas_addr(0x4433221102000000), enclosure logical id(0x50014380328cd9b8), slot(2)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:1: handle(0x000a), sas_addr(0x4433221101000000), enclosure logical id(0x50014380328cd9b8), slot(1)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:0: handle(0x0009), sas_addr(0x4433221100000000), enclosure logical id(0x50014380328cd9b8), slot(0)
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for end-devices: start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for expanders: complete
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for expanders: start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for responding raid volumes: complete
Jan 26 03:24:16 MPC2029 kernel: scsi target0:1:0: handle(0x0081), wwid(0x0146e08058d82202)
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for raid volumes: start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for end-devices: complete
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:7: handle(0x0010), sas_addr(0x4433221107000000), enclosure logical id(0x50014380328cd9b8), slot(7)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:6: handle(0x000f), sas_addr(0x4433221106000000), enclosure logical id(0x50014380328cd9b8), slot(6)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:5: handle(0x000e), sas_addr(0x4433221105000000), enclosure logical id(0x50014380328cd9b8), slot(5)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:4: handle(0x000d), sas_addr(0x4433221104000000), enclosure logical id(0x50014380328cd9b8), slot(4)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:2: handle(0x000c), sas_addr(0x4433221103000000), enclosure logical id(0x50014380328cd9b8), slot(3)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:3: handle(0x000b), sas_addr(0x4433221102000000), enclosure logical id(0x50014380328cd9b8), slot(2)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:1: handle(0x000a), sas_addr(0x4433221101000000), enclosure logical id(0x50014380328cd9b8), slot(1)
Jan 26 03:24:16 MPC2029 kernel: scsi target0:0:0: handle(0x0009), sas_addr(0x4433221100000000), enclosure logical id(0x50014380328cd9b8), slot(0)
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: search for end-devices: start
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: port enable: SUCCESS
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: sending port enable !!
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: Protocol=(Initiator), Capabilities=(Raid,TLR,EEDP,Snapshot Buffer,Diag Trace Buffer,Task Set Full,NCQ)
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: LSISAS2308: FWVersion(18.10.00.00), ChipRevision(0x05), BiosVersion(07.35.02.00)
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: diag reset: SUCCESS
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: sending diag reset !!
Jan 26 03:24:16 MPC2029 kernel: mpt2sas0: fault_state(0x0501)!

Any help is appreciated.

MOD EDIT: please learn to use code tags

Last edited by pfilz0 (2016-03-18 14:23:21)

Offline

#2 2016-01-27 21:39:25

R00KIE
Forum Fellow
From: Between a computer and a chair
Registered: 2008-09-14
Posts: 4,734

Re: RAID10 file corruption under high load [SOLVED]

You should add more details about the hardware.


R00KIE
Tm90aGluZyB0byBzZWUgaGVyZSwgbW92ZSBhbG9uZy4K

Offline

#3 2016-02-01 23:58:37

pfilz0
Member
Registered: 2015-03-26
Posts: 17

Re: RAID10 file corruption under high load [SOLVED]

Hi R00kie,

Here's some info. Please let me know if it is insufficient

lspci -v:

00:00.0 Host bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DMI2 (rev 02)
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: fast devsel
	Capabilities: [90] Express Root Port (Slot-), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [144] Vendor Specific Information: ID=0004 Rev=1 Len=03c <?>
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>

00:01.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 1 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 25
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	I/O behind bridge: 00003000-00003fff
	Memory behind bridge: f5300000-f53fffff
	Capabilities: [40] Subsystem: Intel Corporation Device 0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot-), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport
	Kernel modules: shpchp

00:01.1 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 1 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 26
	Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
	Memory behind bridge: f5100000-f52fffff
	Capabilities: [40] Subsystem: Intel Corporation Device 0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport
	Kernel modules: shpchp

00:02.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 2 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 27
	Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
	Memory behind bridge: f4000000-f4ffffff
	Prefetchable memory behind bridge: 00000000c0000000-00000000d1ffffff
	Capabilities: [40] Subsystem: Intel Corporation Device 0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport
	Kernel modules: shpchp

00:03.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 3 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 28
	Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
	I/O behind bridge: 00002000-00002fff
	Memory behind bridge: f2000000-f30fffff
	Prefetchable memory behind bridge: 00000000e0000000-00000000f1ffffff
	Capabilities: [40] Subsystem: Intel Corporation Device 0000
	Capabilities: [60] MSI: Enable+ Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport
	Kernel modules: shpchp

00:05.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Address Map, VTd_Misc, System Management (rev 02)
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Hot Plug (rev 02)
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [110] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [120] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [130] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>

00:05.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 RAS, Control Status and Global Errors (rev 02)
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

00:05.4 PIC: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 I/O APIC (rev 02) (prog-if 20 [IO(X)-APIC])
	Subsystem: Intel Corporation Device 0000
	Flags: bus master, fast devsel, latency 0
	Memory at f543e000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

00:11.0 Unassigned class [ff00]: Intel Corporation C610/X99 series chipset SPSR (rev 05)
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [80] Power Management version 3

00:11.4 RAID bus controller: Intel Corporation C610/X99 series chipset sSATA Controller [RAID mode] (rev 05)
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 29
	I/O ports at 40a0 [size=8]
	I/O ports at 40b4 [size=4]
	I/O ports at 4098 [size=8]
	I/O ports at 40b0 [size=4]
	I/O ports at 4060 [size=32]
	Memory at f543d000 (32-bit, non-prefetchable) [size=2K]
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [70] Power Management version 3
	Capabilities: [a8] SATA HBA v1.0
	Kernel driver in use: ahci
	Kernel modules: ahci

00:14.0 USB controller: Intel Corporation C610/X99 series chipset USB xHCI Host Controller (rev 05) (prog-if 30 [XHCI])
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: bus master, medium devsel, latency 0, IRQ 19
	Memory at f5420000 (64-bit, non-prefetchable) [size=64K]
	Capabilities: [70] Power Management version 2
	Kernel driver in use: xhci_hcd
	Kernel modules: xhci_pci

00:16.0 Communication controller: Intel Corporation C610/X99 series chipset MEI Controller #1 (rev 05)
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: bus master, fast devsel, latency 0, IRQ 24
	Memory at f5435000 (64-bit, non-prefetchable) [size=16]
	Capabilities: [50] Power Management version 3
	Capabilities: [8c] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Kernel driver in use: mei_me
	Kernel modules: mei_me

00:16.3 Serial controller: Intel Corporation C610/X99 series chipset KT Controller (rev 05) (prog-if 02 [16550])
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: 66MHz, fast devsel, IRQ 17
	I/O ports at 4090 [size=8]
	Memory at f543c000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [c8] Power Management version 3
	Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
	Kernel driver in use: serial

00:19.0 Ethernet controller: Intel Corporation Ethernet Connection (2) I218-LM (rev 05)
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: bus master, fast devsel, latency 0, IRQ 47
	Memory at f5400000 (32-bit, non-prefetchable) [size=128K]
	Memory at f543b000 (32-bit, non-prefetchable) [size=4K]
	I/O ports at 4040 [disabled] [size=32]
	Capabilities: [c8] Power Management version 2
	Capabilities: [d0] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [e0] PCI Advanced Features
	Kernel driver in use: e1000e
	Kernel modules: e1000e

00:1a.0 USB controller: Intel Corporation C610/X99 series chipset USB Enhanced Host Controller #2 (rev 05) (prog-if 20 [EHCI])
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: bus master, medium devsel, latency 0, IRQ 18
	Memory at f543a000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [50] Power Management version 2
	Capabilities: [58] Debug port: BAR=1 offset=00a0
	Capabilities: [98] PCI Advanced Features
	Kernel driver in use: ehci-pci
	Kernel modules: ehci_pci

00:1b.0 Audio device: Intel Corporation C610/X99 series chipset HD Audio Controller (rev 05)
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: bus master, fast devsel, latency 0, IRQ 60
	Memory at f5430000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [50] Power Management version 2
	Capabilities: [60] MSI: Enable+ Count=1/1 Maskable- 64bit+
	Capabilities: [70] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [100] Virtual Channel
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel

00:1c.0 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root Port #1 (rev d5) (prog-if 00 [Normal decode])
	Physical Slot: 8191
	Flags: bus master, fast devsel, latency 0, IRQ 16
	Bus: primary=00, secondary=05, subordinate=05, sec-latency=0
	I/O behind bridge: 00001000-00001fff
	Memory behind bridge: f5000000-f50fffff
	Capabilities: [40] Express Root Port (Slot-), MSI 00
	Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: Hewlett-Packard Company Device 2129
	Capabilities: [a0] Power Management version 3
	Kernel driver in use: pcieport
	Kernel modules: shpchp

00:1c.3 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root Port #4 (rev d5) (prog-if 00 [Normal decode])
	Physical Slot: 8191
	Flags: bus master, fast devsel, latency 0, IRQ 19
	Bus: primary=00, secondary=06, subordinate=06, sec-latency=0
	Capabilities: [40] Express Root Port (Slot+), MSI 00
	Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: Hewlett-Packard Company Device 2129
	Capabilities: [a0] Power Management version 3
	Kernel driver in use: pcieport
	Kernel modules: shpchp

00:1c.4 PCI bridge: Intel Corporation C610/X99 series chipset PCI Express Root Port #5 (rev d5) (prog-if 00 [Normal decode])
	Physical Slot: 8191
	Flags: bus master, fast devsel, latency 0, IRQ 16
	Bus: primary=00, secondary=07, subordinate=07, sec-latency=0
	Capabilities: [40] Express Root Port (Slot-), MSI 00
	Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit-
	Capabilities: [90] Subsystem: Hewlett-Packard Company Device 2129
	Capabilities: [a0] Power Management version 3
	Kernel driver in use: pcieport
	Kernel modules: shpchp

00:1d.0 USB controller: Intel Corporation C610/X99 series chipset USB Enhanced Host Controller #1 (rev 05) (prog-if 20 [EHCI])
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: bus master, medium devsel, latency 0, IRQ 18
	Memory at f5439000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [50] Power Management version 2
	Capabilities: [58] Debug port: BAR=1 offset=00a0
	Capabilities: [98] PCI Advanced Features
	Kernel driver in use: ehci-pci
	Kernel modules: ehci_pci

00:1f.0 ISA bridge: Intel Corporation C610/X99 series chipset LPC Controller (rev 05)
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: bus master, medium devsel, latency 0
	Capabilities: [e0] Vendor Specific Information: Len=0c <?>
	Kernel driver in use: lpc_ich
	Kernel modules: lpc_ich

00:1f.2 RAID bus controller: Intel Corporation C600/X79 series chipset SATA RAID Controller (rev 05)
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: bus master, 66MHz, medium devsel, latency 0, IRQ 30
	I/O ports at 4088 [size=8]
	I/O ports at 40ac [size=4]
	I/O ports at 4080 [size=8]
	I/O ports at 40a8 [size=4]
	I/O ports at 4020 [size=32]
	Memory at f5438000 (32-bit, non-prefetchable) [size=2K]
	Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
	Capabilities: [70] Power Management version 3
	Capabilities: [a8] SATA HBA v1.0
	Kernel driver in use: ahci
	Kernel modules: ahci

00:1f.3 SMBus: Intel Corporation C610/X99 series chipset SMBus Controller (rev 05)
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: medium devsel, IRQ 18
	Memory at f5434000 (64-bit, non-prefetchable) [size=256]
	I/O ports at 4000 [size=32]
	Kernel driver in use: i801_smbus
	Kernel modules: i2c_i801

01:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05)
	Subsystem: Hewlett-Packard Company Device 158b
	Physical Slot: 0
	Flags: bus master, fast devsel, latency 0
	I/O ports at 3000 [size=256]
	Memory at f5340000 (64-bit, non-prefetchable) [size=64K]
	Memory at f5300000 (64-bit, non-prefetchable) [size=256K]
	Expansion ROM at <ignored> [disabled]
	Capabilities: [50] Power Management version 3
	Capabilities: [68] Express Endpoint, MSI 00
	Capabilities: [d0] Vital Product Data
	Capabilities: [a8] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [c0] MSI-X: Enable+ Count=16 Masked-
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [1e0] #19
	Capabilities: [1c0] Power Budgeting <?>
	Capabilities: [190] #16
	Capabilities: [148] Alternative Routing-ID Interpretation (ARI)
	Kernel driver in use: mpt2sas
	Kernel modules: mpt2sas

02:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03)
	Subsystem: Hewlett-Packard Company Ethernet I210-T1 GbE NIC
	Physical Slot: 1
	Flags: bus master, fast devsel, latency 0
	Memory at f5100000 (32-bit, non-prefetchable) [size=1M]
	Memory at f5200000 (32-bit, non-prefetchable) [size=16K]
	Expansion ROM at <ignored> [disabled]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [70] MSI-X: Enable+ Count=5 Masked-
	Capabilities: [a0] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Device Serial Number a0-36-9f-ff-ff-72-b2-0f
	Capabilities: [1a0] Transaction Processing Hints
	Kernel driver in use: igb
	Kernel modules: igb

03:00.0 3D controller: NVIDIA Corporation GK110BGL [Tesla K40c] (rev a1)
	Subsystem: Hewlett-Packard Company Device 0983
	Physical Slot: 6
	Flags: bus master, fast devsel, latency 0, IRQ 58
	Memory at f4000000 (32-bit, non-prefetchable) [size=16M]
	Memory at c0000000 (64-bit, prefetchable) [size=256M]
	Memory at d0000000 (64-bit, prefetchable) [size=32M]
	Capabilities: [60] Power Management version 3
	Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [78] Express Endpoint, MSI 00
	Capabilities: [100] Virtual Channel
	Capabilities: [128] Power Budgeting <?>
	Capabilities: [420] Advanced Error Reporting
	Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
	Capabilities: [900] #19
	Kernel driver in use: nvidia
	Kernel modules: nouveau, nvidia

04:00.0 VGA compatible controller: NVIDIA Corporation GM107GL [Quadro K620] (rev a2) (prog-if 00 [VGA controller])
	Subsystem: Hewlett-Packard Company Device 1098
	Physical Slot: 2
	Flags: bus master, fast devsel, latency 0, IRQ 59
	Memory at f2000000 (32-bit, non-prefetchable) [size=16M]
	Memory at e0000000 (64-bit, prefetchable) [size=256M]
	Memory at f0000000 (64-bit, prefetchable) [size=32M]
	I/O ports at 2000 [size=128]
	Expansion ROM at f3080000 [disabled] [size=512K]
	Capabilities: [60] Power Management version 3
	Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [78] Express Legacy Endpoint, MSI 00
	Capabilities: [100] Virtual Channel
	Capabilities: [250] Latency Tolerance Reporting
	Capabilities: [258] L1 PM Substates
	Capabilities: [128] Power Budgeting <?>
	Capabilities: [600] Vendor Specific Information: ID=0001 Rev=1 Len=024 <?>
	Capabilities: [900] #19
	Kernel driver in use: nvidia
	Kernel modules: nouveau, nvidia

04:00.1 Audio device: NVIDIA Corporation Device 0fbc (rev a1)
	Subsystem: Hewlett-Packard Company Device 1098
	Physical Slot: 2
	Flags: bus master, fast devsel, latency 0, IRQ 61
	Memory at f3000000 (32-bit, non-prefetchable) [size=16K]
	Capabilities: [60] Power Management version 3
	Capabilities: [68] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [78] Express Endpoint, MSI 00
	Kernel driver in use: snd_hda_intel
	Kernel modules: snd_hda_intel

05:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Connection (rev 03)
	Subsystem: Hewlett-Packard Company Device 2129
	Flags: bus master, fast devsel, latency 0
	Memory at f5000000 (32-bit, non-prefetchable) [size=512K]
	I/O ports at 1000 [disabled] [size=32]
	Memory at f5080000 (32-bit, non-prefetchable) [size=16K]
	Capabilities: [40] Power Management version 3
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
	Capabilities: [70] MSI-X: Enable+ Count=5 Masked-
	Capabilities: [a0] Express Endpoint, MSI 00
	Capabilities: [100] Advanced Error Reporting
	Capabilities: [140] Device Serial Number ec-b1-d7-ff-ff-33-3f-ca
	Capabilities: [1a0] Transaction Processing Hints
	Kernel driver in use: igb
	Kernel modules: igb

7f:08.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0
	Flags: fast devsel

7f:08.2 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:08.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0
	Flags: fast devsel

7f:09.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1
	Flags: fast devsel

7f:09.2 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:09.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1
	Flags: fast devsel

7f:0b.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring
	Flags: fast devsel

7f:0b.1 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:0b.2 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:0c.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

7f:0c.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

7f:0c.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

7f:0c.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

7f:0c.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

7f:0c.5 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

7f:0c.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

7f:0c.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

7f:0d.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

7f:0d.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

7f:0f.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Buffered Ring Agent (rev 02)
	Flags: fast devsel

7f:0f.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Buffered Ring Agent (rev 02)
	Flags: fast devsel

7f:0f.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Buffered Ring Agent (rev 02)
	Flags: fast devsel

7f:0f.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Buffered Ring Agent (rev 02)
	Flags: fast devsel

7f:0f.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers (rev 02)
	Subsystem: Intel Corporation Device 2fe0
	Flags: fast devsel

7f:0f.5 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers (rev 02)
	Subsystem: Intel Corporation Device 2fe0
	Flags: fast devsel

7f:0f.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers (rev 02)
	Subsystem: Intel Corporation Device 2fe0
	Flags: fast devsel

7f:10.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCIe Ring Interface (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCIe Ring Interface
	Flags: fast devsel

7f:10.1 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCIe Ring Interface (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCIe Ring Interface
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:10.5 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers
	Flags: fast devsel

7f:10.6 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers
	Flags: fast devsel

7f:10.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers
	Flags: fast devsel

7f:12.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 0 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 0
	Flags: fast devsel
	Kernel modules: sb_edac

7f:12.1 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 0 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 0
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:12.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 1 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 1
	Flags: fast devsel

7f:12.5 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 1 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 1
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:13.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address, Thermal & RAS Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address, Thermal & RAS Registers
	Flags: fast devsel

7f:13.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address, Thermal & RAS Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address, Thermal & RAS Registers
	Flags: fast devsel

7f:13.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder
	Flags: fast devsel

7f:13.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder
	Flags: fast devsel

7f:13.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO Channel 0/1 Broadcast (rev 02)
	Flags: fast devsel

7f:13.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO Global Broadcast (rev 02)
	Flags: fast devsel

7f:14.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 Thermal Control (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 Thermal Control
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:14.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 Thermal Control (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 Thermal Control
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:14.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 ERROR Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 ERROR Registers
	Flags: fast devsel

7f:14.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 ERROR Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 ERROR Registers
	Flags: fast devsel

7f:14.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 (rev 02)
	Flags: fast devsel

7f:14.5 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 (rev 02)
	Flags: fast devsel

7f:14.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 (rev 02)
	Flags: fast devsel

7f:14.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 (rev 02)
	Flags: fast devsel

7f:16.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Target Address, Thermal & RAS Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Target Address, Thermal & RAS Registers
	Flags: fast devsel

7f:16.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Target Address, Thermal & RAS Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Target Address, Thermal & RAS Registers
	Flags: fast devsel

7f:16.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel Target Address Decoder (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel Target Address Decoder
	Flags: fast devsel

7f:16.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel Target Address Decoder (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel Target Address Decoder
	Flags: fast devsel

7f:16.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO Channel 2/3 Broadcast (rev 02)
	Flags: fast devsel

7f:16.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO Global Broadcast (rev 02)
	Flags: fast devsel

7f:17.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 0 Thermal Control (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 0 Thermal Control
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:17.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 1 Thermal Control (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 1 Thermal Control
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

7f:17.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 0 ERROR Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 0 ERROR Registers
	Flags: fast devsel

7f:17.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 1 ERROR Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 1 ERROR Registers
	Flags: fast devsel

7f:17.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 (rev 02)
	Flags: fast devsel

7f:17.5 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 (rev 02)
	Flags: fast devsel

7f:17.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 (rev 02)
	Flags: fast devsel

7f:17.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 (rev 02)
	Flags: fast devsel

7f:1e.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit
	Flags: fast devsel

7f:1e.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit
	Flags: fast devsel

7f:1e.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit
	Flags: fast devsel

7f:1e.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit
	Flags: fast devsel
	I/O ports at <ignored> [disabled]
	Kernel driver in use: hswep_uncore

7f:1e.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit
	Flags: fast devsel

7f:1f.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 VCU (rev 02)
	Flags: fast devsel

7f:1f.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 VCU (rev 02)
	Flags: fast devsel

80:00.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 0 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 16
	Bus: primary=80, secondary=81, subordinate=81, sec-latency=0
	Capabilities: [40] Subsystem: Intel Corporation Device 0000
	Capabilities: [60] MSI: Enable- Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot-), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport
	Kernel modules: shpchp

80:01.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 1 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 16
	Bus: primary=80, secondary=82, subordinate=82, sec-latency=0
	Capabilities: [40] Subsystem: Intel Corporation Device 0000
	Capabilities: [60] MSI: Enable- Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot-), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport
	Kernel modules: shpchp

80:01.1 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 1 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 16
	Bus: primary=80, secondary=83, subordinate=83, sec-latency=0
	Capabilities: [40] Subsystem: Intel Corporation Device 0000
	Capabilities: [60] MSI: Enable- Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot-), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport
	Kernel modules: shpchp

80:02.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 2 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 16
	Bus: primary=80, secondary=84, subordinate=84, sec-latency=0
	Capabilities: [40] Subsystem: Intel Corporation Device 0000
	Capabilities: [60] MSI: Enable- Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport
	Kernel modules: shpchp

80:03.0 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 3 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 16
	Bus: primary=80, secondary=85, subordinate=85, sec-latency=0
	Capabilities: [40] Subsystem: Intel Corporation Device 0000
	Capabilities: [60] MSI: Enable- Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport
	Kernel modules: shpchp

80:03.2 PCI bridge: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCI Express Root Port 3 (rev 02) (prog-if 00 [Normal decode])
	Flags: bus master, fast devsel, latency 0, IRQ 16
	Bus: primary=80, secondary=86, subordinate=86, sec-latency=0
	Capabilities: [40] Subsystem: Intel Corporation Device 0000
	Capabilities: [60] MSI: Enable- Count=1/2 Maskable+ 64bit-
	Capabilities: [90] Express Root Port (Slot+), MSI 00
	Capabilities: [e0] Power Management version 3
	Capabilities: [100] Vendor Specific Information: ID=0002 Rev=0 Len=00c <?>
	Capabilities: [110] Access Control Services
	Capabilities: [148] Advanced Error Reporting
	Capabilities: [1d0] Vendor Specific Information: ID=0003 Rev=1 Len=00a <?>
	Capabilities: [250] #19
	Capabilities: [280] Vendor Specific Information: ID=0005 Rev=3 Len=018 <?>
	Capabilities: [300] Vendor Specific Information: ID=0008 Rev=0 Len=038 <?>
	Kernel driver in use: pcieport
	Kernel modules: shpchp

80:05.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Address Map, VTd_Misc, System Management (rev 02)
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

80:05.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Hot Plug (rev 02)
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [80] MSI: Enable- Count=1/1 Maskable- 64bit+
	Capabilities: [100] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [110] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [120] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>
	Capabilities: [130] Vendor Specific Information: ID=0006 Rev=1 Len=010 <?>

80:05.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 RAS, Control Status and Global Errors (rev 02)
	Flags: fast devsel
	Capabilities: [40] Express Root Complex Integrated Endpoint, MSI 00

80:05.4 PIC: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 I/O APIC (rev 02) (prog-if 20 [IO(X)-APIC])
	Subsystem: Intel Corporation Device 0000
	Flags: bus master, fast devsel, latency 0
	Memory at f8000000 (32-bit, non-prefetchable) [size=4K]
	Capabilities: [44] Express Root Complex Integrated Endpoint, MSI 00
	Capabilities: [e0] Power Management version 3

ff:08.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0
	Flags: fast devsel

ff:08.2 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:08.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 0
	Flags: fast devsel

ff:09.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1
	Flags: fast devsel

ff:09.2 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:09.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 QPI Link 1
	Flags: fast devsel

ff:0b.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring
	Flags: fast devsel

ff:0b.1 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:0b.2 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 R3 QPI Link 0 & 1 Monitoring
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:0c.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

ff:0c.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

ff:0c.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

ff:0c.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

ff:0c.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

ff:0c.5 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

ff:0c.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

ff:0c.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

ff:0d.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

ff:0d.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Unicast Registers
	Flags: fast devsel

ff:0f.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Buffered Ring Agent (rev 02)
	Flags: fast devsel

ff:0f.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Buffered Ring Agent (rev 02)
	Flags: fast devsel

ff:0f.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Buffered Ring Agent (rev 02)
	Flags: fast devsel

ff:0f.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Buffered Ring Agent (rev 02)
	Flags: fast devsel

ff:0f.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers (rev 02)
	Subsystem: Intel Corporation Device 2fe0
	Flags: fast devsel

ff:0f.5 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers (rev 02)
	Subsystem: Intel Corporation Device 2fe0
	Flags: fast devsel

ff:0f.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 System Address Decoder & Broadcast Registers (rev 02)
	Subsystem: Intel Corporation Device 2fe0
	Flags: fast devsel

ff:10.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCIe Ring Interface (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCIe Ring Interface
	Flags: fast devsel

ff:10.1 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCIe Ring Interface (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 PCIe Ring Interface
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:10.5 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers
	Flags: fast devsel

ff:10.6 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers
	Flags: fast devsel

ff:10.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Scratchpad & Semaphore Registers
	Flags: fast devsel

ff:12.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 0 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 0
	Flags: fast devsel
	Kernel driver in use: sbridge_edac
	Kernel modules: sb_edac

ff:12.1 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 0 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 0
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:12.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 1 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 1
	Flags: fast devsel

ff:12.5 Performance counters: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 1 (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Home Agent 1
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:13.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address, Thermal & RAS Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address, Thermal & RAS Registers
	Flags: fast devsel

ff:13.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address, Thermal & RAS Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Target Address, Thermal & RAS Registers
	Flags: fast devsel

ff:13.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder
	Flags: fast devsel

ff:13.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel Target Address Decoder
	Flags: fast devsel

ff:13.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO Channel 0/1 Broadcast (rev 02)
	Flags: fast devsel

ff:13.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO Global Broadcast (rev 02)
	Flags: fast devsel

ff:14.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 Thermal Control (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 Thermal Control
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:14.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 Thermal Control (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 Thermal Control
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:14.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 ERROR Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 0 ERROR Registers
	Flags: fast devsel

ff:14.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 ERROR Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 0 Channel 1 ERROR Registers
	Flags: fast devsel

ff:14.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 (rev 02)
	Flags: fast devsel

ff:14.5 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 (rev 02)
	Flags: fast devsel

ff:14.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 (rev 02)
	Flags: fast devsel

ff:14.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 0 & 1 (rev 02)
	Flags: fast devsel

ff:16.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Target Address, Thermal & RAS Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Target Address, Thermal & RAS Registers
	Flags: fast devsel

ff:16.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Target Address, Thermal & RAS Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Target Address, Thermal & RAS Registers
	Flags: fast devsel

ff:16.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel Target Address Decoder (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel Target Address Decoder
	Flags: fast devsel

ff:16.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel Target Address Decoder (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel Target Address Decoder
	Flags: fast devsel

ff:16.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO Channel 2/3 Broadcast (rev 02)
	Flags: fast devsel

ff:16.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO Global Broadcast (rev 02)
	Flags: fast devsel

ff:17.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 0 Thermal Control (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 0 Thermal Control
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:17.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 1 Thermal Control (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 1 Thermal Control
	Flags: fast devsel
	Kernel driver in use: hswep_uncore

ff:17.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 0 ERROR Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 0 ERROR Registers
	Flags: fast devsel

ff:17.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 1 ERROR Registers (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Integrated Memory Controller 1 Channel 1 ERROR Registers
	Flags: fast devsel

ff:17.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 (rev 02)
	Flags: fast devsel

ff:17.5 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 (rev 02)
	Flags: fast devsel

ff:17.6 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 (rev 02)
	Flags: fast devsel

ff:17.7 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 DDRIO (VMSE) 2 & 3 (rev 02)
	Flags: fast devsel

ff:1e.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit
	Flags: fast devsel

ff:1e.1 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit
	Flags: fast devsel

ff:1e.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit
	Flags: fast devsel

ff:1e.3 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit
	Flags: fast devsel
	I/O ports at <ignored> [disabled]
	Kernel driver in use: hswep_uncore

ff:1e.4 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit (rev 02)
	Subsystem: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 Power Control Unit
	Flags: fast devsel

ff:1f.0 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 VCU (rev 02)
	Flags: fast devsel

ff:1f.2 System peripheral: Intel Corporation Xeon E7 v3/Xeon E5 v3/Core i7 VCU (rev 02)
	Flags: fast devsel

Offline

#4 2016-02-02 21:22:17

R00KIE
Forum Fellow
From: Between a computer and a chair
Registered: 2008-09-14
Posts: 4,734

Re: RAID10 file corruption under high load [SOLVED]

It would also be helpful to know how you are doing raid and what kind of hard disks you have connected (ssd or traditional hard disk) as that might help narrow down the problem or troubleshooting steps.


R00KIE
Tm90aGluZyB0byBzZWUgaGVyZSwgbW92ZSBhbG9uZy4K

Offline

#5 2016-02-02 21:50:02

alphaniner
Member
From: Ancapistan
Registered: 2010-07-12
Posts: 2,810

Re: RAID10 file corruption under high load [SOLVED]

It looks like you're using an HP-branded LSI SAS HBA with IR firmware, but I'm guessing you're using mdadm for RAID b/c the SAS chip doesn't support RAID 5 AFAIK.

If it weren't HP-branded, I'd recommend flashing the latest IT firmware. While I've successfully flashed an HP-branded LSI SCSI card with LSI f/w, my one attempt to flash an OEM-branded LSI SAS card resulted in a brick. Granted, that was an unusual situation as the particular card was only sold to OEMs so there wasn't an official f/w release designed for it. I was trying to flash it because it wasn't playing nice with mdadm. If nothing else pans out, I'd look around and see if anyone has flashed that particular card with LSI f/w.


But whether the Constitution really be one thing, or another, this much is certain - that it has either authorized such a government as we have had, or has been powerless to prevent it. In either case, it is unfit to exist.
-Lysander Spooner

Offline

#6 2016-02-04 14:26:40

pfilz0
Member
Registered: 2015-03-26
Posts: 17

Re: RAID10 file corruption under high load [SOLVED]

Sorry, of course it is a RAID10 (not RAID5). I am using the LSI SAS controller. We bought what HP calls high density stack - allowing 6 2.5" disks. As disks we are using Seagate Spinpoint M9T 2TB (ST200LM003). Apparently they are not made for the heavy stress we were putting them under. I ran a consistency check with the LSI config utility and it showed on drive failed and an error that the bad allocator table is full. I don't have a lot of experience with RAIDs but from what I gathered I can swap the failed disk with a new one and the RAID should be able to repair itself.

Offline

#7 2016-02-04 14:45:45

alphaniner
Member
From: Ancapistan
Registered: 2010-07-12
Posts: 2,810

Re: RAID10 file corruption under high load [SOLVED]

It's not guaranteed that a free drive will be automatically used to repair the RAID. The controller may need to be configured to do this, or it may not even be possible. Traditionally, you need to manually designate an unused drive as spare or "hot spare".


But whether the Constitution really be one thing, or another, this much is certain - that it has either authorized such a government as we have had, or has been powerless to prevent it. In either case, it is unfit to exist.
-Lysander Spooner

Offline

#8 2016-02-04 14:47:44

frostschutz
Member
Registered: 2013-11-15
Posts: 1,647

Re: RAID10 file corruption under high load [SOLVED]

If there is a bad drive, you should replace it.

But if for whatever reason the controller itself does not work reliably - you'll have to find a way to fix that (if it's a bug in the kernel driver) or just bite the bullet and go for a different controller.

RAID needs reliable hardware to work, that goes for disks, cables, controllers, ram, ...

Offline

#9 2016-02-06 09:57:38

R00KIE
Forum Fellow
From: Between a computer and a chair
Registered: 2008-09-14
Posts: 4,734

Re: RAID10 file corruption under high load [SOLVED]

I'd say that if you have enough free sata ports in the motherboard you should use them instead of raid cards. But right now you are probably already locked in to the format used by that card and it might not be easy to change.


R00KIE
Tm90aGluZyB0byBzZWUgaGVyZSwgbW92ZSBhbG9uZy4K

Offline

#10 2016-02-09 08:28:09

pfilz0
Member
Registered: 2015-03-26
Posts: 17

Re: RAID10 file corruption under high load [SOLVED]

I did buy new drives of the same model as used previously. As soon as I put them in I will give an update whether it automatically rebuilds or not.

I also think it's a hardware problem but I feel the culprit is the disk and not the controller itself. As I learned, these seagate drives appear to be notoriously unreliable so a long term fix would be to change the setup, allow for 3.5" disks and buy hitachi ultrastar or similar server disks more suited to high loads.

Offline

#11 2016-02-09 14:10:54

alphaniner
Member
From: Ancapistan
Registered: 2010-07-12
Posts: 2,810

Re: RAID10 file corruption under high load [SOLVED]

Depending on how much space you need, you may be able to find a good deal on 2.5" SAS 3Gb/s (and maybe 6Gb/s) drives on eBay. When I last looked, there were loads of vendors selling unused overstock. They're usually OEM branded though, which means no warranty or support from the manufacturer.

For all intents and purposes, SAS drives are inherently 'enterprise grade' and generally expected to be used in RAIDs.


But whether the Constitution really be one thing, or another, this much is certain - that it has either authorized such a government as we have had, or has been powerless to prevent it. In either case, it is unfit to exist.
-Lysander Spooner

Offline

#12 2016-03-18 14:22:44

pfilz0
Member
Registered: 2015-03-26
Posts: 17

Re: RAID10 file corruption under high load [SOLVED]

As it turns out, it was actually the controller that was faulty. None of the disks had any bad sectors when I checked them.

Well, it gave me the opportunity to convert it all to btrfs (with software RAID10). It runs smoothly and I didn't notice any decrease in speed.

Last edited by pfilz0 (2016-03-18 14:23:47)

Offline

Board footer

Powered by FluxBB