You are not logged in.
$ git bisect bad
Bisecting: 80 revisions left to test after this (roughly 6 steps)
[cd336f6562d3d7646a9cf071b902db200a1dd77b] Merge tag 'timers-core-2023-06-26' of ssh://gitolite.kernel.org/pub/scm/linux/kernel/git/tip/tip
https://drive.google.com/file/d/1NbJKap … sp=sharing linux-6.4.r839.gcd336f6562d3-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1mjN7FC … sp=sharing linux-headers-6.4.r839.gcd336f6562d3-1-x86_64.pkg.tar.zst
Offline
$ git bisect bad Bisecting: 80 revisions left to test after this (roughly 6 steps) [cd336f6562d3d7646a9cf071b902db200a1dd77b] Merge tag 'timers-core-2023-06-26' of ssh://gitolite.kernel.org/pub/scm/linux/kernel/git/tip/tip
https://drive.google.com/file/d/1NbJKap … sp=sharing linux-6.4.r839.gcd336f6562d3-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1mjN7FC … sp=sharing linux-headers-6.4.r839.gcd336f6562d3-1-x86_64.pkg.tar.zst
No boot
Offline
$ git bisect bad
Bisecting: 43 revisions left to test after this (roughly 6 steps)
[60be49bdf1d4ddb9e2deb7aa718d5b8bc167ee4e] MAINTAINERS: Add CPU HOTPLUG entry
https://drive.google.com/file/d/1Uh7_1w … sp=sharing linux-6.4rc2.r43.g60be49bdf1d4-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1H41Z2i … sp=sharing linux-headers-6.4rc2.r43.g60be49bdf1d4-1-x86_64.pkg.tar.zst
Offline
$ git bisect bad Bisecting: 43 revisions left to test after this (roughly 6 steps) [60be49bdf1d4ddb9e2deb7aa718d5b8bc167ee4e] MAINTAINERS: Add CPU HOTPLUG entry
https://drive.google.com/file/d/1Uh7_1w … sp=sharing linux-6.4rc2.r43.g60be49bdf1d4-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1H41Z2i … sp=sharing linux-headers-6.4rc2.r43.g60be49bdf1d4-1-x86_64.pkg.tar.zst
Doesn't boot
Offline
$ git bisect bad
Bisecting: 21 revisions left to test after this (roughly 5 steps)
[5356297d12d9ee6f70d09485878904bc41bac422] cpu/hotplug: Remove cpu_report_state() and related unused cruft
https://drive.google.com/file/d/1-rnV6g … sp=sharing linux-6.4rc2.r21.g5356297d12d9-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1nweR5D … sp=sharing linux-headers-6.4rc2.r21.g5356297d12d9-1-x86_64.pkg.tar.zst
Offline
$ git bisect bad Bisecting: 21 revisions left to test after this (roughly 5 steps) [5356297d12d9ee6f70d09485878904bc41bac422] cpu/hotplug: Remove cpu_report_state() and related unused cruft
https://drive.google.com/file/d/1-rnV6g … sp=sharing linux-6.4rc2.r21.g5356297d12d9-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1nweR5D … sp=sharing linux-headers-6.4rc2.r21.g5356297d12d9-1-x86_64.pkg.tar.zst
Does boot (3rd attempt and no files on desktop, they are there in Dolphin btw)
Offline
$ git bisect good
Bisecting: 10 revisions left to test after this (roughly 4 steps)
[f54d4434c281f38b975d58de47adeca671beff4f] x86/apic: Provide cpu_primary_thread mask
https://drive.google.com/file/d/1kJ1ybU … sp=sharing linux-6.4rc2.r32.gf54d4434c281-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1IeMIyu … sp=sharing linux-headers-6.4rc2.r32.gf54d4434c281-1-x86_64.pkg.tar.zst
Offline
$ git bisect good Bisecting: 10 revisions left to test after this (roughly 4 steps) [f54d4434c281f38b975d58de47adeca671beff4f] x86/apic: Provide cpu_primary_thread mask
https://drive.google.com/file/d/1kJ1ybU … sp=sharing linux-6.4rc2.r32.gf54d4434c281-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1IeMIyu … sp=sharing linux-headers-6.4rc2.r32.gf54d4434c281-1-x86_64.pkg.tar.zst
Does boot
Offline
$ git bisect good
Bisecting: 5 revisions left to test after this (roughly 3 steps)
[0c7ffa32dbd6b09a87fea4ad1de8b27145dfd9a6] x86/smpboot/64: Implement arch_cpuhp_init_parallel_bringup() and enable it
https://drive.google.com/file/d/1S0E49Z … sp=sharing linux-6.4rc2.r37.g0c7ffa32dbd6-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1cK1R9l … sp=sharing linux-headers-6.4rc2.r37.g0c7ffa32dbd6-1-x86_64.pkg.tar.zst
Can you boot one of the bad kernels with cpuhp.parallel=0? If not try nosmp.
Offline
$ git bisect good Bisecting: 5 revisions left to test after this (roughly 3 steps) [0c7ffa32dbd6b09a87fea4ad1de8b27145dfd9a6] x86/smpboot/64: Implement arch_cpuhp_init_parallel_bringup() and enable it
https://drive.google.com/file/d/1S0E49Z … sp=sharing linux-6.4rc2.r37.g0c7ffa32dbd6-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1cK1R9l … sp=sharing linux-headers-6.4rc2.r37.g0c7ffa32dbd6-1-x86_64.pkg.tar.zst
Can you boot one of the bad kernels with cpuhp.parallel=0? If not try nosmp.
Doesn't boot
Offline
Doesn't boot
Did adding the kernel parameters cpuhp.parallel=0 have any effect? If not what about nosmp?
Edit:
$ git bisect bad
Bisecting: 2 revisions left to test after this (roughly 1 step)
[bea629d57d006733d155bdb65ba4867788da69b6] x86/apic: Save the APIC virtual base address
https://drive.google.com/file/d/1JCRvuK … sp=sharing linux-6.4rc2.r34.gbea629d57d00-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1XasETr … sp=sharing linux-headers-6.4rc2.r34.gbea629d57d00-1-x86_64.pkg.tar.zst
Last edited by loqs (2023-09-19 17:26:45)
Offline
Sandrino wrote:Doesn't boot
Did adding the kernel parameters cpuhp.parallel=0 have any effect? If not what about nosmp?
Edit:$ git bisect bad Bisecting: 2 revisions left to test after this (roughly 1 step) [bea629d57d006733d155bdb65ba4867788da69b6] x86/apic: Save the APIC virtual base address
https://drive.google.com/file/d/1JCRvuK … sp=sharing linux-6.4rc2.r34.gbea629d57d00-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1XasETr … sp=sharing linux-headers-6.4rc2.r34.gbea629d57d00-1-x86_64.pkg.tar.zst
linux-6.4rc2.r34.gbea629d57d00-1-x86_64.pkg.tar.zst does boot (3rd attempt)
Last edited by Sandrino (2023-09-19 19:16:18)
Offline
$ git bisect good
Bisecting: 0 revisions left to test after this (roughly 1 step)
[7e75178a0950c5ceffa2ca3225701b69752f7d3a] x86/smpboot: Support parallel startup of secondary CPUs
https://drive.google.com/file/d/109D8Bj … sp=sharing linux-6.4rc2.r36.g7e75178a0950-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1G09Y7B … sp=sharing linux-headers-6.4rc2.r36.g7e75178a0950-1-x86_64.pkg.tar.zst
Offline
Sandrino wrote:Doesn't boot
Did adding the kernel parameters cpuhp.parallel=0 have any effect? If not what about nosmp?
Edit:$ git bisect bad Bisecting: 2 revisions left to test after this (roughly 1 step) [bea629d57d006733d155bdb65ba4867788da69b6] x86/apic: Save the APIC virtual base address
https://drive.google.com/file/d/1JCRvuK … sp=sharing linux-6.4rc2.r34.gbea629d57d00-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1XasETr … sp=sharing linux-headers-6.4rc2.r34.gbea629d57d00-1-x86_64.pkg.tar.zst
linux-6.4rc2.r37.g0c7ffa32dbd6-1-x86_64.pkg.tar.zst with cpuhp.parallel=0 > doesn't boot
with nosmp does boot
Offline
$ git bisect good Bisecting: 0 revisions left to test after this (roughly 1 step) [7e75178a0950c5ceffa2ca3225701b69752f7d3a] x86/smpboot: Support parallel startup of secondary CPUs
https://drive.google.com/file/d/109D8Bj … sp=sharing linux-6.4rc2.r36.g7e75178a0950-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1G09Y7B … sp=sharing linux-headers-6.4rc2.r36.g7e75178a0950-1-x86_64.pkg.tar.zst
Doesn't boot
Offline
$ git bisect bad
Bisecting: 0 revisions left to test after this (roughly 0 steps)
[f6f1ae9128d2a080ecdd55f85e8a0ca3ed1d58eb] x86/smpboot: Implement a bit spinlock to protect the realmode stack
https://drive.google.com/file/d/1bzSAeA … sp=sharing linux-6.4rc2.r35.gf6f1ae9128d2-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1Pw-iNg … sp=sharing linux-headers-6.4rc2.r35.gf6f1ae9128d2-1-x86_64.pkg.tar.zst
Offline
$ git bisect bad Bisecting: 0 revisions left to test after this (roughly 0 steps) [f6f1ae9128d2a080ecdd55f85e8a0ca3ed1d58eb] x86/smpboot: Implement a bit spinlock to protect the realmode stack
https://drive.google.com/file/d/1bzSAeA … sp=sharing linux-6.4rc2.r35.gf6f1ae9128d2-1-x86_64.pkg.tar.zst
https://drive.google.com/file/d/1Pw-iNg … sp=sharing linux-headers-6.4rc2.r35.gf6f1ae9128d2-1-x86_64.pkg.tar.zst
Doesn't boot
Offline
$ git bisect bad
f6f1ae9128d2a080ecdd55f85e8a0ca3ed1d58eb is the first bad commit
commit f6f1ae9128d2a080ecdd55f85e8a0ca3ed1d58eb
Author: Thomas Gleixner <tglx@linutronix.de>
Date: Fri May 12 23:07:53 2023 +0200
x86/smpboot: Implement a bit spinlock to protect the realmode stack
Parallel AP bringup requires that the APs can run fully parallel through
the early startup code including the real mode trampoline.
To prepare for this implement a bit-spinlock to serialize access to the
real mode stack so that parallel upcoming APs are not going to corrupt each
others stack while going through the real mode startup code.
Co-developed-by: David Woodhouse <dwmw@amazon.co.uk>
Signed-off-by: David Woodhouse <dwmw@amazon.co.uk>
Signed-off-by: Thomas Gleixner <tglx@linutronix.de>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Tested-by: Michael Kelley <mikelley@microsoft.com>
Tested-by: Oleksandr Natalenko <oleksandr@natalenko.name>
Tested-by: Helge Deller <deller@gmx.de> # parisc
Tested-by: Guilherme G. Piccoli <gpiccoli@igalia.com> # Steam Deck
Link: https://lore.kernel.org/r/20230512205257.355425551@linutronix.de
arch/x86/include/asm/realmode.h | 3 +++
arch/x86/kernel/head_64.S | 12 ++++++++++++
arch/x86/realmode/init.c | 3 +++
arch/x86/realmode/rm/trampoline_64.S | 23 ++++++++++++++++++-----
4 files changed, 36 insertions(+), 5 deletions(-)
$ git bisect log
git bisect start
# status: waiting for both good and bad commits
# good: [6995e2de6891c724bfeb2db33d7b87775f913ad1] Linux 6.4
git bisect good 6995e2de6891c724bfeb2db33d7b87775f913ad1
# status: waiting for bad commit, 1 good commit known
# bad: [2dde18cd1d8fac735875f2e4987f11817cc0bc2c] Linux 6.5
git bisect bad 2dde18cd1d8fac735875f2e4987f11817cc0bc2c
# bad: [b775d6c5859affe00527cbe74263de05cfe6b9f9] Merge tag 'mips_6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/mips/linux
git bisect bad b775d6c5859affe00527cbe74263de05cfe6b9f9
# bad: [3a8a670eeeaa40d87bd38a587438952741980c18] Merge tag 'net-next-6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net-next
git bisect bad 3a8a670eeeaa40d87bd38a587438952741980c18
# bad: [6e17c6de3ddf3073741d9c91a796ee696914d8a0] Merge tag 'mm-stable-2023-06-24-19-15' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm
git bisect bad 6e17c6de3ddf3073741d9c91a796ee696914d8a0
# bad: [2605e80d3438c77190f55b821c6575048c68268e] Merge tag 'arm64-upstream' of git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux
git bisect bad 2605e80d3438c77190f55b821c6575048c68268e
# good: [0aa69d53ac7c30f6184f88f2e310d808b32b35a5] Merge tag 'for-6.5/io_uring-2023-06-23' of git://git.kernel.dk/linux
git bisect good 0aa69d53ac7c30f6184f88f2e310d808b32b35a5
# good: [7cffdbe3607a6cc2dc02d135e13732ec36bc4e28] Merge tag 'x86-boot-2023-06-26' of ssh://gitolite.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good 7cffdbe3607a6cc2dc02d135e13732ec36bc4e28
# bad: [5dfe7a7e52ccdf60dfd11ccbe509e4365ea721ca] Merge tag 'x86_tdx_for_6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect bad 5dfe7a7e52ccdf60dfd11ccbe509e4365ea721ca
# bad: [cd336f6562d3d7646a9cf071b902db200a1dd77b] Merge tag 'timers-core-2023-06-26' of ssh://gitolite.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect bad cd336f6562d3d7646a9cf071b902db200a1dd77b
# bad: [60be49bdf1d4ddb9e2deb7aa718d5b8bc167ee4e] MAINTAINERS: Add CPU HOTPLUG entry
git bisect bad 60be49bdf1d4ddb9e2deb7aa718d5b8bc167ee4e
# good: [5356297d12d9ee6f70d09485878904bc41bac422] cpu/hotplug: Remove cpu_report_state() and related unused cruft
git bisect good 5356297d12d9ee6f70d09485878904bc41bac422
# good: [f54d4434c281f38b975d58de47adeca671beff4f] x86/apic: Provide cpu_primary_thread mask
git bisect good f54d4434c281f38b975d58de47adeca671beff4f
# bad: [0c7ffa32dbd6b09a87fea4ad1de8b27145dfd9a6] x86/smpboot/64: Implement arch_cpuhp_init_parallel_bringup() and enable it
git bisect bad 0c7ffa32dbd6b09a87fea4ad1de8b27145dfd9a6
# good: [bea629d57d006733d155bdb65ba4867788da69b6] x86/apic: Save the APIC virtual base address
git bisect good bea629d57d006733d155bdb65ba4867788da69b6
# bad: [7e75178a0950c5ceffa2ca3225701b69752f7d3a] x86/smpboot: Support parallel startup of secondary CPUs
git bisect bad 7e75178a0950c5ceffa2ca3225701b69752f7d3a
# bad: [f6f1ae9128d2a080ecdd55f85e8a0ca3ed1d58eb] x86/smpboot: Implement a bit spinlock to protect the realmode stack
git bisect bad f6f1ae9128d2a080ecdd55f85e8a0ca3ed1d58eb
# first bad commit: [f6f1ae9128d2a080ecdd55f85e8a0ca3ed1d58eb] x86/smpboot: Implement a bit spinlock to protect the realmode stack
seth any thoughts?
Edit:
Can you boot with maxcpus=1 then bring up the other cores with "echo 1 > /sys/devices/system/cpu/cpuX/online"?
Last edited by loqs (2023-09-19 21:00:43)
Offline
"3rd attempt"…
https://bbs.archlinux.org/viewtopic.php … 6#p2121386
@Sandrino, have you tried the reglar 6.5 w/ nosmp?
Offline
"3rd attempt"…
https://bbs.archlinux.org/viewtopic.php … 6#p2121386@Sandrino, have you tried the reglar 6.5 w/ nosmp?
6.5.3 with nosmp does boot
Offline
So it's an intersection of ACPI and SMP and it's not the IRQ (we tested acpi=noirq, though you might want to make really REALLY sure that you didn't fatfinger that - happens )
"Great"
Can you strip the system? Remove or (in the BIOS) deactivate hardware (fingerprint, wifi, usb, thunderbolt, …)?
Offline
So it's an intersection of ACPI and SMP and it's not the IRQ (we tested acpi=noirq, though you might want to make really REALLY sure that you didn't fatfinger that - happens )
"Great"
Can you strip the system? Remove or (in the BIOS) deactivate hardware (fingerprint, wifi, usb, thunderbolt, …)?
Only the touch pad and network stack can be disabled
Offline
Did you try maxcpus=1 then bring up the other cores with "echo 1 > /sys/devices/system/cpu/cpuX/online"?
Edit:
Can you also retry the last bad kernel to increase the test count from 3 to say 10 or 15.
Last edited by loqs (2023-09-20 10:01:37)
Offline
Did you try maxcpus=1 then bring up the other cores with "echo 1 > /sys/devices/system/cpu/cpuX/online"?
6.5.3 with maxcpus=1 does boot but turning on others core does freeze the system after 2/3 switces; there are 8 logic core (quad core with HT)
edit: forgot to remove nosmp when adding maxcpus=1 into kernel parameters so what is wrote is wrong! Have to repeat the test
edit2: this time linux-6.4rc2.r35.gf6f1ae9128d2-1-x86_64.pkg.tar.zst did boot at first attempt
edit3: it seems that I can't get more than 3 core online on 6.5.3 with maxcpus=1 and enabling others with echo 1 > /sys/devices/system/cpu/cpuX/online
edit4: re-cecked linux-6.4rc2.r35.gf6f1ae9128d2-1-x86_64.pkg.tar.zst, this time did boot at 6th attempt
Last edited by Sandrino (2023-09-20 16:10:05)
Offline
Please retry 6.5.3 with cpuhp.parallel=0 ten plus times as the bisect log with linux-6.4rc2.r35.gf6f1ae9128d2-1-x86_64.pkg.tar.zst as good becomes:
$ git bisect log
git bisect start
# status: waiting for both good and bad commits
# good: [6995e2de6891c724bfeb2db33d7b87775f913ad1] Linux 6.4
git bisect good 6995e2de6891c724bfeb2db33d7b87775f913ad1
# bad: [2dde18cd1d8fac735875f2e4987f11817cc0bc2c] Linux 6.5
git bisect bad 2dde18cd1d8fac735875f2e4987f11817cc0bc2c
# bad: [b775d6c5859affe00527cbe74263de05cfe6b9f9] Merge tag 'mips_6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/mips/linux
git bisect bad b775d6c5859affe00527cbe74263de05cfe6b9f9
# bad: [3a8a670eeeaa40d87bd38a587438952741980c18] Merge tag 'net-next-6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net-next
git bisect bad 3a8a670eeeaa40d87bd38a587438952741980c18
# bad: [6e17c6de3ddf3073741d9c91a796ee696914d8a0] Merge tag 'mm-stable-2023-06-24-19-15' of git://git.kernel.org/pub/scm/linux/kernel/git/akpm/mm
git bisect bad 6e17c6de3ddf3073741d9c91a796ee696914d8a0
# bad: [2605e80d3438c77190f55b821c6575048c68268e] Merge tag 'arm64-upstream' of git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux
git bisect bad 2605e80d3438c77190f55b821c6575048c68268e
# good: [0aa69d53ac7c30f6184f88f2e310d808b32b35a5] Merge tag 'for-6.5/io_uring-2023-06-23' of git://git.kernel.dk/linux
git bisect good 0aa69d53ac7c30f6184f88f2e310d808b32b35a5
# good: [7cffdbe3607a6cc2dc02d135e13732ec36bc4e28] Merge tag 'x86-boot-2023-06-26' of ssh://gitolite.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect good 7cffdbe3607a6cc2dc02d135e13732ec36bc4e28
# bad: [5dfe7a7e52ccdf60dfd11ccbe509e4365ea721ca] Merge tag 'x86_tdx_for_6.5' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect bad 5dfe7a7e52ccdf60dfd11ccbe509e4365ea721ca
# bad: [cd336f6562d3d7646a9cf071b902db200a1dd77b] Merge tag 'timers-core-2023-06-26' of ssh://gitolite.kernel.org/pub/scm/linux/kernel/git/tip/tip
git bisect bad cd336f6562d3d7646a9cf071b902db200a1dd77b
# bad: [60be49bdf1d4ddb9e2deb7aa718d5b8bc167ee4e] MAINTAINERS: Add CPU HOTPLUG entry
git bisect bad 60be49bdf1d4ddb9e2deb7aa718d5b8bc167ee4e
# good: [5356297d12d9ee6f70d09485878904bc41bac422] cpu/hotplug: Remove cpu_report_state() and related unused cruft
git bisect good 5356297d12d9ee6f70d09485878904bc41bac422
# good: [f54d4434c281f38b975d58de47adeca671beff4f] x86/apic: Provide cpu_primary_thread mask
git bisect good f54d4434c281f38b975d58de47adeca671beff4f
# bad: [0c7ffa32dbd6b09a87fea4ad1de8b27145dfd9a6] x86/smpboot/64: Implement arch_cpuhp_init_parallel_bringup() and enable it
git bisect bad 0c7ffa32dbd6b09a87fea4ad1de8b27145dfd9a6
# good: [bea629d57d006733d155bdb65ba4867788da69b6] x86/apic: Save the APIC virtual base address
git bisect good bea629d57d006733d155bdb65ba4867788da69b6
# bad: [7e75178a0950c5ceffa2ca3225701b69752f7d3a] x86/smpboot: Support parallel startup of secondary CPUs
git bisect bad 7e75178a0950c5ceffa2ca3225701b69752f7d3a
# good: [f6f1ae9128d2a080ecdd55f85e8a0ca3ed1d58eb] x86/smpboot: Implement a bit spinlock to protect the realmode stack
git bisect good f6f1ae9128d2a080ecdd55f85e8a0ca3ed1d58eb
# first bad commit: [7e75178a0950c5ceffa2ca3225701b69752f7d3a] x86/smpboot: Support parallel startup of secondary CPUs
Offline