Intel NUC J3455 Linux Kernel freeze slowness 4.4.98 errors

It looks like this has something to do with APIC but I am not sure. I have similar CPUs with a different MB and BIOS that work fine on the same type of kernel. A lot of time the issue is because of the C-step setting in the BIOS.

The same thing happened on the 2.6 kernel with Centos 6 but this is a homebrew 4.4 kernel so I am not sure why it is happening when even Centos 7 (3.2) kernel works OK.

Solution - It comes down to the BIOS settings:

*The most critical part is this:

Boot:

OS Selection "Linux" (now note this is weird but even if you are booting without UEFI this setting applies still).

If you don't choose Linux as your OS everything runs snail slow.

Security:

Disable "Execute Disable Bit"

Disable "Intel Platform Trust"

Power:

Disable "Enhanced Intel Speedstep Technology"

Disable "OS ACPI C2 Report"

[72799.017154] INFO: rcu_sched detected stalls on CPUs/tasks: [72799.017193] 1-...: (185 GPs behind) idle=832/0/0 softirq=52330/52330 fqs=0 [72799.017220] (detected by 0, t=5252 jiffies, g=1775778, c=1775777, q=678) [72799.017249] Task dump for CPU 1: [72799.017270] swapper/1 R running 0 0 1 0x00200008 [72799.017301] 00200086 00000000 00000000 00000000 c1037b90 f34f0000 c147140d 0 [72799.017353] 00000000 00000000 00000000 00000001 00000000 00000000 0000007b b [72799.017405] f3bb00d8 00000000 ffffff10 c100bc48 00000060 00200246 00000000 a [72799.017458] Call Trace: [72799.017486] [] ? smp_apic_timer_interrupt+0x30/0x40 [72799.017515] [] ? apic_timer_interrupt+0x2d/0x34 [72799.017542] [] ? mwait_idle+0x68/0x150 [72799.017568] [] ? arch_cpu_idle+0x6/0x10 [72799.017593] [] ? cpu_startup_entry+0x1dd/0x2d0 [72799.017618] [] ? setup_APIC_timer+0x9b/0xb0 [72799.017645] rcu_sched kthread starved for 5252 jiffies! g1775778 c1775777 f00 [72862.037828] INFO: rcu_sched detected stalls on CPUs/tasks: [72862.037866] 1-...: (185 GPs behind) idle=832/0/0 softirq=52330/52330 fqs=0 [72862.037893] (detected by 0, t=21007 jiffies, g=1775778, c=1775777, q=3093) [72862.037923] Task dump for CPU 1: [72862.037944] swapper/1 R running 0 0 1 0x00200008 [72862.037975] 00200086 00000000 00000000 00000000 c1037b90 f34f0000 c147140d 0 [72862.038028] 00000000 00000000 00000000 00000001 00000000 00000000 0000007b b [72862.038080] f3bb00d8 00000000 ffffff10 c100bc48 00000060 00200246 00000000 a [72862.038132] Call Trace: [72862.038161] [] ? smp_apic_timer_interrupt+0x30/0x40 [72862.038190] [] ? apic_timer_interrupt+0x2d/0x34 [72862.038216] [] ? mwait_idle+0x68/0x150 [72862.038242] [] ? arch_cpu_idle+0x6/0x10 [72862.038268] [] ? cpu_startup_entry+0x1dd/0x2d0 [72862.038293] [] ? setup_APIC_timer+0x9b/0xb0 [72862.038320] rcu_sched kthread starved for 21007 jiffies! g1775778 c1775777 f0 [72925.058501] INFO: rcu_sched detected stalls on CPUs/tasks: [72925.058539] 1-...: (185 GPs behind) idle=832/0/0 softirq=52330/52330 fqs=0 [72925.058566] (detected by 2, t=36762 jiffies, g=1775778, c=1775777, q=5985) [72925.058596] Task dump for CPU 1: [72925.058617] swapper/1 R running 0 0 1 0x00200008 [72925.058648] 00200086 00000000 00000000 00000000 c1037b90 f34f0000 c147140d 0 [72925.058701] 00000000 00000000 00000000 00000001 00000000 00000000 0000007b b [72925.058752] f3bb00d8 00000000 ffffff10 c100bc48 00000060 00200246 00000000 a [72925.058805] Call Trace: [72925.058834] [] ? smp_apic_timer_interrupt+0x30/0x40 [72925.058863] [] ? apic_timer_interrupt+0x2d/0x34 [72925.058890] [] ? mwait_idle+0x68/0x150 [72925.058915] [] ? arch_cpu_idle+0x6/0x10 [72925.058941] [] ? cpu_startup_entry+0x1dd/0x2d0 [72925.058967] [] ? setup_APIC_timer+0x9b/0xb0 [72925.058993] rcu_sched kthread starved for 36762 jiffies! g1775778 c1775777 f0 [72988.079176] INFO: rcu_sched detected stalls on CPUs/tasks: [72988.079216] 1-...: (185 GPs behind) idle=832/0/0 softirq=52330/52330 fqs=0 [72988.079243] (detected by 0, t=52517 jiffies, g=1775778, c=1775777, q=9582) [72988.079273] Task dump for CPU 1: [72988.079294] swapper/1 R running 0 0 1 0x00200008 [72988.079325] 00200086 00000000 00000000 00000000 c1037b90 f34f0000 c147140d 0 [72988.079378] 00000000 00000000 00000000 00000001 00000000 00000000 0000007b b [72988.079430] f3bb00d8 00000000 ffffff10 c100bc48 00000060 00200246 00000000 a [72988.079482] Call Trace: [72988.079511] [] ? smp_apic_timer_interrupt+0x30/0x40 [72988.079539] [] ? apic_timer_interrupt+0x2d/0x34 [72988.079566] [] ? mwait_idle+0x68/0x150 [72988.079592] [] ? arch_cpu_idle+0x6/0x10 [72988.079617] [] ? cpu_startup_entry+0x1dd/0x2d0 [72988.079643] [] ? setup_APIC_timer+0x9b/0xb0 [72988.079669] rcu_sched kthread starved for 52517 jiffies! g1775778 c1775777 f0 [73051.099850] INFO: rcu_sched detected stalls on CPUs/tasks: [73051.099888] 1-...: (185 GPs behind) idle=832/0/0 softirq=52330/52330 fqs=0 [73051.099915] (detected by 0, t=68272 jiffies, g=1775778, c=1775777, q=12493) [73051.099946] Task dump for CPU 1: [73051.099966] swapper/1 R running 0 0 1 0x00200008 [73051.099997] 00200086 00000000 00000000 00000000 c1037b90 f34f0000 c147140d 0 [73051.100050] 00000000 00000000 00000000 00000001 00000000 00000000 0000007b b [73051.100102] f3bb00d8 00000000 ffffff10 c100bc48 00000060 00200246 00000000 a [73051.100154] Call Trace: [73051.100183] [] ? smp_apic_timer_interrupt+0x30/0x40 [73051.100211] [] ? apic_timer_interrupt+0x2d/0x34 [73051.100238] [] ? mwait_idle+0x68/0x150 [73051.100264] [] ? arch_cpu_idle+0x6/0x10 [73051.100289] [] ? cpu_startup_entry+0x1dd/0x2d0 [73051.100315] [] ? setup_APIC_timer+0x9b/0xb0 [73051.100341] rcu_sched kthread starved for 68272 jiffies! g1775778 c1775777 f0 [73114.120521] INFO: rcu_sched detected stalls on CPUs/tasks: [73114.120560] 1-...: (185 GPs behind) idle=832/0/0 softirq=52330/52330 fqs=0 [73114.120588] (detected by 3, t=84027 jiffies, g=1775778, c=1775777, q=15681) [73114.120618] Task dump for CPU 1: [73114.120639] swapper/1 R running 0 0 1 0x00200008 [73114.120670] 00200086 00000000 00000000 00000000 c1037b90 f34f0000 c147140d 0 [73114.120722] 00000000 00000000 00000000 00000001 00000000 00000000 0000007b b [73114.120774] f3bb00d8 00000000 ffffff10 c100bc48 00000060 00200246 00000000 a [73114.120827] Call Trace: [73114.120856] [] ? smp_apic_timer_interrupt+0x30/0x40 [73114.120884] [] ? apic_timer_interrupt+0x2d/0x34 [73114.120911] [] ? mwait_idle+0x68/0x150 [73114.120937] [] ? arch_cpu_idle+0x6/0x10 [73114.120962] [] ? cpu_startup_entry+0x1dd/0x2d0 [73114.120988] [] ? setup_APIC_timer+0x9b/0xb0 [73114.121014] rcu_sched kthread starved for 84027 jiffies! g1775778 c1775777 f0 [73177.141194] INFO: rcu_sched detected stalls on CPUs/tasks: [73177.141232] 1-...: (185 GPs behind) idle=832/0/0 softirq=52330/52330 fqs=0 [73177.141259] (detected by 2, t=99782 jiffies, g=1775778, c=1775777, q=18837) [73177.141289] Task dump for CPU 1: [73177.141310] swapper/1 R running 0 0 1 0x00200008 [73177.141340] 00200086 00000000 00000000 00000000 c1037b90 f34f0000 c147140d 0 [73177.141393] 00000000 00000000 00000000 00000001 00000000 00000000 0000007b b [73177.141445] f3bb00d8 00000000 ffffff10 c100bc48 00000060 00200246 00000000 a [73177.141497] Call Trace: [73177.141525] [] ? smp_apic_timer_interrupt+0x30/0x40 [73177.141554] [] ? apic_timer_interrupt+0x2d/0x34 [73177.141581] [] ? mwait_idle+0x68/0x150 [73177.141607] [] ? arch_cpu_idle+0x6/0x10 [73177.141632] [] ? cpu_startup_entry+0x1dd/0x2d0 [73177.141658] [] ? setup_APIC_timer+0x9b/0xb0 [73177.141684] rcu_sched kthread starved for 99782 jiffies! g1775778 c1775777 f0 [73240.161868] INFO: rcu_sched detected stalls on CPUs/tasks: [73240.161906] 1-...: (185 GPs behind) idle=832/0/0 softirq=52330/52330 fqs=0 [73240.161934] (detected by 3, t=115537 jiffies, g=1775778, c=1775777, q=22200) [73240.161964] Task dump for CPU 1: [73240.161985] swapper/1 R running 0 0 1 0x00200008 [73240.162016] 00200086 00000000 00000000 00000000 c1037b90 f34f0000 c147140d 0 [73240.162069] 00000000 00000000 00000000 00000001 00000000 00000000 0000007b b [73240.162121] f3bb00d8 00000000 ffffff10 c100bc48 00000060 00200246 00000000 a [73240.162173] Call Trace: [73240.163521] [] ? smp_apic_timer_interrupt+0x30/0x40 [73240.163550] [] ? apic_timer_interrupt+0x2d/0x34 [73240.163577] [] ? mwait_idle+0x68/0x150 [73240.163603] [] ? arch_cpu_idle+0x6/0x10 [73240.163628] [] ? cpu_startup_entry+0x1dd/0x2d0 [73240.163654] [] ? setup_APIC_timer+0x9b/0xb0 [73240.163680] rcu_sched kthread starved for 115537 jiffies! g1775778 c1775777 0 [73303.182543] INFO: rcu_sched detected stalls on CPUs/tasks: [73303.182582] 1-...: (185 GPs behind) idle=832/0/0 softirq=52330/52330 fqs=0 [73303.182609] (detected by 0, t=131292 jiffies, g=1775778, c=1775777, q=24499) [73303.182639] Task dump for CPU 1: [73303.182660] swapper/1 R running 0 0 1 0x00200008 [73303.182691] 00200086 00000000 00000000 00000000 c1037b90 f34f0000 c147140d 0 [73303.182743] 00000000 00000000 00000000 00000001 00000000 00000000 0000007b b [73303.182796] f3bb00d8 00000000 ffffff10 c100bc48 00000060 00200246 00000000 a [73303.182848] Call Trace: [73303.182877] [] ? smp_apic_timer_interrupt+0x30/0x40 [73303.182906] [] ? apic_timer_interrupt+0x2d/0x34 [73303.182932] [] ? mwait_idle+0x68/0x150 [73303.182958] [] ? arch_cpu_idle+0x6/0x10 [73303.182984] [] ? cpu_startup_entry+0x1dd/0x2d0 [73303.183009] [] ? setup_APIC_timer+0x9b/0xb0 [73303.183035] rcu_sched kthread starved for 131292 jiffies! g1775778 c1775777 0 [73366.203215] INFO: rcu_sched detected stalls on CPUs/tasks: [73366.203254] 1-...: (185 GPs behind) idle=832/0/0 softirq=52330/52330 fqs=0 [73366.203281] (detected by 3, t=147047 jiffies, g=1775778, c=1775777, q=26783) [73366.203311] Task dump for CPU 1: [73366.203332] swapper/1 R running 0 0 1 0x00200008 [73366.203363] 00200086 00000000 00000000 00000000 c1037b90 f34f0000 c147140d 0 [73366.203416] 00000000 00000000 00000000 00000001 00000000 00000000 0000007b b [73366.203468] f3bb00d8 00000000 ffffff10 c100bc48 00000060 00200246 00000000 a [73366.203520] Call Trace: [73366.203549] [] ? smp_apic_timer_interrupt+0x30/0x40 [73366.203578] [] ? apic_timer_interrupt+0x2d/0x34 [73366.203604] [] ? mwait_idle+0x68/0x150 [73366.203630] [] ? arch_cpu_idle+0x6/0x10 [73366.203656] [] ? cpu_startup_entry+0x1dd/0x2d0 [73366.203681] [] ? setup_APIC_timer+0x9b/0xb0 [73366.203707] rcu_sched kthread starved for 147047 jiffies! g1775778 c1775777 0

You may also get errors like these:

[ 299.955483] mce: [Hardware Error]: Machine check events logged

Other symptoms are that everything seems to run very slow such as basic keyboard input there is a lot of lag even when opening top or waiting for the output of dmesg etc..When typing it basically feels like you are on a dialup modem connecting to a server on the other side of the world with packet loss or that is saturated.

Tags:

intel, nuc, linux, kernel, slowness, errorsit, apic, cpus, mb, bios, centos, homebrew, ok, settings, os, quot, booting, uefi, applies, snail, disable, execute, platform, enhanced, speedstep, acpi, info, rcu_sched, detected, stalls, tasks, gps, idle, softirq, fqs, jiffies, task, cpu, swapper, bb, ffffff, bc, smp_apic_timer_interrupt, apic_timer_interrupt, mwait_idle, arch_cpu_idle, cpu_startup_entry, dd, setup_apic_timer, xb, kthread, starved, errors, mce, hardware, logged, keyboard, input, lag, output, dmesg, etc, typing, dialup, modem, connecting, server, packet, saturated,