INFO: rcu detected stall in worker_thread (8)

Status: auto-obsoleted due to no activity on 2023/08/07 05:14
Subsystems: kernel
[Documentation on labels]
First crash: 1196d, last: 1196d
▶ ▼ Similar bugs (17)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in worker_thread (3) mm cgroups 1 1 2413d 2413d 0/29 closed as invalid on 2020/01/08 05:33
upstream INFO: rcu detected stall in worker_thread (4) mm cgroups 1 28 2413d 2413d 0/29 closed as invalid on 2020/01/09 08:13
linux-5.15 INFO: rcu detected stall in worker_thread 1 1 1054d 1054d 0/3 auto-obsoleted due to no activity on 2024/01/09 18:17
upstream INFO: rcu detected stall in worker_thread (5) kernel 1 2 1537d 1574d 0/29 auto-closed as invalid on 2022/08/31 00:50
android-6-12 INFO: rcu detected stall in worker_thread 1 1 310d 310d 0/1 auto-obsoleted due to no activity on 2026/01/09 16:24
upstream INFO: rcu detected stall in worker_thread (9) prio:low netfilter 1 syz, C done 5761 4h31m 1045d 0/29 upstream: reported C repro on 2023/10/07 18:33
upstream INFO: rcu detected stall in worker_thread (2) cgroups mm 1 12 2413d 2413d 0/29 closed as invalid on 2020/01/08 05:23
upstream INFO: rcu detected stall in worker_thread mm cgroups 1 150 2448d 2450d 0/29 closed as invalid on 2019/12/04 14:14
linux-6.1 INFO: rcu detected stall in worker_thread 1 6 789d 819d 0/3 auto-obsoleted due to no activity on 2024/09/27 16:46
linux-6.6 INFO: rcu detected stall in worker_thread origin:lts-only 1 syz, C done 324 3d05h 425d 0/2 upstream: reported C repro on 2025/06/18 07:15
upstream INFO: rcu detected stall in worker_thread (6) kernel 1 1 1413d 1413d 0/29 auto-obsoleted due to no activity on 2023/01/12 15:50
linux-6.1 INFO: rcu detected stall in worker_thread (3) 1 2 7h48m 28d 0/3 upstream: reported on 2026/07/20 15:45
linux-5.15 INFO: rcu detected stall in worker_thread (2) 1 4 792d 798d 0/3 auto-obsoleted due to no activity on 2024/09/24 04:34
upstream INFO: rcu detected stall in worker_thread (7) kernel 1 1 1306d 1306d 0/29 auto-obsoleted due to no activity on 2023/04/27 16:37
linux-6.1 INFO: rcu detected stall in worker_thread (2) 1 1 573d 573d 0/3 auto-obsoleted due to no activity on 2025/05/01 18:18
upstream INFO: task hung in crda_timeout_work (8) wireless prio:high 1 syz, C done error 648 2h25m 689d 0/29 upstream: reported C repro on 2024/09/27 16:53
android-5-15 BUG: soft lockup in worker_thread origin:lts 1 syz, C done 1 721d 721d 0/2 auto-obsoleted due to no activity on 2024/12/04 04:19

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	Tasks blocked on level-0 rcu_node (CPUs 0-1): P13406/1:b..l
rcu: 	(detected by 1, t=10504 jiffies, g=54449, q=47 ncpus=2)
task:syz-executor.0  state:R  running task     stack:25248 pid:13406 ppid:5026   flags:0x00004006
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5343 [inline]
 __schedule+0xc9a/0x5880 kernel/sched/core.c:6669
 preempt_schedule_common+0x45/0xb0 kernel/sched/core.c:6838
 preempt_schedule_thunk+0x1a/0x20 arch/x86/entry/thunk_64.S:34
 vprintk_emit+0x1ee/0x600 kernel/printk/printk.c:2308
 dev_vprintk_emit drivers/base/core.c:4840 [inline]
 dev_printk_emit+0xda/0x120 drivers/base/core.c:4851
 __netdev_printk+0x1dd/0x470 net/core/dev.c:11263
 netdev_info+0xdc/0x120 net/core/dev.c:11318
 nsim_udp_tunnel_set_port+0x297/0x3b0 drivers/net/netdevsim/udp_tunnels.c:34
 udp_tunnel_nic_device_sync_one net/ipv4/udp_tunnel_nic.c:223 [inline]
 udp_tunnel_nic_device_sync_by_port net/ipv4/udp_tunnel_nic.c:246 [inline]
 __udp_tunnel_nic_device_sync.part.0+0x86f/0xdb0 net/ipv4/udp_tunnel_nic.c:289
 __udp_tunnel_nic_device_sync net/ipv4/udp_tunnel_nic.c:283 [inline]
 udp_tunnel_nic_device_sync+0x108/0x180 net/ipv4/udp_tunnel_nic.c:312
 __udp_tunnel_nic_add_port+0x673/0xc80 net/ipv4/udp_tunnel_nic.c:531
 udp_tunnel_nic_add_port include/net/udp_tunnel.h:336 [inline]
 udp_tunnel_nic_add_port include/net/udp_tunnel.h:331 [inline]
 udp_tunnel_notify_add_rx_port+0x222/0x430 net/ipv4/udp_tunnel_core.c:127
 geneve_socket_create drivers/net/geneve.c:599 [inline]
 geneve_sock_add+0x649/0x910 drivers/net/geneve.c:674
 geneve_open+0x129/0x1c0 drivers/net/geneve.c:710
 __dev_open+0x297/0x4d0 net/core/dev.c:1415
 __dev_change_flags+0x587/0x750 net/core/dev.c:8566
 rtnl_configure_link+0xfe/0x260 net/core/rtnetlink.c:3263
 rtnl_newlink_create net/core/rtnetlink.c:3451 [inline]
 __rtnl_newlink+0x10f6/0x1840 net/core/rtnetlink.c:3660
 rtnl_newlink+0x68/0xa0 net/core/rtnetlink.c:3673
 rtnetlink_rcv_msg+0x43d/0xd50 net/core/rtnetlink.c:6395
 netlink_rcv_skb+0x165/0x440 net/netlink/af_netlink.c:2546
 netlink_unicast_kernel net/netlink/af_netlink.c:1339 [inline]
 netlink_unicast+0x547/0x7f0 net/netlink/af_netlink.c:1365
 netlink_sendmsg+0x925/0xe30 net/netlink/af_netlink.c:1913
 sock_sendmsg_nosec net/socket.c:724 [inline]
 sock_sendmsg+0xde/0x190 net/socket.c:747
 ____sys_sendmsg+0x71c/0x900 net/socket.c:2503
 ___sys_sendmsg+0x110/0x1b0 net/socket.c:2557
 __sys_sendmsg+0xf7/0x1c0 net/socket.c:2586
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x39/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7f042ee8c169
RSP: 002b:00007f042fbb3168 EFLAGS: 00000246 ORIG_RAX: 000000000000002e
RAX: ffffffffffffffda RBX: 00007f042efabf80 RCX: 00007f042ee8c169
RDX: 0000000000000000 RSI: 0000000020000080 RDI: 0000000000000007
RBP: 00007f042eee7ca1 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffe4e6544ef R14: 00007f042fbb3300 R15: 0000000000022000
 </TASK>
rcu: rcu_preempt kthread timer wakeup didn't happen for 10501 jiffies! g54449 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
rcu: 	Possible timer handling issue on cpu=0 timer-softirq=66577
rcu: rcu_preempt kthread starved for 10502 jiffies! g54449 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:I stack:28320 pid:15    ppid:2      flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5343 [inline]
 __schedule+0xc9a/0x5880 kernel/sched/core.c:6669
 schedule+0xde/0x1a0 kernel/sched/core.c:6745
 schedule_timeout+0x14e/0x2b0 kernel/time/timer.c:2167
 rcu_gp_fqs_loop+0x190/0x910 kernel/rcu/tree.c:1609
 rcu_gp_kthread+0x23a/0x360 kernel/rcu/tree.c:1808
 kthread+0x344/0x440 kernel/kthread.c:379
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 5201 Comm: kworker/u4:13 Not tainted 6.4.0-rc1-syzkaller-00001-gba0ad6ed89fd #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 04/14/2023
Workqueue:  0x0 (phy13)
RIP: 0010:variable_test_bit arch/x86/include/asm/bitops.h:228 [inline]
RIP: 0010:arch_test_bit arch/x86/include/asm/bitops.h:240 [inline]
RIP: 0010:_test_bit include/asm-generic/bitops/instrumented-non-atomic.h:142 [inline]
RIP: 0010:__lock_acquire+0xf07/0x5df0 kernel/locking/lockdep.c:5044
Code: 76 e6 ff 0f 0b 31 c0 e9 7b f7 ff ff 48 63 5c 24 10 be 08 00 00 00 48 89 d8 48 c1 e8 06 48 8d 3c c5 00 cd 51 91 e8 09 8e 70 00 <48> 0f a3 1d 01 20 ed 0f 0f 82 f9 f9 ff ff e8 e6 0e aa 02 85 c0 0f
RSP: 0018:ffffc90000007b20 EFLAGS: 00000046
RAX: 0000000000000001 RBX: 0000000000000ab6 RCX: ffffffff8164acf7
RDX: fffffbfff22a39cb RSI: 0000000000000008 RDI: ffffffff9151ce50
RBP: 000000000000004a R08: 0000000000000000 R09: ffffffff9151ce57
R10: fffffbfff22a39ca R11: 0000000000000000 R12: ffff88803430ec48
R13: ffff88803430e180 R14: 0000000000000001 R15: 0000000000000002
FS:  0000000000000000(0000) GS:ffff8880b9800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b2d43a000 CR3: 000000002fd8f000 CR4: 00000000003506f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 lock_acquire kernel/locking/lockdep.c:5691 [inline]
 lock_acquire+0x1b1/0x520 kernel/locking/lockdep.c:5656
 __raw_spin_lock include/linux/spinlock_api_smp.h:133 [inline]
 _raw_spin_lock+0x2e/0x40 kernel/locking/spinlock.c:154
 spin_lock include/linux/spinlock.h:350 [inline]
 advance_sched+0xd2/0xd20 net/sched/sch_taprio.c:929
 __run_hrtimer kernel/time/hrtimer.c:1685 [inline]
 __hrtimer_run_queues+0x5fa/0xbe0 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x320/0x7b0 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
 __sysvec_apic_timer_interrupt+0x14a/0x430 arch/x86/kernel/apic/apic.c:1112
 sysvec_apic_timer_interrupt+0x92/0xc0 arch/x86/kernel/apic/apic.c:1106
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:645
RIP: 0010:finish_task_switch.isra.0+0x2bf/0xc80 kernel/sched/core.c:5215
Code: 8b 3a 4c 89 e7 48 c7 02 00 00 00 00 ff d1 4d 85 ff 75 bf 4c 89 e7 e8 60 f8 ff ff e8 6b 10 32 00 fb 65 48 8b 1c 25 00 bc 03 00 <48> 8d bb e8 15 00 00 48 b8 00 00 00 00 00 fc ff df 48 89 fa 48 c1
RSP: 0018:ffffc9000560fc38 EFLAGS: 00000206
RAX: 0000000000af09db RBX: ffff88803430e180 RCX: 1ffffffff1cf2f71
RDX: 0000000000000000 RSI: 0000000000000001 RDI: 0000000000000000
RBP: ffffc9000560fc80 R08: 0000000000000001 R09: 0000000000000001
R10: fffffbfff1cf357a R11: 0000000000000000 R12: ffff8880b983c600
R13: ffff88807e468000 R14: 0000000000000000 R15: ffff8880b983d038
 context_switch kernel/sched/core.c:5346 [inline]
 __schedule+0xca2/0x5880 kernel/sched/core.c:6669
 schedule+0xde/0x1a0 kernel/sched/core.c:6745
 worker_thread+0x160/0x10c0 kernel/workqueue.c:2573
 kthread+0x344/0x440 kernel/kthread.c:379
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/05/09 05:10 upstream ba0ad6ed89fd f4168103 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-selinux-root INFO: rcu detected stall in worker_thread
* Struck through repros no longer work on HEAD.