INFO: rcu detected stall in wg_ratelimiter_gc_entries

Status: auto-obsoleted due to no activity on 2023/08/11 08:26
Subsystems: wireguard
[Documentation on labels]
First crash: 1189d, last: 1189d
▶ ▼ Similar bugs (8)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in wg_ratelimiter_gc_entries (5) wireguard 1 1 264d 264d 0/29 auto-obsoleted due to no activity on 2026/02/21 09:54
linux-6.1 INFO: rcu detected stall in wg_ratelimiter_gc_entries 1 1 1212d 1212d 0/3 auto-obsoleted due to no activity on 2023/08/18 11:48
upstream INFO: rcu detected stall in wg_ratelimiter_gc_entries (4) wireguard 1 2 468d 473d 0/29 auto-obsoleted due to no activity on 2025/08/01 02:14
linux-6.1 INFO: rcu detected stall in wg_ratelimiter_gc_entries (2) 1 1 742d 742d 0/3 auto-obsoleted due to no activity on 2024/11/10 07:30
upstream INFO: rcu detected stall in wg_ratelimiter_gc_entries (2) wireguard 1 syz, C done done 3 1094d 1093d 0/29 auto-obsoleted due to no activity on 2023/11/23 21:08
upstream INFO: rcu detected stall in wg_ratelimiter_gc_entries (3) wireguard 1 1 604d 604d 0/29 auto-obsoleted due to no activity on 2025/03/18 13:29
linux-5.15 INFO: rcu detected stall in wg_ratelimiter_gc_entries (2) 1 1 289d 289d 0/3 auto-obsoleted due to no activity on 2026/02/06 13:45
linux-5.15 INFO: rcu detected stall in wg_ratelimiter_gc_entries 1 1 748d 748d 0/3 auto-obsoleted due to no activity on 2024/11/04 15:33

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	1-...!: (1 GPs behind) idle=2fdc/1/0x4000000000000000 softirq=69900/69902 fqs=3
rcu: 	Tasks blocked on level-0 rcu_node (CPUs 0-1): P19170/1:b..l
rcu: 	(detected by 0, t=10502 jiffies, g=86193, q=165 ncpus=2)
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 17897 Comm: kworker/1:8 Not tainted 6.4.0-rc1-syzkaller-00133-g9a48d6046722 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 04/28/2023
Workqueue: events_power_efficient wg_ratelimiter_gc_entries
RIP: 0010:cpu_max_bits_warn include/linux/cpumask.h:143 [inline]
RIP: 0010:cpumask_check include/linux/cpumask.h:150 [inline]
RIP: 0010:cpumask_test_cpu include/linux/cpumask.h:504 [inline]
RIP: 0010:cpu_online include/linux/cpumask.h:1082 [inline]
RIP: 0010:trace_hrtimer_start include/trace/events/timer.h:198 [inline]
RIP: 0010:debug_activate kernel/time/hrtimer.c:476 [inline]
RIP: 0010:enqueue_hrtimer+0x46/0x320 kernel/time/hrtimer.c:1084
Code: df 4e 8a 48 89 ef e8 d9 c7 a3 02 0f 1f 44 00 00 e8 df a1 10 00 65 44 8b 25 c3 18 90 7e bf 07 00 00 00 44 89 e6 e8 ea 9d 10 00 <41> 83 fc 07 0f 87 5c 02 00 00 e8 bb a1 10 00 45 89 e4 be 08 00 00
RSP: 0018:ffffc900001e0e10 EFLAGS: 00000046
RAX: 0000000000010001 RBX: ffff8880b992b940 RCX: ffffffff8173a316
RDX: ffff88807ec5d940 RSI: 0000000000000000 RDI: 0000000000000005
RBP: ffff88803e4e8340 R08: 0000000000000005 R09: 0000000000000007
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000001
R13: 0000000000000000 R14: ffff8880b992b840 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff8880b9900000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000020404030 CR3: 000000007a3c7000 CR4: 0000000000350ee0
Call Trace:
 <IRQ>
 __run_hrtimer kernel/time/hrtimer.c:1702 [inline]
 __hrtimer_run_queues+0xa5b/0xbe0 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x320/0x7b0 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
 __sysvec_apic_timer_interrupt+0x14a/0x430 arch/x86/kernel/apic/apic.c:1112
 sysvec_apic_timer_interrupt+0x92/0xc0 arch/x86/kernel/apic/apic.c:1106
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x1a/0x20 arch/x86/include/asm/idtentry.h:645
RIP: 0010:resched_offsets_ok kernel/sched/core.c:10102 [inline]
RIP: 0010:__might_resched+0x66/0x580 kernel/sched/core.c:10117
Code: 8d be 3c 04 00 00 65 8b 05 8f 90 ab 7e 48 89 fa 25 ff ff ff 7f 48 c1 ea 03 41 89 c5 48 b8 00 00 00 00 00 fc ff df 0f b6 14 02 <48> 89 f8 83 e0 07 83 c0 03 38 d0 7c 08 84 d2 0f 85 54 04 00 00 41
RSP: 0018:ffffc900156b7c98 EFLAGS: 00000217
RAX: dffffc0000000000 RBX: 0000000000000000 RCX: 0000000000000001
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff88807ec5dd7c
RBP: ffffffff8ae2a640 R08: 0000000000000000 R09: ffffffff8d619d83
R10: fffffbfff1ac33b0 R11: 0000000000000000 R12: 000000000000004e
R13: 0000000000000000 R14: ffff88807ec5d940 R15: 0000000000000fd0
 wg_ratelimiter_gc_entries+0x2f5/0x430 drivers/net/wireguard/ratelimiter.c:78
 process_one_work+0x99a/0x15e0 kernel/workqueue.c:2405
 worker_thread+0x67d/0x10c0 kernel/workqueue.c:2552
 kthread+0x344/0x440 kernel/kthread.c:379
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
task:syz-executor.2  state:R  running task     stack:29400 pid:19170 ppid:5045   flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5343 [inline]
 __schedule+0xc9a/0x5880 kernel/sched/core.c:6669
 preempt_schedule_common+0x45/0xb0 kernel/sched/core.c:6838
 preempt_schedule_thunk+0x1a/0x20 arch/x86/entry/thunk_64.S:34
 __raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline]
 _raw_spin_unlock_irqrestore+0x5b/0x70 kernel/locking/spinlock.c:194
 spin_unlock_irqrestore include/linux/spinlock.h:405 [inline]
 timerfd_clock_was_set+0x166/0x310 fs/timerfd.c:113
 clock_was_set+0x1b1/0x810 kernel/time/hrtimer.c:980
 timekeeping_inject_offset+0x4b4/0x620 kernel/time/timekeeping.c:1395
 do_adjtimex+0x333/0xa40 kernel/time/timekeeping.c:2444
 do_clock_adjtime kernel/time/posix-timers.c:1122 [inline]
 __do_sys_clock_adjtime+0x163/0x270 kernel/time/posix-timers.c:1134
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x39/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7f2fb728c169
RSP: 002b:00007f2fb809d168 EFLAGS: 00000246 ORIG_RAX: 0000000000000131
RAX: ffffffffffffffda RBX: 00007f2fb73ac050 RCX: 00007f2fb728c169
RDX: 0000000000000000 RSI: 0000000020000040 RDI: 0000000000000000
RBP: 00007f2fb72e7ca1 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffd1519736f R14: 00007f2fb809d300 R15: 0000000000022000
 </TASK>
rcu: rcu_preempt kthread starved for 10496 jiffies! g86193 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:R  running task     stack:28088 pid:16    ppid:2      flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5343 [inline]
 __schedule+0xc9a/0x5880 kernel/sched/core.c:6669
 schedule+0xde/0x1a0 kernel/sched/core.c:6745
 schedule_timeout+0x14e/0x2b0 kernel/time/timer.c:2167
 rcu_gp_fqs_loop+0x190/0x910 kernel/rcu/tree.c:1609
 rcu_gp_kthread+0x23a/0x360 kernel/rcu/tree.c:1808
 kthread+0x344/0x440 kernel/kthread.c:379
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
CPU: 0 PID: 55 Comm: kworker/u4:3 Not tainted 6.4.0-rc1-syzkaller-00133-g9a48d6046722 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 04/28/2023
Workqueue: events_unbound toggle_allocation_gate
RIP: 0010:csd_lock_wait kernel/smp.c:285 [inline]
RIP: 0010:smp_call_function_many_cond+0x684/0x15a0 kernel/smp.c:828
Code: 0b 00 85 ed 74 48 48 8b 44 24 08 49 89 c4 83 e0 07 49 c1 ec 03 48 89 c5 4d 01 f4 83 c5 03 e8 b3 40 0b 00 f3 90 41 0f b6 04 24 <40> 38 c5 7c 08 84 c0 0f 85 ad 0c 00 00 8b 43 08 31 ff 83 e0 01 41
RSP: 0018:ffffc90001567948 EFLAGS: 00000293
RAX: 0000000000000000 RBX: ffff8880b9943220 RCX: 0000000000000000
RDX: ffff888017a61dc0 RSI: ffffffff8179042d RDI: 0000000000000005
RBP: 0000000000000003 R08: 0000000000000005 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: ffffed1017328645
R13: 0000000000000001 R14: dffffc0000000000 R15: 0000000000000001
FS:  0000000000000000(0000) GS:ffff8880b9800000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fee988d9768 CR3: 000000000c571000 CR4: 0000000000350ef0
Call Trace:
 <TASK>
 on_each_cpu_cond_mask+0x5a/0xa0 kernel/smp.c:996
 on_each_cpu include/linux/smp.h:71 [inline]
 text_poke_sync arch/x86/kernel/alternative.c:1770 [inline]
 text_poke_bp_batch+0x237/0x770 arch/x86/kernel/alternative.c:1970
 text_poke_flush arch/x86/kernel/alternative.c:2161 [inline]
 text_poke_flush arch/x86/kernel/alternative.c:2158 [inline]
 text_poke_finish+0x1a/0x30 arch/x86/kernel/alternative.c:2168
 arch_jump_label_transform_apply+0x17/0x30 arch/x86/kernel/jump_label.c:146
 jump_label_update+0x32f/0x410 kernel/jump_label.c:829
 static_key_enable_cpuslocked+0x1b5/0x270 kernel/jump_label.c:205
 static_key_enable+0x1a/0x20 kernel/jump_label.c:218
 toggle_allocation_gate mm/kfence/core.c:831 [inline]
 toggle_allocation_gate+0xf8/0x230 mm/kfence/core.c:823
 process_one_work+0x99a/0x15e0 kernel/workqueue.c:2405
 worker_thread+0x67d/0x10c0 kernel/workqueue.c:2552
 kthread+0x344/0x440 kernel/kthread.c:379
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:308
 </TASK>

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2023/05/13 08:25 upstream 9a48d6046722 2b9ba477 .config console log report info [disk image] [vmlinux] [kernel image] ci-upstream-kasan-gce-root INFO: rcu detected stall in wg_ratelimiter_gc_entries
* Struck through repros no longer work on HEAD.