BUG: soft lockup in net_rx_action

Status: auto-obsoleted due to no activity on 2024/11/18 17:50
Reported-by: syzbot+7022be6ce201252d232f@syzkaller.appspotmail.com
First crash: 735d, last: 723d
▶ ▼ Similar bugs (11)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
upstream INFO: rcu detected stall in net_rx_action (3) kvm 1 67 1570d 1571d 0/29 auto-closed as invalid on 2022/06/05 10:21
android-5-15 BUG: soft lockup in net_rx_action 1 1 848d 848d 0/2 auto-obsoleted due to no activity on 2024/07/16 07:14
android-6-1 BUG: soft lockup in net_rx_action 1 2 741d 784d 0/2 auto-obsoleted due to no activity on 2024/10/31 15:08
upstream INFO: rcu detected stall in net_rx_action (5) virt wireguard wireless 1 3 840d 877d 0/29 auto-obsoleted due to no activity on 2024/07/25 01:10
android-54 BUG: soft lockup in net_rx_action 1 1 788d 788d 0/2 auto-obsoleted due to no activity on 2024/09/14 14:52
linux-4.19 BUG: soft lockup in net_rx_action (2) 1 1 1407d 1407d 0/1 auto-obsoleted due to no activity on 2023/02/03 20:26
android-5-15 BUG: soft lockup in net_rx_action (2) 1 1 730d 730d 0/2 auto-obsoleted due to no activity on 2024/11/11 18:48
linux-4.19 BUG: soft lockup in net_rx_action 1 1 1670d 1670d 0/1 auto-closed as invalid on 2022/05/16 12:13
linux-5.15 INFO: rcu detected stall in net_rx_action 1 1 1059d 1059d 0/3 auto-obsoleted due to no activity on 2023/12/28 19:24
upstream INFO: rcu detected stall in net_rx_action (2) batman 1 1 1724d 1724d 0/29 closed as invalid on 2022/02/08 10:10
upstream INFO: rcu detected stall in net_rx_action (4) kernel 1 1 1287d 1287d 0/29 auto-obsoleted due to no activity on 2023/05/05 00:12

Sample crash report:
watchdog: BUG: soft lockup - CPU#0 stuck for 122s! [syz.4.192:1590]
Modules linked in:
CPU: 0 PID: 1590 Comm: syz.4.192 Not tainted 5.10.223-syzkaller-01561-g0890c03b8b7d #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/27/2024
RIP: 0010:__list_add_valid+0x0/0xf0 lib/list_debug.c:22
Code: 89 f7 e8 03 bb 51 ff e9 73 ff ff ff e8 99 21 14 ff 0f 0b e8 92 21 14 ff 0f 0b e8 4b 39 56 02 cc cc cc cc cc cc cc cc cc cc cc <55> 48 89 e5 41 57 41 56 41 55 41 54 53 48 85 f6 0f 84 8b 00 00 00
RSP: 0018:ffffc90000007a18 EFLAGS: 00000246
RAX: 1ffff92000000f59 RBX: dffffc0000000000 RCX: dffffc0000000000
RDX: ffffc90000007ac0 RSI: ffffc90000007ac0 RDI: ffff88811738fa00
RBP: ffffc90000007b70 R08: ffffffff83c59043 R09: ffffffff83c54c4c
R10: 0000000000000003 R11: ffff888115df3b40 R12: ffffc90000007ac0
R13: ffff88811738fa00 R14: 1ffff11022e71f40 R15: ffffc90000007ac0
FS:  00007fabb414b6c0(0000) GS:ffff8881f7000000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000001b3401fffc CR3: 000000012e7b2000 CR4: 00000000003506b0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <IRQ>
 gro_normal_list net/core/dev.c:5789 [inline]
 napi_complete_done+0x344/0x750 net/core/dev.c:6538
 virtqueue_napi_complete drivers/net/virtio_net.c:357 [inline]
 virtnet_poll+0xb60/0x11f0 drivers/net/virtio_net.c:1537
 napi_poll net/core/dev.c:6854 [inline]
 net_rx_action+0x516/0x10d0 net/core/dev.c:6924
 __do_softirq+0x268/0x5bb kernel/softirq.c:309
 asm_call_irq_on_stack+0xf/0x20
 </IRQ>
 __run_on_irqstack arch/x86/include/asm/irq_stack.h:26 [inline]
 run_on_irqstack_cond arch/x86/include/asm/irq_stack.h:77 [inline]
 do_softirq_own_stack+0x60/0x80 arch/x86/kernel/irq_64.c:77
 invoke_softirq kernel/softirq.c:405 [inline]
 __irq_exit_rcu+0x128/0x150 kernel/softirq.c:435
 irq_exit_rcu+0x9/0x10 kernel/softirq.c:447
 sysvec_apic_timer_interrupt+0xbf/0xe0 arch/x86/kernel/apic/apic.c:1094
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:635
RIP: 0010:release_task_stack kernel/fork.c:435 [inline]
RIP: 0010:put_task_stack+0x6f/0x120 kernel/fork.c:450
Code: 00 00 00 49 be 00 00 00 00 00 fc ff df 49 8d 5f 10 48 89 d8 48 c1 e8 03 42 80 3c 30 00 74 08 48 89 df e8 34 fd 6a 00 48 8b 1b <bf> 80 00 00 00 48 89 de e8 84 68 2d 00 48 81 fb 80 00 00 00 75 78
RSP: 0018:ffffc9000122fbd8 EFLAGS: 00000246
RAX: 1ffff11022bbe002 RBX: 0000000000000080 RCX: ffffffff813d4465
RDX: ffff888115df3b40 RSI: 0000000000000001 RDI: 0000000000000001
RBP: ffffc9000122fbf0 R08: ffffffff813d447f R09: ffffed1022bbe166
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff8881f7055fc0
R13: ffff888115df4018 R14: dffffc0000000000 R15: ffff888115df0000
 finish_task_switch+0x24a/0x5a0 kernel/sched/core.c:3916
 context_switch kernel/sched/core.c:4049 [inline]
 __schedule+0xbee/0x1330 kernel/sched/core.c:4804
 preempt_schedule_irq+0xc7/0x140 kernel/sched/core.c:5065
 irqentry_exit_cond_resched kernel/entry/common.c:365 [inline]
 irqentry_exit+0x4f/0x60 kernel/entry/common.c:395
 sysvec_apic_timer_interrupt+0xcb/0xe0 arch/x86/kernel/apic/apic.c:1094
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:635
RIP: 0010:exit_to_user_mode_loop+0x41/0xd0 kernel/entry/common.c:159
Code: 89 fe eb 22 e8 90 4a 52 00 e8 8b 8f f0 00 fa 65 48 8b 05 d2 08 a9 7e 48 8b 18 f7 c3 0e 30 08 00 0f 84 87 00 00 00 fb f6 c3 08 <74> 05 e8 08 b4 57 03 f7 c3 00 10 00 00 74 08 4c 89 f7 e8 18 71 34
RSP: 0000:ffffc9000122fee0 EFLAGS: 00000202
RAX: 0000000000000000 RBX: 0000000000000008 RCX: ffff888115df3b40
RDX: 1ffff11022bbe76c RSI: 0000000000000008 RDI: ffffc9000122ff58
RBP: ffffc9000122fef0 R08: ffffffff87084008 R09: ffffffff87084018
R10: ffffffff87084010 R11: ffffffff87084003 R12: ffffffff84c00c7a
R13: 0000000000000000 R14: ffffc9000122ff58 R15: 0000000000000000
 exit_to_user_mode_prepare kernel/entry/common.c:199 [inline]
 irqentry_exit_to_user_mode+0x4e/0x80 kernel/entry/common.c:287
 irqentry_exit+0x12/0x60 kernel/entry/common.c:375
 sysvec_apic_timer_interrupt+0xcb/0xe0 arch/x86/kernel/apic/apic.c:1094
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:635
RIP: 0033:0x7fabb54cde81
Code: 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 48 3d 01 f0 ff ff 73 01 <c3> 48 c7 c1 a8 ff ff ff f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f
RSP: 002b:00007fabb414b038 EFLAGS: 00000217
RAX: 0000000000000000 RBX: 00007fabb5669f80 RCX: 00007fabb54cde79
RDX: 00000000200006c0 RSI: 0000000000005452 RDI: 0000000000000003
RBP: 00007fabb553b916 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000000000 R14: 00007fabb5669f80 R15: 00007ffd80279918
Sending NMI from CPU 0 to CPUs 1:
NMI backtrace for cpu 1
CPU: 1 PID: 1215 Comm: syz.1.138 Not tainted 5.10.223-syzkaller-01561-g0890c03b8b7d #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 06/27/2024
RIP: 0010:__hrtimer_get_next_event+0x55f/0x5b0 kernel/time/hrtimer.c:591
Code: 10 e8 c5 a1 0f 00 4c 8b 75 c8 eb 05 e8 ba a1 0f 00 31 c0 4d 85 f6 4c 0f 4e f0 4c 89 f0 48 83 c4 48 5b 41 5c 41 5d 41 5e 41 5f <5d> c3 44 89 f1 80 e1 07 38 c1 0f 8c cf fa ff ff 4c 89 f7 e8 09 3a
RSP: 0018:ffffc90000170008 EFLAGS: 00000092
RAX: 7fffffffffffffff RBX: 0000000000000000 RCX: ffff88811390bb40
RDX: 0000000000010102 RSI: 0000000000000000 RDI: 0000000000000000
RBP: ffffc90000170008 R08: ffffffff815b050c R09: ffff888121a61960
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff8881f7149940
R13: 0000000000000001 R14: ffff8881f7149940 R15: dffffc0000000000
FS:  0000000000000000(0000) GS:ffff8881f7100000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055b0937a9e38 CR3: 000000010cfca000 CR4: 00000000003506a0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
 <NMI>
 </NMI>
 <IRQ>
 hrtimer_update_next_event kernel/time/hrtimer.c:604 [inline]
 hrtimer_interrupt+0x3de/0x8b0 kernel/time/hrtimer.c:1712
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1083 [inline]
 __sysvec_apic_timer_interrupt+0xfd/0x3c0 arch/x86/kernel/apic/apic.c:1100
 run_sysvec_on_irqstack_cond arch/x86/include/asm/irq_stack.h:91 [inline]
 sysvec_apic_timer_interrupt+0xba/0xe0 arch/x86/kernel/apic/apic.c:1094
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:635
RIP: 0010:ip6_ignore_linkdown include/net/addrconf.h:439 [inline]
RIP: 0010:find_match+0xe1/0xd70 net/ipv6/route.c:739
Code: 7d fd 4c 8b 23 4d 85 e4 0f 84 30 0a 00 00 49 81 c4 9c 01 00 00 4c 89 e0 48 c1 e8 03 48 b9 00 00 00 00 00 fc ff df 0f b6 04 08 <84> c0 0f 85 3d 0a 00 00 41 8b 1c 24 31 ff 89 de e8 2a de 3f fd 85
RSP: 0018:ffffc90000170230 EFLAGS: 00000a07
RAX: 0000000000000000 RBX: ffff88810e8102e0 RCX: dffffc0000000000
RDX: ffff88811390bb40 RSI: 0000000000000000 RDI: 0000000000000000
RBP: ffffc900001702b0 R08: ffffffff842acdef R09: ffffc90000170570
R10: ffffc90000170560 R11: dffffc0000000001 R12: ffff88811218619c
R13: 1ffff11025d09495 R14: 0000000000000000 R15: 0000000000000003
 __find_rr_leaf+0x276/0xb70 net/ipv6/route.c:827
 find_rr_leaf net/ipv6/route.c:848 [inline]
 rt6_select net/ipv6/route.c:892 [inline]
 fib6_table_lookup+0x338/0xaf0 net/ipv6/route.c:2190
 ip6_pol_route+0x151/0x14b0 net/ipv6/route.c:2226
 ip6_pol_route_input+0x55/0x80 net/ipv6/route.c:2284
 pol_lookup_func include/net/ip6_fib.h:594 [inline]
 fib6_rule_lookup+0x25a/0x620 net/ipv6/fib6_rules.c:115
 ip6_route_input_lookup net/ipv6/route.c:2296 [inline]
 ip6_route_input+0x726/0xb00 net/ipv6/route.c:2465
 ip6_rcv_finish_core net/ipv6/ip6_input.c:67 [inline]
 ip6_rcv_finish+0x14f/0x350 net/ipv6/ip6_input.c:78
 NF_HOOK include/linux/netfilter.h:299 [inline]
 ipv6_rcv+0xee/0x270 net/ipv6/ip6_input.c:301
 __netif_receive_skb_one_core net/core/dev.c:5382 [inline]
 __netif_receive_skb+0x1c6/0x530 net/core/dev.c:5496
 process_backlog+0x31c/0x650 net/core/dev.c:6403
 napi_poll net/core/dev.c:6854 [inline]
 net_rx_action+0x516/0x10d0 net/core/dev.c:6924
 __do_softirq+0x268/0x5bb kernel/softirq.c:309
 asm_call_irq_on_stack+0xf/0x20
 </IRQ>
 __run_on_irqstack arch/x86/include/asm/irq_stack.h:26 [inline]
 run_on_irqstack_cond arch/x86/include/asm/irq_stack.h:77 [inline]
 do_softirq_own_stack+0x60/0x80 arch/x86/kernel/irq_64.c:77
 invoke_softirq kernel/softirq.c:405 [inline]
 __irq_exit_rcu+0x128/0x150 kernel/softirq.c:435
 irq_exit_rcu+0x9/0x10 kernel/softirq.c:447
 sysvec_apic_timer_interrupt+0xbf/0xe0 arch/x86/kernel/apic/apic.c:1094
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:635
RIP: 0010:__schedule+0xc46/0x1330 kernel/sched/core.c:4811
Code: 60 0e 36 e0 45 48 8b 44 24 58 49 c7 44 05 00 00 00 00 00 65 48 8b 04 25 28 00 00 00 48 3b 84 24 a0 00 00 00 0f 85 e1 03 00 00 <48> 8d 65 d8 5b 41 5c 41 5d 41 5e 41 5f 5d c3 4c 89 ff e8 a3 5f 99
RSP: 0018:ffffc90000f77160 EFLAGS: 00000246
RAX: 2c0d7087a0a8f400 RBX: ffff8881f7156b80 RCX: 0000000000000002
RDX: 0000000040000000 RSI: 0000000000000000 RDI: 0000000000000001
RBP: ffffc90000f77250 R08: ffffffff8188e1b9 R09: fffffbfff0dc753b
R10: 0000000000000000 R11: dffffc0000000001 R12: ffff8881156913c0
R13: dffffc0000000000 R14: ffff8881f7155fc0 R15: 1ffff11022721804
 preempt_schedule_irq+0xc7/0x140 kernel/sched/core.c:5065
 irqentry_exit_cond_resched kernel/entry/common.c:365 [inline]
 irqentry_exit+0x4f/0x60 kernel/entry/common.c:395
 sysvec_apic_timer_interrupt+0xcb/0xe0 arch/x86/kernel/apic/apic.c:1094
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:635
RIP: 0010:unwind_next_frame+0x6/0x700 arch/x86/kernel/unwind_frame.c:255
Code: 41 5f 5d c3 44 89 f1 80 e1 07 80 c1 03 38 c1 7c 99 4c 89 f7 e8 4b 2f 76 00 eb 8f 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 41 57 <41> 56 41 55 41 54 53 48 83 ec 50 49 89 fe 48 ba 00 00 00 00 00 fc
RSP: 0018:ffffc90000f773e8 EFLAGS: 00000202
RAX: 0000000000000001 RBX: ffffc90000f77400 RCX: 0000000000f77401
RDX: dffffc0000000000 RSI: ffffffff8159651b RDI: ffffc90000f77400
RBP: ffffc90000f773f0 R08: ffffc90000f774e8 R09: 000000000000000d
R10: ffffc90000f774f0 R11: dffffc0000000001 R12: ffff88811390bb40
R13: ffffffff8159b260 R14: ffffc90000f774e0 R15: 0000000000000000
 arch_stack_walk+0x10d/0x140 arch/x86/kernel/stacktrace.c:25
 stack_trace_save+0x113/0x1c0 kernel/stacktrace.c:121
 save_stack+0x97/0x240 mm/page_owner.c:146
 __reset_page_owner+0x36/0x150 mm/page_owner.c:174
 reset_page_owner include/linux/page_owner.h:28 [inline]
 free_pages_prepare mm/page_alloc.c:1349 [inline]
 free_pcp_prepare mm/page_alloc.c:1421 [inline]
 free_unref_page_prepare+0x2ae/0x2d0 mm/page_alloc.c:3336
 free_unref_page mm/page_alloc.c:3391 [inline]
 free_the_page+0x9e/0x370 mm/page_alloc.c:5407
 __free_pages+0x67/0xc0 mm/page_alloc.c:5418
 __vunmap+0x7bc/0x8f0 mm/vmalloc.c:2301
 __vfree mm/vmalloc.c:2349 [inline]
 vfree+0x5c/0x80 mm/vmalloc.c:2380
 kcov_put kernel/kcov.c:408 [inline]
 kcov_close+0x2b/0x50 kernel/kcov.c:510
 __fput+0x33d/0x7b0 fs/file_table.c:281
 ____fput+0x15/0x20 fs/file_table.c:314
 task_work_run+0x129/0x190 kernel/task_work.c:165
 exit_task_work include/linux/task_work.h:32 [inline]
 do_exit+0xc83/0x2a50 kernel/exit.c:863
 do_group_exit+0x141/0x310 kernel/exit.c:985
 get_signal+0x10a0/0x1410 kernel/signal.c:2782
 arch_do_signal_or_restart+0xbd/0x17c0 arch/x86/kernel/signal.c:805
 handle_signal_work kernel/entry/common.c:145 [inline]
 exit_to_user_mode_loop+0x9b/0xd0 kernel/entry/common.c:169
 exit_to_user_mode_prepare kernel/entry/common.c:199 [inline]
 irqentry_exit_to_user_mode+0x4e/0x80 kernel/entry/common.c:287
 irqentry_exit+0x12/0x60 kernel/entry/common.c:375
 sysvec_apic_timer_interrupt+0xcb/0xe0 arch/x86/kernel/apic/apic.c:1094
 asm_sysvec_apic_timer_interrupt+0x12/0x20 arch/x86/include/asm/idtentry.h:635
RIP: 0033:0x7f2647690e79
Code: Unable to access opcode bytes at RIP 0x7f2647690e4f.
RSP: 002b:00007f264630e038 EFLAGS: 00000246
RAX: 0000000000000000 RBX: 00007f264782cf80 RCX: 00007f2647690e79
RDX: 00000000200006c0 RSI: 0000000000005452 RDI: 0000000000000003
RBP: 00007f26476fe916 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 0000000000000000 R14: 00007f264782cf80 R15: 00007ffe759bc848

Crashes (2):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2024/08/20 17:48 android13-5.10-lts 0890c03b8b7d 9f0ab3fb .config console log report info ci2-android-5-10-perf BUG: soft lockup in net_rx_action
2024/08/08 17:53 android13-5.10-lts fd58936f3c1f 61405512 .config console log report info ci2-android-5-10-perf BUG: soft lockup in net_rx_action
* Struck through repros no longer work on HEAD.