INFO: rcu detected stall in sys_process_vm_readv (2)

Status: auto-obsoleted due to no activity on 2022/12/09 23:02
Subsystems: mm
[Documentation on labels]
First crash: 1432d, last: 1432d
▶ ▼ Similar bugs (11)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-6.1 INFO: rcu detected stall in sys_process_vm_readv (2) 1 1 557d 557d 0/3 auto-obsoleted due to no activity on 2025/05/13 07:10
upstream INFO: rcu detected stall in sys_process_vm_readv (3) cgroups mm 1 6 966d 1142d 0/29 auto-obsoleted due to no activity on 2024/03/20 00:08
upstream INFO: rcu detected stall in sys_process_vm_readv (7) mm cgroups prio:low 1 2 163d 240d 0/29 auto-obsoleted due to no activity on 2026/06/01 05:35
upstream INFO: rcu detected stall in sys_process_vm_readv (6) mm 1 1 428d 428d 0/29 auto-obsoleted due to no activity on 2025/09/09 12:22
upstream INFO: rcu detected stall in sys_process_vm_readv (5) mm 1 1 564d 564d 0/29 auto-obsoleted due to no activity on 2025/04/25 18:06
linux-5.15 INFO: rcu detected stall in sys_process_vm_readv (3) 1 1 524d 524d 0/3 auto-obsoleted due to no activity on 2025/06/14 17:14
linux-5.15 INFO: rcu detected stall in sys_process_vm_readv (2) 1 4 681d 734d 0/3 auto-obsoleted due to no activity on 2025/01/09 01:58
linux-5.15 INFO: rcu detected stall in sys_process_vm_readv 1 2 994d 1037d 0/3 auto-obsoleted due to no activity on 2024/03/02 07:32
linux-6.1 INFO: rcu detected stall in sys_process_vm_readv 1 2 753d 767d 0/3 auto-obsoleted due to no activity on 2024/10/28 22:50
upstream INFO: rcu detected stall in sys_process_vm_readv cgroups mm 1 1 1570d 1570d 0/29 auto-closed as invalid on 2022/06/24 21:29
upstream INFO: rcu detected stall in sys_process_vm_readv (4) mm 1 28 691d 827d 0/29 auto-obsoleted due to no activity on 2024/11/29 20:49

Sample crash report:
rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
rcu: 	0-...!: (0 ticks this GP) idle=a0cc/1/0x4000000000000000 softirq=49204/49204 fqs=0
rcu: 	Tasks blocked on level-0 rcu_node (CPUs 0-1): P6395/1:b..l
	(detected by 1, t=10502 jiffies, g=71801, q=224 ncpus=2)
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 14207 Comm: syz-executor.2 Not tainted 6.0.0-rc4-syzkaller-00302-gb96fbd602d35 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/26/2022
RIP: 0010:__lock_acquire+0xefe/0x56d0 kernel/locking/lockdep.c:5023
Code: 73 f7 ff ff 48 63 5c 24 18 be 08 00 00 00 48 89 d8 48 c1 e8 06 48 8d 3c c5 40 39 8e 90 e8 1a 49 69 00 48 0f a3 1d b2 16 2f 0f <0f> 82 f1 f9 ff ff e8 a7 71 9b 02 85 c0 0f 84 1b ff ff ff 48 c7 c0
RSP: 0018:ffffc90000007ab8 EFLAGS: 00000047
RAX: 0000000000000001 RBX: 0000000000000000 RCX: ffffffff815f2286
RDX: fffffbfff211c729 RSI: 0000000000000008 RDI: ffffffff908e3940
RBP: ffff88807787286a R08: 0000000000000000 R09: ffffffff908e3947
R10: fffffbfff211c728 R11: 0000000000000000 R12: ffff888077872848
R13: ffff888077871d80 R14: ffff8880778727f8 R15: dffffc0000000000
FS:  00007f5152d93700(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000002051b000 CR3: 0000000073bb3000 CR4: 0000000000350ef0
Call Trace:
 <IRQ>
 lock_acquire kernel/locking/lockdep.c:5666 [inline]
 lock_acquire+0x1ab/0x570 kernel/locking/lockdep.c:5631
 __raw_spin_lock_irqsave include/linux/spinlock_api_smp.h:110 [inline]
 _raw_spin_lock_irqsave+0x39/0x50 kernel/locking/spinlock.c:162
 debug_object_activate+0x12e/0x3e0 lib/debugobjects.c:658
 debug_hrtimer_activate kernel/time/hrtimer.c:420 [inline]
 debug_activate kernel/time/hrtimer.c:475 [inline]
 enqueue_hrtimer+0x27/0x3e0 kernel/time/hrtimer.c:1084
 __run_hrtimer kernel/time/hrtimer.c:1702 [inline]
 __hrtimer_run_queues+0xaf3/0xe40 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
 __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112
 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1106
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline]
RIP: 0010:_raw_spin_unlock_irqrestore+0x38/0x70 kernel/locking/spinlock.c:194
Code: 74 24 10 e8 fa 95 dc f7 48 89 ef e8 82 17 dd f7 81 e3 00 02 00 00 75 25 9c 58 f6 c4 02 75 2d 48 85 db 74 01 fb bf 01 00 00 00 <e8> 33 d9 cf f7 65 8b 05 ec 8e 7f 76 85 c0 74 0a 5b 5d c3 e8 f0 9f
RSP: 0018:ffffc90013fcf148 EFLAGS: 00000206
RAX: 0000000000000002 RBX: 0000000000000200 RCX: 1ffffffff211ed96
RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000000001
RBP: ffff8880b9a40480 R08: 0000000000000001 R09: ffffffff908e3977
R10: 0000000000000001 R11: 0000000000000000 R12: ffffed101734809c
R13: dffffc0000000000 R14: ffff88813fffa700 R15: 0000000000000000
 spin_unlock_irqrestore include/linux/spinlock.h:404 [inline]
 rmqueue_pcplist mm/page_alloc.c:3808 [inline]
 rmqueue mm/page_alloc.c:3841 [inline]
 get_page_from_freelist+0x75a/0x2ce0 mm/page_alloc.c:4280
 __alloc_pages+0x1c7/0x510 mm/page_alloc.c:5515
 __folio_alloc+0x12/0x40 mm/page_alloc.c:5546
 vma_alloc_folio+0xf9/0x790 mm/mempolicy.c:2231
 alloc_page_vma include/linux/gfp.h:290 [inline]
 wp_page_copy+0xa97/0x1b60 mm/memory.c:3107
 do_wp_page+0x1d1/0x1910 mm/memory.c:3404
 handle_pte_fault mm/memory.c:4929 [inline]
 __handle_mm_fault+0x1813/0x39b0 mm/memory.c:5053
 handle_mm_fault+0x1c8/0x780 mm/memory.c:5151
 do_user_addr_fault+0x475/0x1210 arch/x86/mm/fault.c:1397
 handle_page_fault arch/x86/mm/fault.c:1488 [inline]
 exc_page_fault+0x94/0x170 arch/x86/mm/fault.c:1544
 asm_exc_page_fault+0x22/0x30 arch/x86/include/asm/idtentry.h:570
RIP: 0010:copy_user_generic_string+0x2c/0x40 arch/x86/lib/copy_user_64.S:133
Code: cb 83 fa 08 72 27 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 c1 e9 03 83 e2 07 <f3> 48 a5 89 d1 f3 a4 31 c0 0f 01 ca c3 8d 0c ca 89 ca eb 20 0f 01
RSP: 0018:ffffc90013fcf8f8 EFLAGS: 00050246
RAX: 0000000000000001 RBX: 0000000000001000 RCX: 00000000000001d0
RDX: 0000000000000000 RSI: ffff88800f4e5180 RDI: 000000002051b000
RBP: 00007fffffffe000 R08: 0000000000000000 R09: ffff88800f4e5fff
R10: ffffed1001e9cbff R11: 0000000000000000 R12: 000000002051ae80
R13: ffff88800f4e5000 R14: ffff88800f4e5000 R15: 0000000000000000
 copy_user_generic arch/x86/include/asm/uaccess_64.h:37 [inline]
 raw_copy_to_user arch/x86/include/asm/uaccess_64.h:58 [inline]
 copyout lib/iov_iter.c:170 [inline]
 copyout+0xf6/0x120 lib/iov_iter.c:164
 _copy_to_iter+0x537/0x13c0 lib/iov_iter.c:524
 copy_page_to_iter+0x35f/0xe40 lib/iov_iter.c:722
 process_vm_rw_pages mm/process_vm_access.c:45 [inline]
 process_vm_rw_single_vec mm/process_vm_access.c:117 [inline]
 process_vm_rw_core.constprop.0+0x5c3/0x980 mm/process_vm_access.c:215
 process_vm_rw+0x29c/0x300 mm/process_vm_access.c:283
 __do_sys_process_vm_readv mm/process_vm_access.c:295 [inline]
 __se_sys_process_vm_readv mm/process_vm_access.c:291 [inline]
 __x64_sys_process_vm_readv+0xdf/0x1b0 mm/process_vm_access.c:291
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7f5151c893c9
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f5152d93168 EFLAGS: 00000246 ORIG_RAX: 0000000000000136
RAX: ffffffffffffffda RBX: 00007f5151d9bf80 RCX: 00007f5151c893c9
RDX: 0000000000000002 RSI: 0000000020008400 RDI: 000000000000053a
RBP: 00007f5151ce433f R08: 0000000000000286 R09: 0000000000000000
R10: 0000000020008640 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffd194abe3f R14: 00007f5152d93300 R15: 0000000000022000
 </TASK>
task:kworker/u4:14   state:R  running task     stack:26064 pid: 6395 ppid:     2 flags:0x00004000
Workqueue: netns cleanup_net
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5182 [inline]
 __schedule+0xadf/0x52b0 kernel/sched/core.c:6494
 preempt_schedule_irq+0x4e/0x90 kernel/sched/core.c:6806
 irqentry_exit+0x31/0x80 kernel/entry/common.c:428
 asm_sysvec_reschedule_ipi+0x16/0x20 arch/x86/include/asm/idtentry.h:654
RIP: 0010:check_kcov_mode kernel/kcov.c:166 [inline]
RIP: 0010:__sanitizer_cov_trace_pc+0x7/0x60 kernel/kcov.c:200
Code: 4b 00 5d be 03 00 00 00 e9 36 70 81 02 66 0f 1f 44 00 00 48 8b be a8 01 00 00 e8 b4 ff ff ff 31 c0 c3 90 65 8b 05 19 66 86 7e <89> c1 48 8b 34 24 81 e1 00 01 00 00 65 48 8b 14 25 80 6f 02 00 a9
RSP: 0018:ffffc90005defb38 EFLAGS: 00000293
RAX: 0000000080000000 RBX: 000000000007ffff RCX: 0000000000000001
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff88807e83bf3c
RBP: 000000000007903c R08: 0000000000000004 R09: 000000000007ffff
R10: 000000000007903c R11: 1ffffffff17f2741 R12: ffffffff8da9af20
R13: ffffc90005defca0 R14: 0000000000000002 R15: dffffc0000000000
 rcu_lock_acquire include/linux/rcupdate.h:280 [inline]
 rcu_read_lock include/linux/rcupdate.h:706 [inline]
 inet_twsk_purge+0xf7/0x850 net/ipv4/inet_timewait_sock.c:270
 ops_exit_list+0x125/0x170 net/core/net_namespace.c:168
 cleanup_net+0x4ea/0xb00 net/core/net_namespace.c:595
 process_one_work+0x991/0x1610 kernel/workqueue.c:2289
 worker_thread+0x665/0x1080 kernel/workqueue.c:2436
 kthread+0x2e4/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:306
 </TASK>
rcu: rcu_preempt kthread timer wakeup didn't happen for 10501 jiffies! g71801 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402
rcu: 	Possible timer handling issue on cpu=0 timer-softirq=40843
rcu: rcu_preempt kthread starved for 10502 jiffies! g71801 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=0
rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
rcu: RCU grace-period kthread stack dump:
task:rcu_preempt     state:I stack:28728 pid:   16 ppid:     2 flags:0x00004000
Call Trace:
 <TASK>
 context_switch kernel/sched/core.c:5182 [inline]
 __schedule+0xadf/0x52b0 kernel/sched/core.c:6494
 schedule+0xda/0x1b0 kernel/sched/core.c:6570
 schedule_timeout+0x14a/0x2a0 kernel/time/timer.c:1935
 rcu_gp_fqs_loop+0x190/0x910 kernel/rcu/tree.c:1657
 rcu_gp_kthread+0x236/0x360 kernel/rcu/tree.c:1854
 kthread+0x2e4/0x3a0 kernel/kthread.c:376
 ret_from_fork+0x1f/0x30 arch/x86/entry/entry_64.S:306
 </TASK>
rcu: Stack dump where RCU GP kthread last ran:
Sending NMI from CPU 1 to CPUs 0:
NMI backtrace for cpu 0
CPU: 0 PID: 14207 Comm: syz-executor.2 Not tainted 6.0.0-rc4-syzkaller-00302-gb96fbd602d35 #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 08/26/2022
RIP: 0010:task_irq_context kernel/locking/lockdep.c:4562 [inline]
RIP: 0010:__lock_acquire+0x2e5/0x56d0 kernel/locking/lockdep.c:4991
Code: 4d 89 74 24 10 48 89 c2 48 89 44 24 48 48 b8 00 00 00 00 00 fc ff df 48 c1 ea 03 80 3c 02 00 0f 85 b5 3b 00 00 48 8b 44 24 20 <49> 8d b5 5c 0a 00 00 48 ba 00 00 00 00 00 fc ff df 48 89 f1 48 89
RSP: 0018:ffffc90000007bd8 EFLAGS: 00000046
RAX: 0000000000000000 RBX: ffff8880778727f8 RCX: 000000000000005b
RDX: 1ffff1100ef0e507 RSI: 0000000000000194 RDI: ffff888077872830
RBP: 0000000000000000 R08: 1ffff1100ef0e503 R09: 0000000000000001
R10: fffffbfff1bbd982 R11: 0000000000000000 R12: ffff888077872820
R13: ffff888077871d80 R14: ffff8880b9a2a558 R15: 0000000000000000
FS:  00007f5152d93700(0000) GS:ffff8880b9a00000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000002051b000 CR3: 0000000073bb3000 CR4: 0000000000350ef0
Call Trace:
 <IRQ>
 lock_acquire kernel/locking/lockdep.c:5666 [inline]
 lock_acquire+0x1ab/0x570 kernel/locking/lockdep.c:5631
 __raw_spin_lock_irq include/linux/spinlock_api_smp.h:119 [inline]
 _raw_spin_lock_irq+0x32/0x50 kernel/locking/spinlock.c:170
 __run_hrtimer kernel/time/hrtimer.c:1689 [inline]
 __hrtimer_run_queues+0x23e/0xe40 kernel/time/hrtimer.c:1749
 hrtimer_interrupt+0x31c/0x790 kernel/time/hrtimer.c:1811
 local_apic_timer_interrupt arch/x86/kernel/apic/apic.c:1095 [inline]
 __sysvec_apic_timer_interrupt+0x146/0x530 arch/x86/kernel/apic/apic.c:1112
 sysvec_apic_timer_interrupt+0x8e/0xc0 arch/x86/kernel/apic/apic.c:1106
 </IRQ>
 <TASK>
 asm_sysvec_apic_timer_interrupt+0x16/0x20 arch/x86/include/asm/idtentry.h:649
RIP: 0010:__raw_spin_unlock_irqrestore include/linux/spinlock_api_smp.h:152 [inline]
RIP: 0010:_raw_spin_unlock_irqrestore+0x38/0x70 kernel/locking/spinlock.c:194
Code: 74 24 10 e8 fa 95 dc f7 48 89 ef e8 82 17 dd f7 81 e3 00 02 00 00 75 25 9c 58 f6 c4 02 75 2d 48 85 db 74 01 fb bf 01 00 00 00 <e8> 33 d9 cf f7 65 8b 05 ec 8e 7f 76 85 c0 74 0a 5b 5d c3 e8 f0 9f
RSP: 0018:ffffc90013fcf148 EFLAGS: 00000206
RAX: 0000000000000002 RBX: 0000000000000200 RCX: 1ffffffff211ed96
RDX: 0000000000000000 RSI: 0000000000000002 RDI: 0000000000000001
RBP: ffff8880b9a40480 R08: 0000000000000001 R09: ffffffff908e3977
R10: 0000000000000001 R11: 0000000000000000 R12: ffffed101734809c
R13: dffffc0000000000 R14: ffff88813fffa700 R15: 0000000000000000
 spin_unlock_irqrestore include/linux/spinlock.h:404 [inline]
 rmqueue_pcplist mm/page_alloc.c:3808 [inline]
 rmqueue mm/page_alloc.c:3841 [inline]
 get_page_from_freelist+0x75a/0x2ce0 mm/page_alloc.c:4280
 __alloc_pages+0x1c7/0x510 mm/page_alloc.c:5515
 __folio_alloc+0x12/0x40 mm/page_alloc.c:5546
 vma_alloc_folio+0xf9/0x790 mm/mempolicy.c:2231
 alloc_page_vma include/linux/gfp.h:290 [inline]
 wp_page_copy+0xa97/0x1b60 mm/memory.c:3107
 do_wp_page+0x1d1/0x1910 mm/memory.c:3404
 handle_pte_fault mm/memory.c:4929 [inline]
 __handle_mm_fault+0x1813/0x39b0 mm/memory.c:5053
 handle_mm_fault+0x1c8/0x780 mm/memory.c:5151
 do_user_addr_fault+0x475/0x1210 arch/x86/mm/fault.c:1397
 handle_page_fault arch/x86/mm/fault.c:1488 [inline]
 exc_page_fault+0x94/0x170 arch/x86/mm/fault.c:1544
 asm_exc_page_fault+0x22/0x30 arch/x86/include/asm/idtentry.h:570
RIP: 0010:copy_user_generic_string+0x2c/0x40 arch/x86/lib/copy_user_64.S:133
Code: cb 83 fa 08 72 27 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 c1 e9 03 83 e2 07 <f3> 48 a5 89 d1 f3 a4 31 c0 0f 01 ca c3 8d 0c ca 89 ca eb 20 0f 01
RSP: 0018:ffffc90013fcf8f8 EFLAGS: 00050246
RAX: 0000000000000001 RBX: 0000000000001000 RCX: 00000000000001d0
RDX: 0000000000000000 RSI: ffff88800f4e5180 RDI: 000000002051b000
RBP: 00007fffffffe000 R08: 0000000000000000 R09: ffff88800f4e5fff
R10: ffffed1001e9cbff R11: 0000000000000000 R12: 000000002051ae80
R13: ffff88800f4e5000 R14: ffff88800f4e5000 R15: 0000000000000000
 copy_user_generic arch/x86/include/asm/uaccess_64.h:37 [inline]
 raw_copy_to_user arch/x86/include/asm/uaccess_64.h:58 [inline]
 copyout lib/iov_iter.c:170 [inline]
 copyout+0xf6/0x120 lib/iov_iter.c:164
 _copy_to_iter+0x537/0x13c0 lib/iov_iter.c:524
 copy_page_to_iter+0x35f/0xe40 lib/iov_iter.c:722
 process_vm_rw_pages mm/process_vm_access.c:45 [inline]
 process_vm_rw_single_vec mm/process_vm_access.c:117 [inline]
 process_vm_rw_core.constprop.0+0x5c3/0x980 mm/process_vm_access.c:215
 process_vm_rw+0x29c/0x300 mm/process_vm_access.c:283
 __do_sys_process_vm_readv mm/process_vm_access.c:295 [inline]
 __se_sys_process_vm_readv mm/process_vm_access.c:291 [inline]
 __x64_sys_process_vm_readv+0xdf/0x1b0 mm/process_vm_access.c:291
 do_syscall_x64 arch/x86/entry/common.c:50 [inline]
 do_syscall_64+0x35/0xb0 arch/x86/entry/common.c:80
 entry_SYSCALL_64_after_hwframe+0x63/0xcd
RIP: 0033:0x7f5151c893c9
Code: ff ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 c7 c1 b8 ff ff ff f7 d8 64 89 01 48
RSP: 002b:00007f5152d93168 EFLAGS: 00000246 ORIG_RAX: 0000000000000136
RAX: ffffffffffffffda RBX: 00007f5151d9bf80 RCX: 00007f5151c893c9
RDX: 0000000000000002 RSI: 0000000020008400 RDI: 000000000000053a
RBP: 00007f5151ce433f R08: 0000000000000286 R09: 0000000000000000
R10: 0000000020008640 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffd194abe3f R14: 00007f5152d93300 R15: 0000000000022000
 </TASK>

Crashes (1):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2022/09/10 22:52 upstream b96fbd602d35 356d8217 .config console log report info ci-upstream-kasan-gce-root INFO: rcu detected stall in sys_process_vm_readv
* Struck through repros no longer work on HEAD.