possible deadlock in proc_pid_stack

Status: upstream: reported C repro on 2020/08/09 13:43
Reported-by: syzbot+b6ae406d9b2b1c08371f@syzkaller.appspotmail.com
First crash: 2194d, last: 1506d
Fix bisection: failed (error log, bisect log)
  
▶ ▼ Similar bugs (3)
Kernel Title Rank 🛈 Repro Cause bisect Fix bisect Count Last Reported Patched Status
linux-4.19 possible deadlock in proc_pid_stack 4 152 1370d 2239d 0/1 auto-obsoleted due to no activity on 2023/03/12 00:41
upstream possible deadlock in proc_pid_stack (2) fs 4 4 2166d 2176d 0/29 auto-closed as invalid on 2021/01/05 02:47
upstream possible deadlock in proc_pid_stack fs 4 7 2324d 2402d 0/29 auto-closed as invalid on 2020/07/31 02:38
▶ ▼ Last patch testing requests (4)
Created Duration User Patch Repo Result
2023/03/02 01:32 10m retest repro linux-4.14.y report log
2023/03/02 00:32 13m retest repro linux-4.14.y report log
2022/11/11 00:30 9m retest repro linux-4.14.y report log
2022/11/10 23:30 9m retest repro linux-4.14.y report log
▶ ▼ Fix bisection attempts (17)
Created Duration User Patch Repo Result
2022/07/28 09:29 8m bisect fix linux-4.14.y error job log
2022/06/28 08:42 19m bisect fix linux-4.14.y OK (0) job log log
2022/05/28 21:58 23m bisect fix linux-4.14.y OK (0) job log log
2022/04/28 21:23 21m bisect fix linux-4.14.y OK (0) job log log
2022/03/29 20:55 27m bisect fix linux-4.14.y OK (0) job log log
2022/02/27 12:54 22m bisect fix linux-4.14.y OK (0) job log log
2022/01/28 12:27 27m bisect fix linux-4.14.y OK (0) job log log
2021/12/29 11:51 26m bisect fix linux-4.14.y OK (0) job log log
2021/11/29 11:20 26m bisect fix linux-4.14.y OK (0) job log log
2021/10/30 10:54 26m bisect fix linux-4.14.y OK (0) job log log
2021/09/30 00:43 29m bisect fix linux-4.14.y OK (0) job log log
2021/08/31 00:13 30m bisect fix linux-4.14.y OK (0) job log log
2021/07/31 22:53 26m bisect fix linux-4.14.y OK (0) job log log
2021/07/01 22:31 22m bisect fix linux-4.14.y OK (0) job log log
2021/06/01 22:10 21m bisect fix linux-4.14.y OK (0) job log log
2021/01/05 07:24 23m bisect fix linux-4.14.y OK (0) job log log
2020/09/25 23:18 23m bisect fix linux-4.14.y OK (0) job log log

Sample crash report:
======================================================
WARNING: possible circular locking dependency detected
4.14.232-syzkaller #0 Not tainted
------------------------------------------------------
syz-executor674/7965 is trying to acquire lock:
 (&sig->cred_guard_mutex){+.+.}, at: [<ffffffff81a0709f>] lock_trace fs/proc/base.c:407 [inline]
 (&sig->cred_guard_mutex){+.+.}, at: [<ffffffff81a0709f>] proc_pid_stack+0x13f/0x2f0 fs/proc/base.c:457

but task is already holding lock:
 (&p->lock){+.+.}, at: [<ffffffff818e979a>] seq_read+0xba/0x1120 fs/seq_file.c:165

which lock already depends on the new lock.


the existing dependency chain (in reverse order) is:

-> #3 (&p->lock){+.+.}:
       __mutex_lock_common kernel/locking/mutex.c:756 [inline]
       __mutex_lock+0xc4/0x1310 kernel/locking/mutex.c:893
       seq_read+0xba/0x1120 fs/seq_file.c:165
       proc_reg_read+0xee/0x1a0 fs/proc/inode.c:217
       do_loop_readv_writev fs/read_write.c:695 [inline]
       do_loop_readv_writev fs/read_write.c:682 [inline]
       do_iter_read+0x3eb/0x5b0 fs/read_write.c:919
       vfs_readv+0xc8/0x120 fs/read_write.c:981
       kernel_readv fs/splice.c:361 [inline]
       default_file_splice_read+0x418/0x910 fs/splice.c:416
       do_splice_to+0xfb/0x140 fs/splice.c:880
       splice_direct_to_actor+0x207/0x730 fs/splice.c:952
       do_splice_direct+0x164/0x210 fs/splice.c:1061
       do_sendfile+0x47f/0xb30 fs/read_write.c:1441
       SYSC_sendfile64 fs/read_write.c:1502 [inline]
       SyS_sendfile64+0xff/0x110 fs/read_write.c:1488
       do_syscall_64+0x1d5/0x640 arch/x86/entry/common.c:292
       entry_SYSCALL_64_after_hwframe+0x46/0xbb

-> #2 (sb_writers#3){.+.+}:
       percpu_down_read_preempt_disable include/linux/percpu-rwsem.h:36 [inline]
       percpu_down_read include/linux/percpu-rwsem.h:59 [inline]
       __sb_start_write+0x64/0x260 fs/super.c:1342
       sb_start_write include/linux/fs.h:1549 [inline]
       mnt_want_write+0x3a/0xb0 fs/namespace.c:386
       ovl_create_object+0x75/0x1d0 fs/overlayfs/dir.c:538
       lookup_open+0x77a/0x1750 fs/namei.c:3241
       do_last fs/namei.c:3334 [inline]
       path_openat+0xe08/0x2970 fs/namei.c:3569
       do_filp_open+0x179/0x3c0 fs/namei.c:3603
       do_sys_open+0x296/0x410 fs/open.c:1081
       do_syscall_64+0x1d5/0x640 arch/x86/entry/common.c:292
       entry_SYSCALL_64_after_hwframe+0x46/0xbb

-> #1 (&ovl_i_mutex_dir_key[depth]){++++}:
       down_read+0x36/0x80 kernel/locking/rwsem.c:24
       inode_lock_shared include/linux/fs.h:729 [inline]
       do_last fs/namei.c:3333 [inline]
       path_openat+0x149b/0x2970 fs/namei.c:3569
       do_filp_open+0x179/0x3c0 fs/namei.c:3603
       do_open_execat+0xd3/0x450 fs/exec.c:849
       do_execveat_common+0x711/0x1f30 fs/exec.c:1755
       do_execve fs/exec.c:1860 [inline]
       SYSC_execve fs/exec.c:1941 [inline]
       SyS_execve+0x3b/0x50 fs/exec.c:1936
       do_syscall_64+0x1d5/0x640 arch/x86/entry/common.c:292
       entry_SYSCALL_64_after_hwframe+0x46/0xbb

-> #0 (&sig->cred_guard_mutex){+.+.}:
       lock_acquire+0x170/0x3f0 kernel/locking/lockdep.c:3998
       __mutex_lock_common kernel/locking/mutex.c:756 [inline]
       __mutex_lock+0xc4/0x1310 kernel/locking/mutex.c:893
       lock_trace fs/proc/base.c:407 [inline]
       proc_pid_stack+0x13f/0x2f0 fs/proc/base.c:457
       proc_single_show+0xe7/0x150 fs/proc/base.c:761
       seq_read+0x4cf/0x1120 fs/seq_file.c:237
       do_loop_readv_writev fs/read_write.c:695 [inline]
       do_loop_readv_writev fs/read_write.c:682 [inline]
       do_iter_read+0x3eb/0x5b0 fs/read_write.c:919
       vfs_readv+0xc8/0x120 fs/read_write.c:981
       do_preadv fs/read_write.c:1065 [inline]
       SYSC_preadv fs/read_write.c:1115 [inline]
       SyS_preadv+0x15a/0x200 fs/read_write.c:1110
       do_syscall_64+0x1d5/0x640 arch/x86/entry/common.c:292
       entry_SYSCALL_64_after_hwframe+0x46/0xbb

other info that might help us debug this:

Chain exists of:
  &sig->cred_guard_mutex --> sb_writers#3 --> &p->lock

 Possible unsafe locking scenario:

       CPU0                    CPU1
       ----                    ----
  lock(&p->lock);
                               lock(sb_writers#3);
                               lock(&p->lock);
  lock(&sig->cred_guard_mutex);

 *** DEADLOCK ***

1 lock held by syz-executor674/7965:
 #0:  (&p->lock){+.+.}, at: [<ffffffff818e979a>] seq_read+0xba/0x1120 fs/seq_file.c:165

stack backtrace:
CPU: 0 PID: 7965 Comm: syz-executor674 Not tainted 4.14.232-syzkaller #0
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:17 [inline]
 dump_stack+0x1b2/0x281 lib/dump_stack.c:58
 print_circular_bug.constprop.0.cold+0x2d7/0x41e kernel/locking/lockdep.c:1258
 check_prev_add kernel/locking/lockdep.c:1905 [inline]
 check_prevs_add kernel/locking/lockdep.c:2022 [inline]
 validate_chain kernel/locking/lockdep.c:2464 [inline]
 __lock_acquire+0x2e0e/0x3f20 kernel/locking/lockdep.c:3491
 lock_acquire+0x170/0x3f0 kernel/locking/lockdep.c:3998
 __mutex_lock_common kernel/locking/mutex.c:756 [inline]
 __mutex_lock+0xc4/0x1310 kernel/locking/mutex.c:893
 lock_trace fs/proc/base.c:407 [inline]
 proc_pid_stack+0x13f/0x2f0 fs/proc/base.c:457
 proc_single_show+0xe7/0x150 fs/proc/base.c:761
 seq_read+0x4cf/0x1120 fs/seq_file.c:237
 do_loop_readv_writev fs/read_write.c:695 [inline]
 do_loop_readv_writev fs/read_write.c:682 [inline]
 do_iter_read+0x3eb/0x5b0 fs/read_write.c:919
 vfs_readv+0xc8/0x120 fs/read_write.c:981
 do_preadv fs/read_write.c:1065 [inline]
 SYSC_preadv fs/read_write.c:1115 [inline]
 SyS_preadv+0x15a/0x200 fs/read_write.c:1110
 do_syscall_64+0x1d5/0x640 arch/x86/entry/common.c:292
 entry_SYSCALL_64_after_hwframe+0x46/0xbb
RIP: 0033:0x43f2d9
RSP: 002b:00007ffe39a93218 EFLAGS: 00000246 ORIG_RAX: 0000000000000127
RAX: ffffffffffffffda RBX: 0000000000400488 RCX: 000000000043f2d9
RDX: 0000000000000375 RSI: 00000000200017c0 RDI: 0000000000000005
RBP: 00007ffe39a93220 R08: 0000000000000000 R09: 65732f636f72702f
R10: 000000000

Crashes (18):
Time Kernel Commit Syzkaller Config Log Report Syz repro C repro VM info Assets (help?) Manager Title
2021/04/29 17:02 linux-4.14.y 7d7d1c0ab3eb 77e2b668 .config console log report syz C ci2-linux-4-14 possible deadlock in proc_pid_stack
2020/08/10 02:22 linux-4.14.y 14b58326976d 70301872 .config console log report syz C ci2-linux-4-14
2021/05/02 22:10 linux-4.14.y 7d7d1c0ab3eb 77e2b668 .config console log report info ci2-linux-4-14 possible deadlock in proc_pid_stack
2021/04/14 17:39 linux-4.14.y 958e517f4e16 3134b37f .config console log report info ci2-linux-4-14 possible deadlock in proc_pid_stack
2021/04/05 09:21 linux-4.14.y bd634aa64163 6a81331a .config console log report info ci2-linux-4-14 possible deadlock in proc_pid_stack
2021/04/04 20:54 linux-4.14.y bd634aa64163 6a81331a .config console log report info ci2-linux-4-14 possible deadlock in proc_pid_stack
2021/04/03 13:22 linux-4.14.y bd634aa64163 6a81331a .config console log report info ci2-linux-4-14 possible deadlock in proc_pid_stack
2021/03/08 13:17 linux-4.14.y 1d177c0872ab 09fbf400 .config console log report info ci2-linux-4-14 possible deadlock in proc_pid_stack
2021/02/09 14:13 linux-4.14.y 2c8a3fceddf0 2bd9619f .config console log report info ci2-linux-4-14 possible deadlock in proc_pid_stack
2021/02/03 20:39 linux-4.14.y 2c8a3fceddf0 624dad51 .config console log report info ci2-linux-4-14 possible deadlock in proc_pid_stack
2021/01/21 23:54 linux-4.14.y 2762b48e9611 d4f4eca5 .config console log report info ci2-linux-4-14 possible deadlock in proc_pid_stack
2020/12/06 07:24 linux-4.14.y c196b3a9c83a 50503117 .config console log report info ci2-linux-4-14
2020/11/15 16:39 linux-4.14.y 27ce4f2a6817 1bf9a662 .config console log report info ci2-linux-4-14
2020/10/18 02:56 linux-4.14.y cbfa1702aaf6 fea47c01 .config console log report info ci2-linux-4-14
2020/08/26 23:01 linux-4.14.y d7e78d08fa77 318430cb .config console log report ci2-linux-4-14
2020/08/17 11:45 linux-4.14.y 14b58326976d 5ce13532 .config console log report ci2-linux-4-14
2020/08/11 22:42 linux-4.14.y 14b58326976d 5d3ebca9 .config console log report ci2-linux-4-14
2020/08/09 13:43 linux-4.14.y 14b58326976d 70301872 .config console log report ci2-linux-4-14
* Struck through repros no longer work on HEAD.