[ 786.285361] nipa-hw-worker: drivers/net:napi_threaded.py: timed out [ 786.287874] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py [ 786.416498] kselftest: Running tests in drivers/net [ 989.699438] INFO: task python3:5760 blocked for more than 122 seconds. [ 989.707666] Not tainted 7.1.0-rc5-sdwy-g39507b592f90 #1 [ 989.715631] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.725222] task:python3 state:D stack:25672 pid:5760 tgid:5760 ppid:5759 task_flags:0x400100 flags:0x00080000 [ 989.738430] Call Trace: [ 989.741972] [ 989.745123] __schedule+0xcc3/0x19c0 [ 989.749944] ? io_schedule_timeout+0x140/0x140 [ 989.755731] ? find_held_lock+0x2b/0x80 [ 989.760841] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.766726] schedule+0xd8/0x260 [ 989.771143] schedule_preempt_disabled+0x18/0x30 [ 989.777125] __mutex_lock+0x6af/0x2010 [ 989.782132] ? threaded_store+0x132/0x220 [ 989.787432] ? ww_mutex_lock+0x160/0x160 [ 989.792633] ? selinux_inode_free_security+0x330/0x330 [ 989.799203] ? cap_capable+0x1d6/0x3e0 [ 989.804213] ? threaded_store+0x132/0x220 [ 989.809514] threaded_store+0x132/0x220 [ 989.814619] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.819917] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.825216] ? sysfs_kf_write+0x65/0x160 [ 989.830416] ? sysfs_file_ops+0x140/0x140 [ 989.835713] kernfs_fop_write_iter+0x335/0x510 [ 989.841493] ? kernfs_ops+0xf0/0xf0 [ 989.846205] new_sync_write+0x333/0x750 [ 989.851310] ? __lock_acquire+0x508/0xc10 [ 989.856607] ? new_sync_read+0x740/0x740 [ 989.861810] ? lock_acquire.part.0+0xbc/0x260 [ 989.867496] ? ksys_write+0x116/0x250 [ 989.872398] vfs_write+0x657/0x9b0 [ 989.877016] ksys_write+0x116/0x250 [ 989.881730] ? __ia32_sys_read+0xc0/0xc0 [ 989.886928] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.892521] ? rcu_is_watching+0x15/0xd0 [ 989.897721] do_syscall_64+0xf3/0x650 [ 989.902626] ? trace_hardirqs_off+0xd/0x30 [ 989.908024] ? exc_page_fault+0xda/0xf0 [ 989.913127] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.919597] RIP: 0033:0x7f7aa4a0922e [ 989.924409] RSP: 002b:00007ffdb41cd4c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.933709] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f7aa4a0922e [ 989.942521] RDX: 0000000000000001 RSI: 00005557bc6366b0 RDI: 0000000000000007 [ 989.951327] RBP: 00007ffdb41cd4d0 R08: 0000000000000000 R09: 0000000000000000 [ 989.960138] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f7aa4881390 [ 989.968945] R13: 00005557bc6366b0 R14: 0000000000000007 R15: 0000000000000003 [ 989.977768] [ 989.981053] INFO: task python3:5760 is blocked on a mutex likely owned by task python3:3724. [ 989.991325] task:python3 state:D stack:25672 pid:3724 tgid:3724 ppid:3723 task_flags:0x400100 flags:0x00080802 [ 990.004528] Call Trace: [ 990.008066] [ 990.011218] __schedule+0xcc3/0x19c0 [ 990.016030] ? io_schedule_timeout+0x140/0x140 [ 990.021814] ? find_held_lock+0x2b/0x80 [ 990.026919] ? __try_to_del_timer_sync+0x155/0x1f0 [ 990.033095] schedule+0xd8/0x260 [ 990.037513] schedule_timeout+0x13f/0x290 [ 990.042810] ? hrtimer_nanosleep_restart+0x270/0x270 [ 990.049180] ? trace_contention_end+0xb3/0x1a0 [ 990.054957] ? hrtimers_cpu_dying+0x3e0/0x3e0 [ 990.060649] ? ww_mutex_lock+0x160/0x160 [ 990.065850] msleep+0x1b/0x30 [ 990.069978] napi_set_threaded+0x3a5/0x440 [ 990.075375] ? napi_resume_irqs+0x1a0/0x1a0 [ 990.080870] netif_set_threaded+0x257/0x400 [ 990.086363] threaded_store+0x1b8/0x220 [ 990.091469] ? xps_rxqs_store+0x2e0/0x2e0 [ 990.096767] ? sysfs_file_kobj+0xbd/0x1e0 [ 990.102066] ? sysfs_kf_write+0x65/0x160 [ 990.107265] ? sysfs_file_ops+0x140/0x140 [ 990.112562] kernfs_fop_write_iter+0x335/0x510 [ 990.118349] ? kernfs_ops+0xf0/0xf0 [ 990.123060] new_sync_write+0x333/0x750 [ 990.128161] ? __lock_acquire+0x508/0xc10 [ 990.133460] ? new_sync_read+0x740/0x740 [ 990.138660] ? lock_acquire.part.0+0xbc/0x260 [ 990.144347] ? ksys_write+0x116/0x250 [ 990.149261] vfs_write+0x657/0x9b0 [ 990.153878] ksys_write+0x116/0x250 [ 990.158591] ? __ia32_sys_read+0xc0/0xc0 [ 990.163793] ? kernfs_fop_llseek+0x160/0x1f0 [ 990.169384] ? rcu_is_watching+0x15/0xd0 [ 990.174583] do_syscall_64+0xf3/0x650 [ 990.179491] ? trace_hardirqs_off+0xd/0x30 [ 990.184875] ? exc_page_fault+0xda/0xf0 [ 990.189977] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 990.196446] RIP: 0033:0x7f3c4857b22e [ 990.201254] RSP: 002b:00007ffeea498d00 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 990.210552] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3c4857b22e [ 990.219362] RDX: 0000000000000001 RSI: 0000556e555d26b0 RDI: 0000000000000007 [ 990.228174] RBP: 00007ffeea498d10 R08: 0000000000000000 R09: 0000000000000000 [ 990.236982] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3c483f3390 [ 990.245781] R13: 0000556e555d26b0 R14: 0000000000000007 R15: 0000000000000003 [ 990.254585] [ 990.257848] \x0aShowing all locks held in the system: [ 990.266387] 1 lock held by khungtaskd/185: [ 990.271780] #0: ffffffffabcfdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 990.283264] 4 locks held by python3/3724: [ 990.288561] #0: ff110001303143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 990.298454] #1: ff11000166f2a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 [ 990.309415] #2: ff11000122b20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 990.320562] #3: ff11000122b59d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 990.330658] 4 locks held by python3/5760: [ 990.335954] #0: ff110001303143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 990.345844] #1: ff110001ea8dac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 [ 990.356796] #2: ff11000122b20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 990.367954] #3: ff11000122b59d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 990.378045] [ 990.380503] =============================================\x0a [ 1112.580854] INFO: task python3:5760 blocked for more than 245 seconds. [ 1112.589005] Not tainted 7.1.0-rc5-sdwy-g39507b592f90 #1 [ 1112.596258] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.605848] task:python3 state:D stack:25672 pid:5760 tgid:5760 ppid:5759 task_flags:0x400100 flags:0x00080000 [ 1112.619043] Call Trace: [ 1112.622582] [ 1112.625730] __schedule+0xcc3/0x19c0 [ 1112.630543] ? io_schedule_timeout+0x140/0x140 [ 1112.636330] ? find_held_lock+0x2b/0x80 [ 1112.641435] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.647320] schedule+0xd8/0x260 [ 1112.651736] schedule_preempt_disabled+0x18/0x30 [ 1112.657713] __mutex_lock+0x6af/0x2010 [ 1112.662716] ? threaded_store+0x132/0x220 [ 1112.668015] ? ww_mutex_lock+0x160/0x160 [ 1112.673214] ? selinux_inode_free_security+0x330/0x330 [ 1112.679783] ? cap_capable+0x1d6/0x3e0 [ 1112.684794] ? threaded_store+0x132/0x220 [ 1112.690090] threaded_store+0x132/0x220 [ 1112.695190] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.700488] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.705784] ? sysfs_kf_write+0x65/0x160 [ 1112.710981] ? sysfs_file_ops+0x140/0x140 [ 1112.716278] kernfs_fop_write_iter+0x335/0x510 [ 1112.722060] ? kernfs_ops+0xf0/0xf0 [ 1112.726771] new_sync_write+0x333/0x750 [ 1112.731875] ? __lock_acquire+0x508/0xc10 [ 1112.737162] ? new_sync_read+0x740/0x740 [ 1112.742364] ? lock_acquire.part.0+0xbc/0x260 [ 1112.748050] ? ksys_write+0x116/0x250 [ 1112.752959] vfs_write+0x657/0x9b0 [ 1112.757571] ksys_write+0x116/0x250 [ 1112.762280] ? __ia32_sys_read+0xc0/0xc0 [ 1112.767477] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.773066] ? rcu_is_watching+0x15/0xd0 [ 1112.778268] do_syscall_64+0xf3/0x650 [ 1112.783172] ? trace_hardirqs_off+0xd/0x30 [ 1112.788563] ? exc_page_fault+0xda/0xf0 [ 1112.793666] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.800123] RIP: 0033:0x7f7aa4a0922e [ 1112.804931] RSP: 002b:00007ffdb41cd4c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.814229] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f7aa4a0922e [ 1112.823039] RDX: 0000000000000001 RSI: 00005557bc6366b0 RDI: 0000000000000007 [ 1112.831845] RBP: 00007ffdb41cd4d0 R08: 0000000000000000 R09: 0000000000000000 [ 1112.840654] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f7aa4881390 [ 1112.849460] R13: 00005557bc6366b0 R14: 0000000000000007 R15: 0000000000000003 [ 1112.858274] [ 1112.861564] INFO: task python3:5760 is blocked on a mutex likely owned by task python3:3724. [ 1112.871835] task:python3 state:D stack:25672 pid:3724 tgid:3724 ppid:3723 task_flags:0x400100 flags:0x00080802 [ 1112.885036] Call Trace: [ 1112.888574] [ 1112.891721] __schedule+0xcc3/0x19c0 [ 1112.896530] ? io_schedule_timeout+0x140/0x140 [ 1112.902315] ? find_held_lock+0x2b/0x80 [ 1112.907405] ? __try_to_del_timer_sync+0x155/0x1f0 [ 1112.913584] schedule+0xd8/0x260 [ 1112.918003] schedule_timeout+0x13f/0x290 [ 1112.923299] ? hrtimer_nanosleep_restart+0x270/0x270 [ 1112.929668] ? trace_contention_end+0xb3/0x1a0 [ 1112.935453] ? hrtimers_cpu_dying+0x3e0/0x3e0 [ 1112.941142] ? ww_mutex_lock+0x160/0x160 [ 1112.946338] msleep+0x1b/0x30 [ 1112.950465] napi_set_threaded+0x3a5/0x440 [ 1112.955851] ? napi_resume_irqs+0x1a0/0x1a0 [ 1112.961345] netif_set_threaded+0x257/0x400 [ 1112.966836] threaded_store+0x1b8/0x220 [ 1112.971938] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.977225] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.982520] ? sysfs_kf_write+0x65/0x160 [ 1112.987721] ? sysfs_file_ops+0x140/0x140 [ 1112.993006] kernfs_fop_write_iter+0x335/0x510 [ 1112.998790] ? kernfs_ops+0xf0/0xf0 [ 1113.003499] new_sync_write+0x333/0x750 [ 1113.008599] ? __lock_acquire+0x508/0xc10 [ 1113.013894] ? new_sync_read+0x740/0x740 [ 1113.019092] ? lock_acquire.part.0+0xbc/0x260 [ 1113.024775] ? ksys_write+0x116/0x250 [ 1113.029690] vfs_write+0x657/0x9b0 [ 1113.034305] ksys_write+0x116/0x250 [ 1113.039009] ? __ia32_sys_read+0xc0/0xc0 [ 1113.044200] ? kernfs_fop_llseek+0x160/0x1f0 [ 1113.049788] ? rcu_is_watching+0x15/0xd0 [ 1113.054989] do_syscall_64+0xf3/0x650 [ 1113.059886] ? trace_hardirqs_off+0xd/0x30 [ 1113.065279] ? exc_page_fault+0xda/0xf0 [ 1113.070379] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1113.076845] RIP: 0033:0x7f3c4857b22e [ 1113.081651] RSP: 002b:00007ffeea498d00 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1113.090947] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3c4857b22e [ 1113.099755] RDX: 0000000000000001 RSI: 0000556e555d26b0 RDI: 0000000000000007 [ 1113.108563] RBP: 00007ffeea498d10 R08: 0000000000000000 R09: 0000000000000000 [ 1113.117370] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3c483f3390 [ 1113.126169] R13: 0000556e555d26b0 R14: 0000000000000007 R15: 0000000000000003 [ 1113.134981] [ 1113.138238] \x0aShowing all locks held in the system: [ 1113.146766] 1 lock held by khungtaskd/185: [ 1113.152158] #0: ffffffffabcfdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 1113.163640] 4 locks held by python3/3724: [ 1113.168935] #0: ff110001303143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 1113.178825] #1: ff11000166f2a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 [ 1113.189776] #2: ff11000122b20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1113.200931] #3: ff11000122b59d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1113.211027] 4 locks held by python3/5760: [ 1113.216323] #0: ff110001303143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 1113.226211] #1: ff110001ea8dac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 [ 1113.237171] #2: ff11000122b20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1113.248327] #3: ff11000122b59d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1113.258417] [ 1113.260883] =============================================\x0a [ 1235.462243] INFO: task python3:5760 blocked for more than 368 seconds. [ 1235.470388] Not tainted 7.1.0-rc5-sdwy-g39507b592f90 #1 [ 1235.477643] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.487238] task:python3 state:D stack:25672 pid:5760 tgid:5760 ppid:5759 task_flags:0x400100 flags:0x00080002 [ 1235.500452] Call Trace: [ 1235.503995] [ 1235.507151] __schedule+0xcc3/0x19c0 [ 1235.511974] ? io_schedule_timeout+0x140/0x140 [ 1235.517766] ? find_held_lock+0x2b/0x80 [ 1235.522874] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.528766] schedule+0xd8/0x260 [ 1235.533190] schedule_preempt_disabled+0x18/0x30 [ 1235.539175] __mutex_lock+0x6af/0x2010 [ 1235.544181] ? threaded_store+0x132/0x220 [ 1235.549490] ? ww_mutex_lock+0x160/0x160 [ 1235.554691] ? selinux_inode_free_security+0x330/0x330 [ 1235.561268] ? cap_capable+0x1d6/0x3e0 [ 1235.566279] ? threaded_store+0x132/0x220 [ 1235.571580] threaded_store+0x132/0x220 [ 1235.576684] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.581979] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.587281] ? sysfs_kf_write+0x65/0x160 [ 1235.592487] ? sysfs_file_ops+0x140/0x140 [ 1235.597786] kernfs_fop_write_iter+0x335/0x510 [ 1235.603576] ? kernfs_ops+0xf0/0xf0 [ 1235.608289] new_sync_write+0x333/0x750 [ 1235.613396] ? __lock_acquire+0x508/0xc10 [ 1235.618698] ? new_sync_read+0x740/0x740 [ 1235.623905] ? lock_acquire.part.0+0xbc/0x260 [ 1235.629594] ? ksys_write+0x116/0x250 [ 1235.634513] vfs_write+0x657/0x9b0 [ 1235.639131] ksys_write+0x116/0x250 [ 1235.643848] ? __ia32_sys_read+0xc0/0xc0 [ 1235.649049] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.654642] ? rcu_is_watching+0x15/0xd0 [ 1235.659849] do_syscall_64+0xf3/0x650 [ 1235.664757] ? trace_hardirqs_off+0xd/0x30 [ 1235.670157] ? exc_page_fault+0xda/0xf0 [ 1235.675265] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.681735] RIP: 0033:0x7f7aa4a0922e [ 1235.686546] RSP: 002b:00007ffdb41cd4c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.695849] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f7aa4a0922e [ 1235.704665] RDX: 0000000000000001 RSI: 00005557bc6366b0 RDI: 0000000000000007 [ 1235.713465] RBP: 00007ffdb41cd4d0 R08: 0000000000000000 R09: 0000000000000000 [ 1235.722273] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f7aa4881390 [ 1235.731088] R13: 00005557bc6366b0 R14: 0000000000000007 R15: 0000000000000003 [ 1235.739911] [ 1235.743217] INFO: task python3:5760 is blocked on a mutex likely owned by task python3:3724. [ 1235.753497] task:python3 state:D stack:25672 pid:3724 tgid:3724 ppid:3723 task_flags:0x400100 flags:0x00080802 [ 1235.766706] Call Trace: [ 1235.770247] [ 1235.773402] __schedule+0xcc3/0x19c0 [ 1235.778221] ? io_schedule_timeout+0x140/0x140 [ 1235.784009] ? find_held_lock+0x2b/0x80 [ 1235.789118] ? __try_to_del_timer_sync+0x155/0x1f0 [ 1235.795299] schedule+0xd8/0x260 [ 1235.799721] schedule_timeout+0x13f/0x290 [ 1235.805020] ? hrtimer_nanosleep_restart+0x270/0x270 [ 1235.811393] ? trace_contention_end+0xb3/0x1a0 [ 1235.817182] ? hrtimers_cpu_dying+0x3e0/0x3e0 [ 1235.822880] ? ww_mutex_lock+0x160/0x160 [ 1235.828085] msleep+0x1b/0x30 [ 1235.832213] napi_set_threaded+0x3a5/0x440 [ 1235.837615] ? napi_resume_irqs+0x1a0/0x1a0 [ 1235.843118] netif_set_threaded+0x257/0x400 [ 1235.848615] threaded_store+0x1b8/0x220 [ 1235.853724] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.859023] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.864316] ? sysfs_kf_write+0x65/0x160 [ 1235.869519] ? sysfs_file_ops+0x140/0x140 [ 1235.874817] kernfs_fop_write_iter+0x335/0x510 [ 1235.880603] ? kernfs_ops+0xf0/0xf0 [ 1235.885309] new_sync_write+0x333/0x750 [ 1235.890415] ? __lock_acquire+0x508/0xc10 [ 1235.895717] ? new_sync_read+0x740/0x740 [ 1235.900918] ? lock_acquire.part.0+0xbc/0x260 [ 1235.906601] ? ksys_write+0x116/0x250 [ 1235.911516] vfs_write+0x657/0x9b0 [ 1235.916138] ksys_write+0x116/0x250 [ 1235.920856] ? __ia32_sys_read+0xc0/0xc0 [ 1235.926060] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.931654] ? rcu_is_watching+0x15/0xd0 [ 1235.936860] do_syscall_64+0xf3/0x650 [ 1235.941769] ? trace_hardirqs_off+0xd/0x30 [ 1235.947169] ? exc_page_fault+0xda/0xf0 [ 1235.952278] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.958748] RIP: 0033:0x7f3c4857b22e [ 1235.963561] RSP: 002b:00007ffeea498d00 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.972865] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3c4857b22e [ 1235.981670] RDX: 0000000000000001 RSI: 0000556e555d26b0 RDI: 0000000000000007 [ 1235.990485] RBP: 00007ffeea498d10 R08: 0000000000000000 R09: 0000000000000000 [ 1235.999288] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3c483f3390 [ 1236.008100] R13: 0000556e555d26b0 R14: 0000000000000007 R15: 0000000000000003 [ 1236.016919] [ 1236.020188] \x0aShowing all locks held in the system: [ 1236.028735] 1 lock held by khungtaskd/185: [ 1236.034131] #0: ffffffffabcfdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 1236.045629] 4 locks held by python3/3724: [ 1236.050930] #0: ff110001303143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 1236.060830] #1: ff11000166f2a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 [ 1236.071797] #2: ff11000122b20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1236.082962] #3: ff11000122b59d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1236.093071] 4 locks held by python3/5760: [ 1236.098370] #0: ff110001303143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 1236.108271] #1: ff110001ea8dac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 [ 1236.119230] #2: ff11000122b20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1236.130395] #3: ff11000122b59d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1236.140496] [ 1236.142964] =============================================\x0a [ 1358.344667] INFO: task python3:5760 blocked for more than 491 seconds. [ 1358.352814] Not tainted 7.1.0-rc5-sdwy-g39507b592f90 #1 [ 1358.360065] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.369655] task:python3 state:D stack:25672 pid:5760 tgid:5760 ppid:5759 task_flags:0x400100 flags:0x00080002 [ 1358.382861] Call Trace: [ 1358.386402] [ 1358.389551] __schedule+0xcc3/0x19c0 [ 1358.394366] ? io_schedule_timeout+0x140/0x140 [ 1358.400154] ? find_held_lock+0x2b/0x80 [ 1358.405259] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.411135] schedule+0xd8/0x260 [ 1358.415553] schedule_preempt_disabled+0x18/0x30 [ 1358.421532] __mutex_lock+0x6af/0x2010 [ 1358.426537] ? threaded_store+0x132/0x220 [ 1358.431838] ? ww_mutex_lock+0x160/0x160 [ 1358.437039] ? selinux_inode_free_security+0x330/0x330 [ 1358.443610] ? cap_capable+0x1d6/0x3e0 [ 1358.448620] ? threaded_store+0x132/0x220 [ 1358.453915] threaded_store+0x132/0x220 [ 1358.459017] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.464316] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.469617] ? sysfs_kf_write+0x65/0x160 [ 1358.474817] ? sysfs_file_ops+0x140/0x140 [ 1358.480111] kernfs_fop_write_iter+0x335/0x510 [ 1358.485895] ? kernfs_ops+0xf0/0xf0 [ 1358.490608] new_sync_write+0x333/0x750 [ 1358.495713] ? __lock_acquire+0x508/0xc10 [ 1358.501010] ? new_sync_read+0x740/0x740 [ 1358.506205] ? lock_acquire.part.0+0xbc/0x260 [ 1358.511893] ? ksys_write+0x116/0x250 [ 1358.516803] vfs_write+0x657/0x9b0 [ 1358.521419] ksys_write+0x116/0x250 [ 1358.526132] ? __ia32_sys_read+0xc0/0xc0 [ 1358.531332] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.536924] ? rcu_is_watching+0x15/0xd0 [ 1358.542126] do_syscall_64+0xf3/0x650 [ 1358.547032] ? trace_hardirqs_off+0xd/0x30 [ 1358.552427] ? exc_page_fault+0xda/0xf0 [ 1358.557532] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.563999] RIP: 0033:0x7f7aa4a0922e [ 1358.568811] RSP: 002b:00007ffdb41cd4c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.578111] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f7aa4a0922e [ 1358.586918] RDX: 0000000000000001 RSI: 00005557bc6366b0 RDI: 0000000000000007 [ 1358.595724] RBP: 00007ffdb41cd4d0 R08: 0000000000000000 R09: 0000000000000000 [ 1358.604535] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f7aa4881390 [ 1358.613342] R13: 00005557bc6366b0 R14: 0000000000000007 R15: 0000000000000003 [ 1358.622157] [ 1358.625431] INFO: task python3:5760 is blocked on a mutex likely owned by task python3:3724. [ 1358.635703] task:python3 state:D stack:25672 pid:3724 tgid:3724 ppid:3723 task_flags:0x400100 flags:0x00080802 [ 1358.648908] Call Trace: [ 1358.652447] [ 1358.655601] __schedule+0xcc3/0x19c0 [ 1358.660413] ? io_schedule_timeout+0x140/0x140 [ 1358.666198] ? find_held_lock+0x2b/0x80 [ 1358.671294] ? __try_to_del_timer_sync+0x155/0x1f0 [ 1358.677472] schedule+0xd8/0x260 [ 1358.681892] schedule_timeout+0x13f/0x290 [ 1358.687181] ? hrtimer_nanosleep_restart+0x270/0x270 [ 1358.693552] ? trace_contention_end+0xb3/0x1a0 [ 1358.699336] ? hrtimers_cpu_dying+0x3e0/0x3e0 [ 1358.705028] ? ww_mutex_lock+0x160/0x160 [ 1358.710229] msleep+0x1b/0x30 [ 1358.714355] napi_set_threaded+0x3a5/0x440 [ 1358.719742] ? napi_resume_irqs+0x1a0/0x1a0 [ 1358.725237] netif_set_threaded+0x257/0x400 [ 1358.730732] threaded_store+0x1b8/0x220 [ 1358.735835] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.741125] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.746420] ? sysfs_kf_write+0x65/0x160 [ 1358.751618] ? sysfs_file_ops+0x140/0x140 [ 1358.756916] kernfs_fop_write_iter+0x335/0x510 [ 1358.762700] ? kernfs_ops+0xf0/0xf0 [ 1358.767412] new_sync_write+0x333/0x750 [ 1358.772516] ? __lock_acquire+0x508/0xc10 [ 1358.777813] ? new_sync_read+0x740/0x740 [ 1358.783015] ? lock_acquire.part.0+0xbc/0x260 [ 1358.788703] ? ksys_write+0x116/0x250 [ 1358.793614] vfs_write+0x657/0x9b0 [ 1358.798228] ksys_write+0x116/0x250 [ 1358.802943] ? __ia32_sys_read+0xc0/0xc0 [ 1358.808141] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.813729] ? rcu_is_watching+0x15/0xd0 [ 1358.818929] do_syscall_64+0xf3/0x650 [ 1358.823834] ? trace_hardirqs_off+0xd/0x30 [ 1358.829230] ? exc_page_fault+0xda/0xf0 [ 1358.834325] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.840789] RIP: 0033:0x7f3c4857b22e [ 1358.845599] RSP: 002b:00007ffeea498d00 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.854898] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3c4857b22e [ 1358.863704] RDX: 0000000000000001 RSI: 0000556e555d26b0 RDI: 0000000000000007 [ 1358.872516] RBP: 00007ffeea498d10 R08: 0000000000000000 R09: 0000000000000000 [ 1358.881324] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3c483f3390 [ 1358.890130] R13: 0000556e555d26b0 R14: 0000000000000007 R15: 0000000000000003 [ 1358.898945] [ 1358.902213] \x0aShowing all locks held in the system: [ 1358.910754] 1 lock held by khungtaskd/185: [ 1358.916146] #0: ffffffffabcfdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30 [ 1358.927629] 4 locks held by python3/3724: [ 1358.932927] #0: ff110001303143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 1358.942817] #1: ff11000166f2a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 [ 1358.953781] #2: ff11000122b20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1358.964940] #3: ff11000122b59d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1358.975035] 4 locks held by python3/5760: [ 1358.980332] #0: ff110001303143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 1358.990223] #1: ff110001ea8dac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 [ 1359.001184] #2: ff11000122b20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 [ 1359.012332] #3: ff11000122b59d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 [ 1359.022418] [ 1359.024886] =============================================\x0a