[ 791.553320] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 791.555729] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 791.710199] kselftest: Running tests in drivers/net
[ 989.712691] INFO: task python3:5874 blocked for more than 122 seconds.
[ 989.720908] Not tainted 7.1.0-rc4-wvvd-gb2b2ce506207 #1
[ 989.728715] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.738314] task:python3 state:D stack:25672 pid:5874 tgid:5874 ppid:5873 task_flags:0x400100 flags:0x00080000
[ 989.751531] Call Trace:
[ 989.755074]
[ 989.758228] __schedule+0xcc3/0x19c0
[ 989.763051] ? io_schedule_timeout+0x140/0x140
[ 989.768839] ? find_held_lock+0x2b/0x80
[ 989.773951] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.779839] schedule+0xd8/0x260
[ 989.784263] schedule_preempt_disabled+0x18/0x30
[ 989.790245] __mutex_lock+0x6af/0x2010
[ 989.795255] ? threaded_store+0x132/0x220
[ 989.800559] ? ww_mutex_lock+0x160/0x160
[ 989.805760] ? selinux_inode_free_security+0x330/0x330
[ 989.812332] ? cap_capable+0x1d6/0x3e0
[ 989.817350] ? threaded_store+0x132/0x220
[ 989.822651] threaded_store+0x132/0x220
[ 989.827762] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.833063] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.838368] ? sysfs_kf_write+0x65/0x160
[ 989.843573] ? sysfs_file_ops+0x140/0x140
[ 989.848871] kernfs_fop_write_iter+0x335/0x510
[ 989.854659] ? kernfs_ops+0xf0/0xf0
[ 989.859376] new_sync_write+0x333/0x750
[ 989.864484] ? __lock_acquire+0x508/0xc10
[ 989.869786] ? new_sync_read+0x740/0x740
[ 989.874989] ? lock_acquire.part.0+0xbc/0x260
[ 989.880680] ? ksys_write+0x116/0x250
[ 989.885594] vfs_write+0x657/0x9b0
[ 989.890214] ksys_write+0x116/0x250
[ 989.894931] ? __ia32_sys_read+0xc0/0xc0
[ 989.900135] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.905731] ? rcu_is_watching+0x15/0xd0
[ 989.910938] do_syscall_64+0xf3/0x650
[ 989.915846] ? trace_hardirqs_off+0xd/0x30
[ 989.921236] ? exc_page_fault+0xda/0xf0
[ 989.926342] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.932816] RIP: 0033:0x7fb2b931f22e
[ 989.937631] RSP: 002b:00007fff610e4240 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.946937] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb2b931f22e
[ 989.955749] RDX: 0000000000000001 RSI: 000055d5b8bdf6b0 RDI: 0000000000000007
[ 989.964565] RBP: 00007fff610e4250 R08: 0000000000000000 R09: 0000000000000000
[ 989.973378] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb2b9197390
[ 989.982189] R13: 000055d5b8bdf6b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.991016]
[ 989.994329] INFO: task python3:5874 is blocked on a mutex likely owned by task python3:3838.
[ 990.004608] task:python3 state:D stack:25672 pid:3838 tgid:3838 ppid:3837 task_flags:0x400100 flags:0x00080802
[ 990.017819] Call Trace:
[ 990.021363]
[ 990.024507] __schedule+0xcc3/0x19c0
[ 990.029323] ? io_schedule_timeout+0x140/0x140
[ 990.035110] ? find_held_lock+0x2b/0x80
[ 990.040218] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.046406] schedule+0xd8/0x260
[ 990.050827] schedule_timeout+0x13f/0x290
[ 990.056121] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.062497] ? trace_contention_end+0xb3/0x1a0
[ 990.068286] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.073979] ? ww_mutex_lock+0x160/0x160
[ 990.079182] msleep+0x1b/0x30
[ 990.083313] napi_set_threaded+0x3a5/0x440
[ 990.088712] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.094210] netif_set_threaded+0x257/0x400
[ 990.099709] threaded_store+0x1b8/0x220
[ 990.104806] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.110106] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.115405] ? sysfs_kf_write+0x65/0x160
[ 990.120611] ? sysfs_file_ops+0x140/0x140
[ 990.125912] kernfs_fop_write_iter+0x335/0x510
[ 990.131701] ? kernfs_ops+0xf0/0xf0
[ 990.136416] new_sync_write+0x333/0x750
[ 990.141528] ? __lock_acquire+0x508/0xc10
[ 990.146827] ? new_sync_read+0x740/0x740
[ 990.152032] ? lock_acquire.part.0+0xbc/0x260
[ 990.157722] ? ksys_write+0x116/0x250
[ 990.162640] vfs_write+0x657/0x9b0
[ 990.167261] ksys_write+0x116/0x250
[ 990.171981] ? __ia32_sys_read+0xc0/0xc0
[ 990.177177] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.182772] ? rcu_is_watching+0x15/0xd0
[ 990.187975] do_syscall_64+0xf3/0x650
[ 990.192887] ? trace_hardirqs_off+0xd/0x30
[ 990.198285] ? exc_page_fault+0xda/0xf0
[ 990.203392] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.209863] RIP: 0033:0x7f701ad6b22e
[ 990.214676] RSP: 002b:00007fff9361e160 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.223988] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f701ad6b22e
[ 990.232796] RDX: 0000000000000001 RSI: 000055a7e3e486b0 RDI: 0000000000000007
[ 990.241604] RBP: 00007fff9361e170 R08: 0000000000000000 R09: 0000000000000000
[ 990.250411] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f701abe3390
[ 990.259218] R13: 000055a7e3e486b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.268022]
[ 990.271282] \x0aShowing all locks held in the system:
[ 990.279820] 1 lock held by khungtaskd/185:
[ 990.285214] #0: ffffffff9fafdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.296690] 2 locks held by systemd-journal/802:
[ 990.302666] #0: ff1100180e6372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.312553] #1: ffffffff9fd029a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.325379] 4 locks held by python3/3838:
[ 990.330675] #0: ff1100012e2d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.340562] #1: ff11000187487480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.351530] #2: ff11000120b39450 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.362688] #3: ff11000120bc1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.372786] 4 locks held by python3/5874:
[ 990.378080] #0: ff1100012e2d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.387967] #1: ff110001ef154480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.398928] #2: ff11000120b39450 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.410081] #3: ff11000120bc1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.420169]
[ 990.422633] =============================================\x0a
[ 1112.593799] INFO: task python3:5874 blocked for more than 245 seconds.
[ 1112.601948] Not tainted 7.1.0-rc4-wvvd-gb2b2ce506207 #1
[ 1112.609190] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.618779] task:python3 state:D stack:25672 pid:5874 tgid:5874 ppid:5873 task_flags:0x400100 flags:0x00080000
[ 1112.631985] Call Trace:
[ 1112.635526]
[ 1112.638677] __schedule+0xcc3/0x19c0
[ 1112.643496] ? io_schedule_timeout+0x140/0x140
[ 1112.649284] ? find_held_lock+0x2b/0x80
[ 1112.654387] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.660272] schedule+0xd8/0x260
[ 1112.664691] schedule_preempt_disabled+0x18/0x30
[ 1112.670668] __mutex_lock+0x6af/0x2010
[ 1112.675672] ? threaded_store+0x132/0x220
[ 1112.680971] ? ww_mutex_lock+0x160/0x160
[ 1112.686171] ? selinux_inode_free_security+0x330/0x330
[ 1112.692742] ? cap_capable+0x1d6/0x3e0
[ 1112.697752] ? threaded_store+0x132/0x220
[ 1112.703054] threaded_store+0x132/0x220
[ 1112.708157] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.713456] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.718753] ? sysfs_kf_write+0x65/0x160
[ 1112.723956] ? sysfs_file_ops+0x140/0x140
[ 1112.729253] kernfs_fop_write_iter+0x335/0x510
[ 1112.735038] ? kernfs_ops+0xf0/0xf0
[ 1112.739750] new_sync_write+0x333/0x750
[ 1112.744852] ? __lock_acquire+0x508/0xc10
[ 1112.750149] ? new_sync_read+0x740/0x740
[ 1112.755344] ? lock_acquire.part.0+0xbc/0x260
[ 1112.761031] ? ksys_write+0x116/0x250
[ 1112.765932] vfs_write+0x657/0x9b0
[ 1112.770547] ksys_write+0x116/0x250
[ 1112.775261] ? __ia32_sys_read+0xc0/0xc0
[ 1112.780459] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.786050] ? rcu_is_watching+0x15/0xd0
[ 1112.791252] do_syscall_64+0xf3/0x650
[ 1112.796157] ? trace_hardirqs_off+0xd/0x30
[ 1112.801554] ? exc_page_fault+0xda/0xf0
[ 1112.806658] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.813126] RIP: 0033:0x7fb2b931f22e
[ 1112.817938] RSP: 002b:00007fff610e4240 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.827237] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb2b931f22e
[ 1112.836048] RDX: 0000000000000001 RSI: 000055d5b8bdf6b0 RDI: 0000000000000007
[ 1112.844858] RBP: 00007fff610e4250 R08: 0000000000000000 R09: 0000000000000000
[ 1112.853665] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb2b9197390
[ 1112.862476] R13: 000055d5b8bdf6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.871290]
[ 1112.874570] INFO: task python3:5874 is blocked on a mutex likely owned by task python3:3838.
[ 1112.884845] task:python3 state:D stack:25672 pid:3838 tgid:3838 ppid:3837 task_flags:0x400100 flags:0x00080802
[ 1112.898050] Call Trace:
[ 1112.901588]
[ 1112.904740] __schedule+0xcc3/0x19c0
[ 1112.909553] ? io_schedule_timeout+0x140/0x140
[ 1112.915340] ? find_held_lock+0x2b/0x80
[ 1112.920445] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.926621] schedule+0xd8/0x260
[ 1112.931041] schedule_timeout+0x13f/0x290
[ 1112.936330] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.942700] ? trace_contention_end+0xb3/0x1a0
[ 1112.948484] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.954176] ? ww_mutex_lock+0x160/0x160
[ 1112.959377] msleep+0x1b/0x30
[ 1112.963503] napi_set_threaded+0x3a5/0x440
[ 1112.968890] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.974383] netif_set_threaded+0x257/0x400
[ 1112.979878] threaded_store+0x1b8/0x220
[ 1112.984979] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.990278] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.995572] ? sysfs_kf_write+0x65/0x160
[ 1113.000774] ? sysfs_file_ops+0x140/0x140
[ 1113.006070] kernfs_fop_write_iter+0x335/0x510
[ 1113.011855] ? kernfs_ops+0xf0/0xf0
[ 1113.016566] new_sync_write+0x333/0x750
[ 1113.021670] ? __lock_acquire+0x508/0xc10
[ 1113.026966] ? new_sync_read+0x740/0x740
[ 1113.032169] ? lock_acquire.part.0+0xbc/0x260
[ 1113.037854] ? ksys_write+0x116/0x250
[ 1113.042765] vfs_write+0x657/0x9b0
[ 1113.047382] ksys_write+0x116/0x250
[ 1113.052096] ? __ia32_sys_read+0xc0/0xc0
[ 1113.057299] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.062890] ? rcu_is_watching+0x15/0xd0
[ 1113.068089] do_syscall_64+0xf3/0x650
[ 1113.072994] ? trace_hardirqs_off+0xd/0x30
[ 1113.078390] ? exc_page_fault+0xda/0xf0
[ 1113.083483] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.089950] RIP: 0033:0x7f701ad6b22e
[ 1113.094760] RSP: 002b:00007fff9361e160 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.104048] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f701ad6b22e
[ 1113.112854] RDX: 0000000000000001 RSI: 000055a7e3e486b0 RDI: 0000000000000007
[ 1113.121665] RBP: 00007fff9361e170 R08: 0000000000000000 R09: 0000000000000000
[ 1113.130472] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f701abe3390
[ 1113.139280] R13: 000055a7e3e486b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.148095]
[ 1113.151355] \x0aShowing all locks held in the system:
[ 1113.159893] 1 lock held by khungtaskd/185:
[ 1113.165286] #0: ffffffff9fafdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.176769] 4 locks held by python3/3838:
[ 1113.182067] #0: ff1100012e2d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.191961] #1: ff11000187487480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.202923] #2: ff11000120b39450 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.214079] #3: ff11000120bc1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.224177] 4 locks held by python3/5874:
[ 1113.229472] #0: ff1100012e2d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.239362] #1: ff110001ef154480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.250322] #2: ff11000120b39450 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.261480] #3: ff11000120bc1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.271571]
[ 1113.274038] =============================================\x0a
[ 1235.473931] INFO: task python3:5874 blocked for more than 368 seconds.
[ 1235.482078] Not tainted 7.1.0-rc4-wvvd-gb2b2ce506207 #1
[ 1235.489330] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.498919] task:python3 state:D stack:25672 pid:5874 tgid:5874 ppid:5873 task_flags:0x400100 flags:0x00080002
[ 1235.512125] Call Trace:
[ 1235.515667]
[ 1235.518819] __schedule+0xcc3/0x19c0
[ 1235.523639] ? io_schedule_timeout+0x140/0x140
[ 1235.529426] ? find_held_lock+0x2b/0x80
[ 1235.534533] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.540418] schedule+0xd8/0x260
[ 1235.544836] schedule_preempt_disabled+0x18/0x30
[ 1235.550818] __mutex_lock+0x6af/0x2010
[ 1235.555823] ? threaded_store+0x132/0x220
[ 1235.561126] ? ww_mutex_lock+0x160/0x160
[ 1235.566325] ? selinux_inode_free_security+0x330/0x330
[ 1235.572896] ? cap_capable+0x1d6/0x3e0
[ 1235.577904] ? threaded_store+0x132/0x220
[ 1235.583204] threaded_store+0x132/0x220
[ 1235.588309] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.593608] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.598905] ? sysfs_kf_write+0x65/0x160
[ 1235.604107] ? sysfs_file_ops+0x140/0x140
[ 1235.609404] kernfs_fop_write_iter+0x335/0x510
[ 1235.615183] ? kernfs_ops+0xf0/0xf0
[ 1235.619894] new_sync_write+0x333/0x750
[ 1235.624999] ? __lock_acquire+0x508/0xc10
[ 1235.630285] ? new_sync_read+0x740/0x740
[ 1235.635489] ? lock_acquire.part.0+0xbc/0x260
[ 1235.641175] ? ksys_write+0x116/0x250
[ 1235.646084] vfs_write+0x657/0x9b0
[ 1235.650702] ksys_write+0x116/0x250
[ 1235.655416] ? __ia32_sys_read+0xc0/0xc0
[ 1235.660618] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.666208] ? rcu_is_watching+0x15/0xd0
[ 1235.671410] do_syscall_64+0xf3/0x650
[ 1235.676318] ? trace_hardirqs_off+0xd/0x30
[ 1235.681715] ? exc_page_fault+0xda/0xf0
[ 1235.686819] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.693286] RIP: 0033:0x7fb2b931f22e
[ 1235.698088] RSP: 002b:00007fff610e4240 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.707386] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb2b931f22e
[ 1235.716196] RDX: 0000000000000001 RSI: 000055d5b8bdf6b0 RDI: 0000000000000007
[ 1235.725006] RBP: 00007fff610e4250 R08: 0000000000000000 R09: 0000000000000000
[ 1235.733816] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb2b9197390
[ 1235.742627] R13: 000055d5b8bdf6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.751441]
[ 1235.754712] INFO: task python3:5874 is blocked on a mutex likely owned by task python3:3838.
[ 1235.764987] task:python3 state:D stack:25672 pid:3838 tgid:3838 ppid:3837 task_flags:0x400100 flags:0x00080802
[ 1235.778191] Call Trace:
[ 1235.781729]
[ 1235.784881] __schedule+0xcc3/0x19c0
[ 1235.789694] ? io_schedule_timeout+0x140/0x140
[ 1235.795479] ? find_held_lock+0x2b/0x80
[ 1235.800584] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.806767] schedule+0xd8/0x260
[ 1235.811185] schedule_timeout+0x13f/0x290
[ 1235.816481] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.822852] ? trace_contention_end+0xb3/0x1a0
[ 1235.828634] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.834327] ? ww_mutex_lock+0x160/0x160
[ 1235.839527] msleep+0x1b/0x30
[ 1235.843653] napi_set_threaded+0x3a5/0x440
[ 1235.849050] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.854544] netif_set_threaded+0x257/0x400
[ 1235.860038] threaded_store+0x1b8/0x220
[ 1235.865144] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.870441] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.875736] ? sysfs_kf_write+0x65/0x160
[ 1235.880937] ? sysfs_file_ops+0x140/0x140
[ 1235.886224] kernfs_fop_write_iter+0x335/0x510
[ 1235.892010] ? kernfs_ops+0xf0/0xf0
[ 1235.896722] new_sync_write+0x333/0x750
[ 1235.901825] ? __lock_acquire+0x508/0xc10
[ 1235.907116] ? new_sync_read+0x740/0x740
[ 1235.912316] ? lock_acquire.part.0+0xbc/0x260
[ 1235.917994] ? ksys_write+0x116/0x250
[ 1235.922904] vfs_write+0x657/0x9b0
[ 1235.927521] ksys_write+0x116/0x250
[ 1235.932236] ? __ia32_sys_read+0xc0/0xc0
[ 1235.937434] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.943026] ? rcu_is_watching+0x15/0xd0
[ 1235.948229] do_syscall_64+0xf3/0x650
[ 1235.953137] ? trace_hardirqs_off+0xd/0x30
[ 1235.958532] ? exc_page_fault+0xda/0xf0
[ 1235.963625] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.970093] RIP: 0033:0x7f701ad6b22e
[ 1235.974892] RSP: 002b:00007fff9361e160 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.984189] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f701ad6b22e
[ 1235.992999] RDX: 0000000000000001 RSI: 000055a7e3e486b0 RDI: 0000000000000007
[ 1236.001810] RBP: 00007fff9361e170 R08: 0000000000000000 R09: 0000000000000000
[ 1236.010620] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f701abe3390
[ 1236.019430] R13: 000055a7e3e486b0 R14: 0000000000000007 R15: 0000000000000003
[ 1236.028244]
[ 1236.031511] \x0aShowing all locks held in the system:
[ 1236.040049] 1 lock held by khungtaskd/185:
[ 1236.045442] #0: ffffffff9fafdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.056914] 2 locks held by systemd-journal/802:
[ 1236.062895] #0: ff1100180e5372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.072783] #1: ffffffff9fd029a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.085609] 4 locks held by python3/3838:
[ 1236.090903] #0: ff1100012e2d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.100792] #1: ff11000187487480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.111756] #2: ff11000120b39450 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.122920] #3: ff11000120bc1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.133012] 4 locks held by python3/5874:
[ 1236.138309] #0: ff1100012e2d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.148198] #1: ff110001ef154480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.159153] #2: ff11000120b39450 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.170311] #3: ff11000120bc1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.180402]
[ 1236.182867] =============================================\x0a
[ 1358.356000] INFO: task python3:5874 blocked for more than 491 seconds.
[ 1358.364151] Not tainted 7.1.0-rc4-wvvd-gb2b2ce506207 #1
[ 1358.371741] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.381330] task:python3 state:D stack:25672 pid:5874 tgid:5874 ppid:5873 task_flags:0x400100 flags:0x00080002
[ 1358.394527] Call Trace:
[ 1358.398064]
[ 1358.401215] __schedule+0xcc3/0x19c0
[ 1358.406031] ? io_schedule_timeout+0x140/0x140
[ 1358.411816] ? find_held_lock+0x2b/0x80
[ 1358.411824] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.411830] schedule+0xd8/0x260
[ 1358.411833] schedule_preempt_disabled+0x18/0x30
[ 1358.411836] __mutex_lock+0x6af/0x2010
[ 1358.411840] ? threaded_store+0x132/0x220
[ 1358.443586] ? ww_mutex_lock+0x160/0x160
[ 1358.448788] ? selinux_inode_free_security+0x330/0x330
[ 1358.455357] ? cap_capable+0x1d6/0x3e0
[ 1358.460364] ? threaded_store+0x132/0x220
[ 1358.465660] threaded_store+0x132/0x220
[ 1358.470759] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.476057] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.481353] ? sysfs_kf_write+0x65/0x160
[ 1358.486553] ? sysfs_file_ops+0x140/0x140
[ 1358.491840] kernfs_fop_write_iter+0x335/0x510
[ 1358.497627] ? kernfs_ops+0xf0/0xf0
[ 1358.502336] new_sync_write+0x333/0x750
[ 1358.507440] ? __lock_acquire+0x508/0xc10
[ 1358.512734] ? new_sync_read+0x740/0x740
[ 1358.517935] ? lock_acquire.part.0+0xbc/0x260
[ 1358.523618] ? ksys_write+0x116/0x250
[ 1358.528526] vfs_write+0x657/0x9b0
[ 1358.533142] ksys_write+0x116/0x250
[ 1358.537856] ? __ia32_sys_read+0xc0/0xc0
[ 1358.543056] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.548643] ? rcu_is_watching+0x15/0xd0
[ 1358.553842] do_syscall_64+0xf3/0x650
[ 1358.558750] ? trace_hardirqs_off+0xd/0x30
[ 1358.564144] ? exc_page_fault+0xda/0xf0
[ 1358.569244] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.575708] RIP: 0033:0x7fb2b931f22e
[ 1358.580518] RSP: 002b:00007fff610e4240 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.589807] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb2b931f22e
[ 1358.598612] RDX: 0000000000000001 RSI: 000055d5b8bdf6b0 RDI: 0000000000000007
[ 1358.607422] RBP: 00007fff610e4250 R08: 0000000000000000 R09: 0000000000000000
[ 1358.616226] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb2b9197390
[ 1358.625031] R13: 000055d5b8bdf6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.633840]
[ 1358.637170] INFO: task python3:5874 is blocked on a mutex likely owned by task python3:3838.
[ 1358.647440] task:python3 state:D stack:25672 pid:3838 tgid:3838 ppid:3837 task_flags:0x400100 flags:0x00080802
[ 1358.660640] Call Trace:
[ 1358.664167]
[ 1358.667314] __schedule+0xcc3/0x19c0
[ 1358.672127] ? io_schedule_timeout+0x140/0x140
[ 1358.677908] ? find_held_lock+0x2b/0x80
[ 1358.683008] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.689185] schedule+0xd8/0x260
[ 1358.693602] schedule_timeout+0x13f/0x290
[ 1358.698899] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.705265] ? trace_contention_end+0xb3/0x1a0
[ 1358.711050] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.716729] ? ww_mutex_lock+0x160/0x160
[ 1358.721928] msleep+0x1b/0x30
[ 1358.726050] napi_set_threaded+0x3a5/0x440
[ 1358.731443] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.736937] netif_set_threaded+0x257/0x400
[ 1358.742427] threaded_store+0x1b8/0x220
[ 1358.747529] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.752827] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.758122] ? sysfs_kf_write+0x65/0x160
[ 1358.763323] ? sysfs_file_ops+0x140/0x140
[ 1358.768620] kernfs_fop_write_iter+0x335/0x510
[ 1358.774401] ? kernfs_ops+0xf0/0xf0
[ 1358.779111] new_sync_write+0x333/0x750
[ 1358.784210] ? __lock_acquire+0x508/0xc10
[ 1358.789506] ? new_sync_read+0x740/0x740
[ 1358.794702] ? lock_acquire.part.0+0xbc/0x260
[ 1358.800390] ? ksys_write+0x116/0x250
[ 1358.805290] vfs_write+0x657/0x9b0
[ 1358.809903] ksys_write+0x116/0x250
[ 1358.814612] ? __ia32_sys_read+0xc0/0xc0
[ 1358.819809] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.825397] ? rcu_is_watching+0x15/0xd0
[ 1358.830596] do_syscall_64+0xf3/0x650
[ 1358.835501] ? trace_hardirqs_off+0xd/0x30
[ 1358.840892] ? exc_page_fault+0xda/0xf0
[ 1358.845991] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.852456] RIP: 0033:0x7f701ad6b22e
[ 1358.857261] RSP: 002b:00007fff9361e160 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.866556] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f701ad6b22e
[ 1358.875365] RDX: 0000000000000001 RSI: 000055a7e3e486b0 RDI: 0000000000000007
[ 1358.884169] RBP: 00007fff9361e170 R08: 0000000000000000 R09: 0000000000000000
[ 1358.892974] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f701abe3390
[ 1358.901780] R13: 000055a7e3e486b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.910593]
[ 1358.913869] \x0aShowing all locks held in the system:
[ 1358.922398] 1 lock held by khungtaskd/185:
[ 1358.927791] #0: ffffffff9fafdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.939277] 4 locks held by python3/3838:
[ 1358.944569] #0: ff1100012e2d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.954456] #1: ff11000187487480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.965418] #2: ff11000120b39450 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.976575] #3: ff11000120bc1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.986672] 4 locks held by python3/5874:
[ 1358.991964] #0: ff1100012e2d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.001858] #1: ff110001ef154480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.012817] #2: ff11000120b39450 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.023976] #3: ff11000120bc1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.034067] 5 locks held by (systemd-user-)/7715:
[ 1359.040140] #0: ff1100012e5e43e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.050028] #1: ff1100013f5c2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.060985] #2: ffffffff9fb69b60 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1359.071652] #3: ffffffff9f9686f0 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650
[ 1359.083295] #4: ffffffff9fb698d0 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650
[ 1359.095721]
[ 1359.098184] =============================================\x0a