[ 784.209906] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 784.212978] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 784.373108] kselftest: Running tests in drivers/net
[ 989.706599] INFO: task python3:5700 blocked for more than 122 seconds.
[ 989.714815] Not tainted 7.1.0-rc2-vpwd-gd245c487d19e #1
[ 989.722551] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.732140] task:python3 state:D stack:25672 pid:5700 tgid:5700 ppid:5699 task_flags:0x400100 flags:0x00080000
[ 989.745346] Call Trace:
[ 989.748887]
[ 989.752039] __schedule+0xcba/0x1940
[ 989.756857] ? io_schedule_timeout+0x140/0x140
[ 989.762642] ? find_held_lock+0x2b/0x80
[ 989.767748] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.773635] schedule+0xd4/0x260
[ 989.778053] schedule_preempt_disabled+0x18/0x30
[ 989.784032] __mutex_lock+0x6a3/0x2000
[ 989.789037] ? threaded_store+0x132/0x220
[ 989.794337] ? ww_mutex_lock+0x160/0x160
[ 989.799538] ? selinux_inode_free_security+0x330/0x330
[ 989.806110] ? cap_capable+0x1d6/0x3e0
[ 989.811120] ? threaded_store+0x132/0x220
[ 989.816418] threaded_store+0x132/0x220
[ 989.821521] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.826819] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.832120] ? sysfs_kf_write+0x65/0x160
[ 989.837321] ? sysfs_file_ops+0x140/0x140
[ 989.842620] kernfs_fop_write_iter+0x335/0x510
[ 989.848404] ? kernfs_ops+0xf0/0xf0
[ 989.853116] new_sync_write+0x333/0x750
[ 989.858222] ? __lock_acquire+0x508/0xc10
[ 989.863519] ? new_sync_read+0x740/0x740
[ 989.868720] ? lock_acquire.part.0+0xbc/0x260
[ 989.874408] ? ksys_write+0x116/0x250
[ 989.879319] vfs_write+0x657/0x9b0
[ 989.883937] ksys_write+0x116/0x250
[ 989.888647] ? __ia32_sys_read+0xc0/0xc0
[ 989.893846] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.899439] ? rcu_is_watching+0x15/0xd0
[ 989.904640] do_syscall_64+0xf3/0x650
[ 989.909547] ? trace_hardirqs_off+0xd/0x30
[ 989.914936] ? exc_page_fault+0xda/0xf0
[ 989.920040] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.926508] RIP: 0033:0x7fa9fef1922e
[ 989.931311] RSP: 002b:00007ffd9ef6fdb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.940611] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa9fef1922e
[ 989.949422] RDX: 0000000000000001 RSI: 0000565350b03fe0 RDI: 0000000000000007
[ 989.958230] RBP: 00007ffd9ef6fdc0 R08: 0000000000000000 R09: 0000000000000000
[ 989.967042] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa9fed91390
[ 989.975851] R13: 0000565350b03fe0 R14: 0000000000000007 R15: 0000000000000003
[ 989.984677]
[ 989.987976] INFO: task python3:5700 is blocked on a mutex likely owned by task python3:3664.
[ 989.998247] task:python3 state:D stack:25672 pid:3664 tgid:3664 ppid:3663 task_flags:0x400100 flags:0x00080802
[ 990.011453] Call Trace:
[ 990.014992]
[ 990.018146] __schedule+0xcba/0x1940
[ 990.022958] ? io_schedule_timeout+0x140/0x140
[ 990.028743] ? find_held_lock+0x2b/0x80
[ 990.033840] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.040018] schedule+0xd4/0x260
[ 990.044444] schedule_timeout+0x13f/0x290
[ 990.049742] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.056103] ? trace_contention_end+0xb3/0x1a0
[ 990.061881] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.067570] ? ww_mutex_lock+0x160/0x160
[ 990.072772] msleep+0x1b/0x30
[ 990.076899] napi_set_threaded+0x3a5/0x440
[ 990.082293] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.087786] netif_set_threaded+0x257/0x400
[ 990.093278] threaded_store+0x1b8/0x220
[ 990.098384] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.103682] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.108979] ? sysfs_kf_write+0x65/0x160
[ 990.114179] ? sysfs_file_ops+0x140/0x140
[ 990.119468] kernfs_fop_write_iter+0x335/0x510
[ 990.125242] ? kernfs_ops+0xf0/0xf0
[ 990.129953] new_sync_write+0x333/0x750
[ 990.135057] ? __lock_acquire+0x508/0xc10
[ 990.140354] ? new_sync_read+0x740/0x740
[ 990.145556] ? lock_acquire.part.0+0xbc/0x260
[ 990.151245] ? ksys_write+0x116/0x250
[ 990.156157] vfs_write+0x657/0x9b0
[ 990.160775] ksys_write+0x116/0x250
[ 990.165489] ? __ia32_sys_read+0xc0/0xc0
[ 990.170687] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.176275] ? rcu_is_watching+0x15/0xd0
[ 990.181474] do_syscall_64+0xf3/0x650
[ 990.186378] ? trace_hardirqs_off+0xd/0x30
[ 990.191773] ? exc_page_fault+0xda/0xf0
[ 990.196876] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.203347] RIP: 0033:0x7efe26ef922e
[ 990.208155] RSP: 002b:00007ffec3016ac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.217454] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efe26ef922e
[ 990.226265] RDX: 0000000000000001 RSI: 000055b9b141ffe0 RDI: 0000000000000007
[ 990.235076] RBP: 00007ffec3016ad0 R08: 0000000000000000 R09: 0000000000000000
[ 990.243885] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efe26d71390
[ 990.252694] R13: 000055b9b141ffe0 R14: 0000000000000007 R15: 0000000000000003
[ 990.261509]
[ 990.264771] \x0aShowing all locks held in the system:
[ 990.273312] 1 lock held by khungtaskd/184:
[ 990.278707] #0: ffffffff9bcfdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.290183] 3 locks held by systemd-journal/800:
[ 990.296162] #0: ff1100180e2b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.306049] #1: ffffffff9bf032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.318868] #2: ff11000138daf8e0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.330428] 4 locks held by python3/3664:
[ 990.335724] #0: ff1100011e9d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.345614] #1: ff1100016b606280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.356576] #2: ff11000122e20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.367733] #3: ff11000122e99d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.377836] 4 locks held by python3/5700:
[ 990.383131] #0: ff1100011e9d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.393020] #1: ff110001e2c10e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.403971] #2: ff11000122e20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.415127] #3: ff11000122e99d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.425217]
[ 990.427684] =============================================\x0a
[ 1112.586780] INFO: task python3:5700 blocked for more than 245 seconds.
[ 1112.594929] Not tainted 7.1.0-rc2-vpwd-gd245c487d19e #1
[ 1112.602179] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.611766] task:python3 state:D stack:25672 pid:5700 tgid:5700 ppid:5699 task_flags:0x400100 flags:0x00080000
[ 1112.624970] Call Trace:
[ 1112.628511]
[ 1112.631658] __schedule+0xcba/0x1940
[ 1112.636472] ? io_schedule_timeout+0x140/0x140
[ 1112.642254] ? find_held_lock+0x2b/0x80
[ 1112.647357] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.653241] schedule+0xd4/0x260
[ 1112.657658] schedule_preempt_disabled+0x18/0x30
[ 1112.663635] __mutex_lock+0x6a3/0x2000
[ 1112.668638] ? threaded_store+0x132/0x220
[ 1112.673936] ? ww_mutex_lock+0x160/0x160
[ 1112.679134] ? selinux_inode_free_security+0x330/0x330
[ 1112.685705] ? cap_capable+0x1d6/0x3e0
[ 1112.690714] ? threaded_store+0x132/0x220
[ 1112.696007] threaded_store+0x132/0x220
[ 1112.701108] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.706406] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.711706] ? sysfs_kf_write+0x65/0x160
[ 1112.716908] ? sysfs_file_ops+0x140/0x140
[ 1112.722200] kernfs_fop_write_iter+0x335/0x510
[ 1112.727983] ? kernfs_ops+0xf0/0xf0
[ 1112.732694] new_sync_write+0x333/0x750
[ 1112.737798] ? __lock_acquire+0x508/0xc10
[ 1112.743093] ? new_sync_read+0x740/0x740
[ 1112.748296] ? lock_acquire.part.0+0xbc/0x260
[ 1112.753983] ? ksys_write+0x116/0x250
[ 1112.758892] vfs_write+0x657/0x9b0
[ 1112.763503] ksys_write+0x116/0x250
[ 1112.768216] ? __ia32_sys_read+0xc0/0xc0
[ 1112.773403] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.778994] ? rcu_is_watching+0x15/0xd0
[ 1112.784194] do_syscall_64+0xf3/0x650
[ 1112.789098] ? trace_hardirqs_off+0xd/0x30
[ 1112.794494] ? exc_page_fault+0xda/0xf0
[ 1112.799596] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.806053] RIP: 0033:0x7fa9fef1922e
[ 1112.810859] RSP: 002b:00007ffd9ef6fdb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.820155] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa9fef1922e
[ 1112.828960] RDX: 0000000000000001 RSI: 0000565350b03fe0 RDI: 0000000000000007
[ 1112.837764] RBP: 00007ffd9ef6fdc0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.846573] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa9fed91390
[ 1112.855369] R13: 0000565350b03fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.864180]
[ 1112.867459] INFO: task python3:5700 is blocked on a mutex likely owned by task python3:3664.
[ 1112.877731] task:python3 state:D stack:25672 pid:3664 tgid:3664 ppid:3663 task_flags:0x400100 flags:0x00080802
[ 1112.890930] Call Trace:
[ 1112.894468]
[ 1112.897620] __schedule+0xcba/0x1940
[ 1112.902430] ? io_schedule_timeout+0x140/0x140
[ 1112.908207] ? find_held_lock+0x2b/0x80
[ 1112.913311] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.919489] schedule+0xd4/0x260
[ 1112.923908] schedule_timeout+0x13f/0x290
[ 1112.929206] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.935573] ? trace_contention_end+0xb3/0x1a0
[ 1112.941356] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.947045] ? ww_mutex_lock+0x160/0x160
[ 1112.952242] msleep+0x1b/0x30
[ 1112.956364] napi_set_threaded+0x3a5/0x440
[ 1112.961760] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.967246] netif_set_threaded+0x257/0x400
[ 1112.972737] threaded_store+0x1b8/0x220
[ 1112.977840] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.983134] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.988431] ? sysfs_kf_write+0x65/0x160
[ 1112.993628] ? sysfs_file_ops+0x140/0x140
[ 1112.998923] kernfs_fop_write_iter+0x335/0x510
[ 1113.004708] ? kernfs_ops+0xf0/0xf0
[ 1113.009416] new_sync_write+0x333/0x750
[ 1113.014517] ? __lock_acquire+0x508/0xc10
[ 1113.019814] ? new_sync_read+0x740/0x740
[ 1113.025012] ? lock_acquire.part.0+0xbc/0x260
[ 1113.030696] ? ksys_write+0x116/0x250
[ 1113.035607] vfs_write+0x657/0x9b0
[ 1113.040221] ksys_write+0x116/0x250
[ 1113.044933] ? __ia32_sys_read+0xc0/0xc0
[ 1113.050132] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.055719] ? rcu_is_watching+0x15/0xd0
[ 1113.060920] do_syscall_64+0xf3/0x650
[ 1113.065828] ? trace_hardirqs_off+0xd/0x30
[ 1113.071210] ? exc_page_fault+0xda/0xf0
[ 1113.076310] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.082778] RIP: 0033:0x7efe26ef922e
[ 1113.087574] RSP: 002b:00007ffec3016ac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.096869] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efe26ef922e
[ 1113.105677] RDX: 0000000000000001 RSI: 000055b9b141ffe0 RDI: 0000000000000007
[ 1113.114476] RBP: 00007ffec3016ad0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.123281] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efe26d71390
[ 1113.132089] R13: 000055b9b141ffe0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.140902]
[ 1113.144166] \x0aShowing all locks held in the system:
[ 1113.152703] 1 lock held by khungtaskd/184:
[ 1113.158093] #0: ffffffff9bcfdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.169575] 4 locks held by python3/3664:
[ 1113.174870] #0: ff1100011e9d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.184762] #1: ff1100016b606280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.195722] #2: ff11000122e20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.206877] #3: ff11000122e99d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.216971] 4 locks held by python3/5700:
[ 1113.222265] #0: ff1100011e9d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.232154] #1: ff110001e2c10e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.243104] #2: ff11000122e20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.254262] #3: ff11000122e99d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.264353]
[ 1113.266820] =============================================\x0a
[ 1235.468943] INFO: task python3:5700 blocked for more than 368 seconds.
[ 1235.477088] Not tainted 7.1.0-rc2-vpwd-gd245c487d19e #1
[ 1235.484339] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.493926] task:python3 state:D stack:25672 pid:5700 tgid:5700 ppid:5699 task_flags:0x400100 flags:0x00080002
[ 1235.507130] Call Trace:
[ 1235.510669]
[ 1235.513817] __schedule+0xcba/0x1940
[ 1235.518632] ? io_schedule_timeout+0x140/0x140
[ 1235.524418] ? find_held_lock+0x2b/0x80
[ 1235.529521] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.535403] schedule+0xd4/0x260
[ 1235.539819] schedule_preempt_disabled+0x18/0x30
[ 1235.545796] __mutex_lock+0x6a3/0x2000
[ 1235.550799] ? threaded_store+0x132/0x220
[ 1235.556097] ? ww_mutex_lock+0x160/0x160
[ 1235.561288] ? selinux_inode_free_security+0x330/0x330
[ 1235.567857] ? cap_capable+0x1d6/0x3e0
[ 1235.572866] ? threaded_store+0x132/0x220
[ 1235.578159] threaded_store+0x132/0x220
[ 1235.583260] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.588557] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.593858] ? sysfs_kf_write+0x65/0x160
[ 1235.599055] ? sysfs_file_ops+0x140/0x140
[ 1235.604347] kernfs_fop_write_iter+0x335/0x510
[ 1235.610129] ? kernfs_ops+0xf0/0xf0
[ 1235.614841] new_sync_write+0x333/0x750
[ 1235.619941] ? __lock_acquire+0x508/0xc10
[ 1235.625238] ? new_sync_read+0x740/0x740
[ 1235.630437] ? lock_acquire.part.0+0xbc/0x260
[ 1235.636124] ? ksys_write+0x116/0x250
[ 1235.641034] vfs_write+0x657/0x9b0
[ 1235.645647] ksys_write+0x116/0x250
[ 1235.650359] ? __ia32_sys_read+0xc0/0xc0
[ 1235.655557] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.661145] ? rcu_is_watching+0x15/0xd0
[ 1235.666345] do_syscall_64+0xf3/0x650
[ 1235.671251] ? trace_hardirqs_off+0xd/0x30
[ 1235.676642] ? exc_page_fault+0xda/0xf0
[ 1235.681745] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.688211] RIP: 0033:0x7fa9fef1922e
[ 1235.693018] RSP: 002b:00007ffd9ef6fdb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.702317] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa9fef1922e
[ 1235.711123] RDX: 0000000000000001 RSI: 0000565350b03fe0 RDI: 0000000000000007
[ 1235.719928] RBP: 00007ffd9ef6fdc0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.728736] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa9fed91390
[ 1235.737541] R13: 0000565350b03fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.746355]
[ 1235.749619] INFO: task python3:5700 is blocked on a mutex likely owned by task python3:3664.
[ 1235.759893] task:python3 state:D stack:25672 pid:3664 tgid:3664 ppid:3663 task_flags:0x400100 flags:0x00080802
[ 1235.773093] Call Trace:
[ 1235.776629]
[ 1235.779777] __schedule+0xcba/0x1940
[ 1235.784586] ? io_schedule_timeout+0x140/0x140
[ 1235.790368] ? find_held_lock+0x2b/0x80
[ 1235.795470] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.801648] schedule+0xd4/0x260
[ 1235.806067] schedule_timeout+0x13f/0x290
[ 1235.811363] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.817731] ? trace_contention_end+0xb3/0x1a0
[ 1235.823515] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.829203] ? ww_mutex_lock+0x160/0x160
[ 1235.834392] msleep+0x1b/0x30
[ 1235.838515] napi_set_threaded+0x3a5/0x440
[ 1235.843911] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.849397] netif_set_threaded+0x257/0x400
[ 1235.854890] threaded_store+0x1b8/0x220
[ 1235.859992] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.865286] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.870579] ? sysfs_kf_write+0x65/0x160
[ 1235.875776] ? sysfs_file_ops+0x140/0x140
[ 1235.881071] kernfs_fop_write_iter+0x335/0x510
[ 1235.886855] ? kernfs_ops+0xf0/0xf0
[ 1235.891564] new_sync_write+0x333/0x750
[ 1235.896665] ? __lock_acquire+0x508/0xc10
[ 1235.901962] ? new_sync_read+0x740/0x740
[ 1235.907162] ? lock_acquire.part.0+0xbc/0x260
[ 1235.912848] ? ksys_write+0x116/0x250
[ 1235.917758] vfs_write+0x657/0x9b0
[ 1235.922374] ksys_write+0x116/0x250
[ 1235.927087] ? __ia32_sys_read+0xc0/0xc0
[ 1235.932285] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.937873] ? rcu_is_watching+0x15/0xd0
[ 1235.943070] do_syscall_64+0xf3/0x650
[ 1235.947977] ? trace_hardirqs_off+0xd/0x30
[ 1235.953371] ? exc_page_fault+0xda/0xf0
[ 1235.958471] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.964937] RIP: 0033:0x7efe26ef922e
[ 1235.969744] RSP: 002b:00007ffec3016ac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.979038] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efe26ef922e
[ 1235.987847] RDX: 0000000000000001 RSI: 000055b9b141ffe0 RDI: 0000000000000007
[ 1235.996656] RBP: 00007ffec3016ad0 R08: 0000000000000000 R09: 0000000000000000
[ 1236.005463] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efe26d71390
[ 1236.014264] R13: 000055b9b141ffe0 R14: 0000000000000007 R15: 0000000000000003
[ 1236.023078]
[ 1236.026345] \x0aShowing all locks held in the system:
[ 1236.034883] 1 lock held by khungtaskd/184:
[ 1236.040277] #0: ffffffff9bcfdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.051757] 4 locks held by python3/3664:
[ 1236.057053] #0: ff1100011e9d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.066942] #1: ff1100016b606280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.077902] #2: ff11000122e20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.089057] #3: ff11000122e99d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.099148] 4 locks held by python3/5700:
[ 1236.104442] #0: ff1100011e9d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.114331] #1: ff110001e2c10e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.125289] #2: ff11000122e20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.136445] #3: ff11000122e99d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.146536]
[ 1236.149004] =============================================\x0a
[ 1358.349117] INFO: task python3:5700 blocked for more than 491 seconds.
[ 1358.357262] Not tainted 7.1.0-rc2-vpwd-gd245c487d19e #1
[ 1358.364510] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.374096] task:python3 state:D stack:25672 pid:5700 tgid:5700 ppid:5699 task_flags:0x400100 flags:0x00080002
[ 1358.387300] Call Trace:
[ 1358.390840]
[ 1358.393988] __schedule+0xcba/0x1940
[ 1358.398803] ? io_schedule_timeout+0x140/0x140
[ 1358.404581] ? find_held_lock+0x2b/0x80
[ 1358.409684] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.415569] schedule+0xd4/0x260
[ 1358.419986] schedule_preempt_disabled+0x18/0x30
[ 1358.425966] __mutex_lock+0x6a3/0x2000
[ 1358.430966] ? threaded_store+0x132/0x220
[ 1358.436263] ? ww_mutex_lock+0x160/0x160
[ 1358.441462] ? selinux_inode_free_security+0x330/0x330
[ 1358.448032] ? cap_capable+0x1d6/0x3e0
[ 1358.453036] ? threaded_store+0x132/0x220
[ 1358.458330] threaded_store+0x132/0x220
[ 1358.463430] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.468724] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.474024] ? sysfs_kf_write+0x65/0x160
[ 1358.479221] ? sysfs_file_ops+0x140/0x140
[ 1358.484514] kernfs_fop_write_iter+0x335/0x510
[ 1358.490295] ? kernfs_ops+0xf0/0xf0
[ 1358.495008] new_sync_write+0x333/0x750
[ 1358.500109] ? __lock_acquire+0x508/0xc10
[ 1358.505406] ? new_sync_read+0x740/0x740
[ 1358.510605] ? lock_acquire.part.0+0xbc/0x260
[ 1358.516284] ? ksys_write+0x116/0x250
[ 1358.521185] vfs_write+0x657/0x9b0
[ 1358.525799] ksys_write+0x116/0x250
[ 1358.530509] ? __ia32_sys_read+0xc0/0xc0
[ 1358.535707] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.541295] ? rcu_is_watching+0x15/0xd0
[ 1358.546497] do_syscall_64+0xf3/0x650
[ 1358.551403] ? trace_hardirqs_off+0xd/0x30
[ 1358.556795] ? exc_page_fault+0xda/0xf0
[ 1358.561894] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.568361] RIP: 0033:0x7fa9fef1922e
[ 1358.573159] RSP: 002b:00007ffd9ef6fdb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.582455] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa9fef1922e
[ 1358.591262] RDX: 0000000000000001 RSI: 0000565350b03fe0 RDI: 0000000000000007
[ 1358.600070] RBP: 00007ffd9ef6fdc0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.608869] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa9fed91390
[ 1358.617667] R13: 0000565350b03fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.626479]
[ 1358.629755] INFO: task python3:5700 is blocked on a mutex likely owned by task python3:3664.
[ 1358.640028] task:python3 state:D stack:25672 pid:3664 tgid:3664 ppid:3663 task_flags:0x400100 flags:0x00080802
[ 1358.653226] Call Trace:
[ 1358.656762]
[ 1358.659912] __schedule+0xcba/0x1940
[ 1358.664721] ? io_schedule_timeout+0x140/0x140
[ 1358.670496] ? find_held_lock+0x2b/0x80
[ 1358.675599] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.681774] schedule+0xd4/0x260
[ 1358.686191] schedule_timeout+0x13f/0x290
[ 1358.691487] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.697856] ? trace_contention_end+0xb3/0x1a0
[ 1358.703640] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.709327] ? ww_mutex_lock+0x160/0x160
[ 1358.714526] msleep+0x1b/0x30
[ 1358.718651] napi_set_threaded+0x3a5/0x440
[ 1358.724047] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.729538] netif_set_threaded+0x257/0x400
[ 1358.735030] threaded_store+0x1b8/0x220
[ 1358.740130] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.745426] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.750719] ? sysfs_kf_write+0x65/0x160
[ 1358.755917] ? sysfs_file_ops+0x140/0x140
[ 1358.761212] kernfs_fop_write_iter+0x335/0x510
[ 1358.766994] ? kernfs_ops+0xf0/0xf0
[ 1358.771704] new_sync_write+0x333/0x750
[ 1358.776806] ? __lock_acquire+0x508/0xc10
[ 1358.782100] ? new_sync_read+0x740/0x740
[ 1358.787301] ? lock_acquire.part.0+0xbc/0x260
[ 1358.792987] ? ksys_write+0x116/0x250
[ 1358.797894] vfs_write+0x657/0x9b0
[ 1358.802509] ksys_write+0x116/0x250
[ 1358.807222] ? __ia32_sys_read+0xc0/0xc0
[ 1358.812408] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.817997] ? rcu_is_watching+0x15/0xd0
[ 1358.823195] do_syscall_64+0xf3/0x650
[ 1358.828099] ? trace_hardirqs_off+0xd/0x30
[ 1358.833493] ? exc_page_fault+0xda/0xf0
[ 1358.838594] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.845058] RIP: 0033:0x7efe26ef922e
[ 1358.849863] RSP: 002b:00007ffec3016ac0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.859159] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efe26ef922e
[ 1358.867968] RDX: 0000000000000001 RSI: 000055b9b141ffe0 RDI: 0000000000000007
[ 1358.876774] RBP: 00007ffec3016ad0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.885578] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efe26d71390
[ 1358.894383] R13: 000055b9b141ffe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.903193]
[ 1358.906461] \x0aShowing all locks held in the system:
[ 1358.914998] 1 lock held by khungtaskd/184:
[ 1358.920390] #0: ffffffff9bcfdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.931863] 2 locks held by systemd-journal/800:
[ 1358.937842] #0: ff1100180e9372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1358.947729] #1: ffffffff9bf032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.960555] 4 locks held by python3/3664:
[ 1358.965848] #0: ff1100011e9d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.975736] #1: ff1100016b606280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.986695] #2: ff11000122e20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.997850] #3: ff11000122e99d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.007941] 4 locks held by python3/5700:
[ 1359.013238] #0: ff1100011e9d43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.023127] #1: ff110001e2c10e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.034086] #2: ff11000122e20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.045240] #3: ff11000122e99d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.055331]
[ 1359.057796] =============================================\x0a