[ 788.980355] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 788.982839] nipa-hw-worker: [5/44] Retrying drivers/net:napi_threaded.py
[ 789.140143] kselftest: Running tests in drivers/net
[ 989.658918] INFO: task python3:5889 blocked for more than 122 seconds.
[ 989.667115] Not tainted 7.1.0-rc1-lsza-gcf963a5b1508 #1
[ 989.674649] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.684241] task:python3 state:D stack:25672 pid:5889 tgid:5889 ppid:5888 task_flags:0x400100 flags:0x00080000
[ 989.697451] Call Trace:
[ 989.700990]
[ 989.704144] __schedule+0xcba/0x1940
[ 989.708961] ? io_schedule_timeout+0x140/0x140
[ 989.714748] ? find_held_lock+0x2b/0x80
[ 989.719854] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.725745] schedule+0xd4/0x260
[ 989.730163] schedule_preempt_disabled+0x18/0x30
[ 989.736145] __mutex_lock+0x6a3/0x2000
[ 989.741147] ? threaded_store+0x132/0x220
[ 989.746448] ? ww_mutex_lock+0x160/0x160
[ 989.751648] ? selinux_inode_free_security+0x330/0x330
[ 989.758217] ? cap_capable+0x1d6/0x3e0
[ 989.763231] ? threaded_store+0x132/0x220
[ 989.768528] threaded_store+0x132/0x220
[ 989.773621] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.778920] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.784217] ? sysfs_kf_write+0x65/0x160
[ 989.789420] ? sysfs_file_ops+0x140/0x140
[ 989.794718] kernfs_fop_write_iter+0x335/0x510
[ 989.800501] ? kernfs_ops+0xf0/0xf0
[ 989.805212] new_sync_write+0x333/0x750
[ 989.810308] ? __lock_acquire+0x508/0xc10
[ 989.815596] ? new_sync_read+0x740/0x740
[ 989.820796] ? lock_acquire.part.0+0xbc/0x260
[ 989.826483] ? ksys_write+0x116/0x250
[ 989.831392] vfs_write+0x657/0x9b0
[ 989.836011] ksys_write+0x116/0x250
[ 989.840722] ? __ia32_sys_read+0xc0/0xc0
[ 989.845923] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.851514] ? rcu_is_watching+0x15/0xd0
[ 989.856716] do_syscall_64+0xf3/0x650
[ 989.861623] ? trace_hardirqs_off+0xd/0x30
[ 989.867021] ? exc_page_fault+0xda/0xf0
[ 989.872125] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.878591] RIP: 0033:0x7f9f0579622e
[ 989.883401] RSP: 002b:00007ffe87669310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.892701] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9f0579622e
[ 989.901508] RDX: 0000000000000001 RSI: 000055715138da10 RDI: 0000000000000007
[ 989.910317] RBP: 00007ffe87669320 R08: 0000000000000000 R09: 0000000000000000
[ 989.919128] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9f0560e390
[ 989.927945] R13: 000055715138da10 R14: 0000000000000007 R15: 0000000000000003
[ 989.936762]
[ 989.940047] INFO: task python3:5889 is blocked on a mutex likely owned by task python3:3807.
[ 989.950319] task:python3 state:D stack:25496 pid:3807 tgid:3807 ppid:3805 task_flags:0x400100 flags:0x00080802
[ 989.963524] Call Trace:
[ 989.967064]
[ 989.970214] __schedule+0xcba/0x1940
[ 989.975028] ? io_schedule_timeout+0x140/0x140
[ 989.980812] ? find_held_lock+0x2b/0x80
[ 989.985916] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.992093] schedule+0xd4/0x260
[ 989.996514] schedule_timeout+0x13f/0x290
[ 990.001814] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.008186] ? trace_contention_end+0xb3/0x1a0
[ 990.013973] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.019664] ? ww_mutex_lock+0x160/0x160
[ 990.024867] msleep+0x1b/0x30
[ 990.028993] napi_set_threaded+0x3a5/0x440
[ 990.034387] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.039881] netif_set_threaded+0x257/0x400
[ 990.045375] threaded_store+0x1b8/0x220
[ 990.050477] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.055767] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.061056] ? sysfs_kf_write+0x65/0x160
[ 990.066249] ? sysfs_file_ops+0x140/0x140
[ 990.071547] kernfs_fop_write_iter+0x335/0x510
[ 990.077326] ? kernfs_ops+0xf0/0xf0
[ 990.082037] new_sync_write+0x333/0x750
[ 990.087140] ? __lock_acquire+0x508/0xc10
[ 990.092437] ? new_sync_read+0x740/0x740
[ 990.097636] ? lock_acquire.part.0+0xbc/0x260
[ 990.103324] ? ksys_write+0x116/0x250
[ 990.108235] vfs_write+0x657/0x9b0
[ 990.112854] ksys_write+0x116/0x250
[ 990.117565] ? __ia32_sys_read+0xc0/0xc0
[ 990.122762] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.128353] ? rcu_is_watching+0x15/0xd0
[ 990.133556] do_syscall_64+0xf3/0x650
[ 990.138461] ? irq_exit_rcu+0x1a/0x30
[ 990.143370] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.149826] RIP: 0033:0x7f3dca7e122e
[ 990.154637] RSP: 002b:00007ffef370d590 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.163937] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3dca7e122e
[ 990.172750] RDX: 0000000000000001 RSI: 000055fd84efca10 RDI: 0000000000000007
[ 990.181560] RBP: 00007ffef370d5a0 R08: 0000000000000000 R09: 0000000000000000
[ 990.190367] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3dca659390
[ 990.199178] R13: 000055fd84efca10 R14: 0000000000000007 R15: 0000000000000003
[ 990.207991]
[ 990.211253] \x0aShowing all locks held in the system:
[ 990.219792] 1 lock held by khungtaskd/186:
[ 990.225187] #0: ffffffffaeafdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.236672] 4 locks held by python3/3807:
[ 990.241968] #0: ff1100012ed593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.251861] #1: ff1100017032e280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.262822] #2: ff110001214b0b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.273979] #3: ff11000121541d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.284066] 4 locks held by python3/5889:
[ 990.289363] #0: ff1100012ed593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.299250] #1: ff110001e5595080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.310214] #2: ff110001214b0b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.321374] #3: ff11000121541d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.331464]
[ 990.333931] =============================================\x0a
[ 1112.541111] INFO: task python3:5889 blocked for more than 245 seconds.
[ 1112.549259] Not tainted 7.1.0-rc1-lsza-gcf963a5b1508 #1
[ 1112.556510] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.566101] task:python3 state:D stack:25672 pid:5889 tgid:5889 ppid:5888 task_flags:0x400100 flags:0x00080000
[ 1112.579307] Call Trace:
[ 1112.582846]
[ 1112.585996] __schedule+0xcba/0x1940
[ 1112.590811] ? io_schedule_timeout+0x140/0x140
[ 1112.596599] ? find_held_lock+0x2b/0x80
[ 1112.601703] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.607583] schedule+0xd4/0x260
[ 1112.612005] schedule_preempt_disabled+0x18/0x30
[ 1112.617985] __mutex_lock+0x6a3/0x2000
[ 1112.622991] ? threaded_store+0x132/0x220
[ 1112.628294] ? ww_mutex_lock+0x160/0x160
[ 1112.633493] ? selinux_inode_free_security+0x330/0x330
[ 1112.640061] ? cap_capable+0x1d6/0x3e0
[ 1112.645068] ? threaded_store+0x132/0x220
[ 1112.650366] threaded_store+0x132/0x220
[ 1112.655469] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.660768] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.666070] ? sysfs_kf_write+0x65/0x160
[ 1112.671271] ? sysfs_file_ops+0x140/0x140
[ 1112.676568] kernfs_fop_write_iter+0x335/0x510
[ 1112.682354] ? kernfs_ops+0xf0/0xf0
[ 1112.687067] new_sync_write+0x333/0x750
[ 1112.692173] ? __lock_acquire+0x508/0xc10
[ 1112.697472] ? new_sync_read+0x740/0x740
[ 1112.702673] ? lock_acquire.part.0+0xbc/0x260
[ 1112.708359] ? ksys_write+0x116/0x250
[ 1112.713269] vfs_write+0x657/0x9b0
[ 1112.717884] ksys_write+0x116/0x250
[ 1112.722598] ? __ia32_sys_read+0xc0/0xc0
[ 1112.727798] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.733387] ? rcu_is_watching+0x15/0xd0
[ 1112.738591] do_syscall_64+0xf3/0x650
[ 1112.743500] ? trace_hardirqs_off+0xd/0x30
[ 1112.748894] ? exc_page_fault+0xda/0xf0
[ 1112.753999] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.760466] RIP: 0033:0x7f9f0579622e
[ 1112.765276] RSP: 002b:00007ffe87669310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.774573] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9f0579622e
[ 1112.783380] RDX: 0000000000000001 RSI: 000055715138da10 RDI: 0000000000000007
[ 1112.792187] RBP: 00007ffe87669320 R08: 0000000000000000 R09: 0000000000000000
[ 1112.800996] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9f0560e390
[ 1112.809804] R13: 000055715138da10 R14: 0000000000000007 R15: 0000000000000003
[ 1112.818610]
[ 1112.821893] INFO: task python3:5889 is blocked on a mutex likely owned by task python3:3807.
[ 1112.832166] task:python3 state:D stack:25496 pid:3807 tgid:3807 ppid:3805 task_flags:0x400100 flags:0x00080802
[ 1112.845371] Call Trace:
[ 1112.848912]
[ 1112.852061] __schedule+0xcba/0x1940
[ 1112.856874] ? io_schedule_timeout+0x140/0x140
[ 1112.862658] ? find_held_lock+0x2b/0x80
[ 1112.867764] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.873945] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.879632] schedule+0xd4/0x260
[ 1112.884052] schedule_timeout+0x13f/0x290
[ 1112.889350] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.895721] ? trace_contention_end+0xb3/0x1a0
[ 1112.901508] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.907200] ? ww_mutex_lock+0x160/0x160
[ 1112.912401] msleep+0x1b/0x30
[ 1112.916526] napi_set_threaded+0x3a5/0x440
[ 1112.921922] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.927408] netif_set_threaded+0x257/0x400
[ 1112.932902] threaded_store+0x1b8/0x220
[ 1112.938002] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.943301] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.948597] ? sysfs_kf_write+0x65/0x160
[ 1112.953799] ? sysfs_file_ops+0x140/0x140
[ 1112.959094] kernfs_fop_write_iter+0x335/0x510
[ 1112.964879] ? kernfs_ops+0xf0/0xf0
[ 1112.969584] new_sync_write+0x333/0x750
[ 1112.974687] ? __lock_acquire+0x508/0xc10
[ 1112.979984] ? new_sync_read+0x740/0x740
[ 1112.985177] ? lock_acquire.part.0+0xbc/0x260
[ 1112.990864] ? ksys_write+0x116/0x250
[ 1112.995766] vfs_write+0x657/0x9b0
[ 1113.000382] ksys_write+0x116/0x250
[ 1113.005096] ? __ia32_sys_read+0xc0/0xc0
[ 1113.010296] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.015884] ? rcu_is_watching+0x15/0xd0
[ 1113.021087] do_syscall_64+0xf3/0x650
[ 1113.025995] ? irq_exit_rcu+0x1a/0x30
[ 1113.030904] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.037361] RIP: 0033:0x7f3dca7e122e
[ 1113.042169] RSP: 002b:00007ffef370d590 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.051464] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3dca7e122e
[ 1113.060273] RDX: 0000000000000001 RSI: 000055fd84efca10 RDI: 0000000000000007
[ 1113.069081] RBP: 00007ffef370d5a0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.077883] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3dca659390
[ 1113.086692] R13: 000055fd84efca10 R14: 0000000000000007 R15: 0000000000000003
[ 1113.095507]
[ 1113.098771] \x0aShowing all locks held in the system:
[ 1113.107310] 1 lock held by khungtaskd/186:
[ 1113.112705] #0: ffffffffaeafdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.124191] 4 locks held by python3/3807:
[ 1113.129488] #0: ff1100012ed593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.139379] #1: ff1100017032e280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.150339] #2: ff110001214b0b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.161495] #3: ff11000121541d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.171582] 4 locks held by python3/5889:
[ 1113.176878] #0: ff1100012ed593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.186769] #1: ff110001e5595080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.197732] #2: ff110001214b0b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.208889] #3: ff11000121541d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.218981]
[ 1113.221447] =============================================\x0a
[ 1235.422292] INFO: task python3:5889 blocked for more than 368 seconds.
[ 1235.430440] Not tainted 7.1.0-rc1-lsza-gcf963a5b1508 #1
[ 1235.437691] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.447280] task:python3 state:D stack:25672 pid:5889 tgid:5889 ppid:5888 task_flags:0x400100 flags:0x00080002
[ 1235.460484] Call Trace:
[ 1235.464023]
[ 1235.467172] __schedule+0xcba/0x1940
[ 1235.471986] ? io_schedule_timeout+0x140/0x140
[ 1235.477773] ? find_held_lock+0x2b/0x80
[ 1235.482877] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.488754] schedule+0xd4/0x260
[ 1235.493171] schedule_preempt_disabled+0x18/0x30
[ 1235.499149] __mutex_lock+0x6a3/0x2000
[ 1235.504152] ? threaded_store+0x132/0x220
[ 1235.509453] ? ww_mutex_lock+0x160/0x160
[ 1235.514650] ? selinux_inode_free_security+0x330/0x330
[ 1235.521220] ? cap_capable+0x1d6/0x3e0
[ 1235.526229] ? threaded_store+0x132/0x220
[ 1235.531526] threaded_store+0x132/0x220
[ 1235.536620] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.541917] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.547211] ? sysfs_kf_write+0x65/0x160
[ 1235.552411] ? sysfs_file_ops+0x140/0x140
[ 1235.557695] kernfs_fop_write_iter+0x335/0x510
[ 1235.563481] ? kernfs_ops+0xf0/0xf0
[ 1235.568191] new_sync_write+0x333/0x750
[ 1235.573294] ? __lock_acquire+0x508/0xc10
[ 1235.578588] ? new_sync_read+0x740/0x740
[ 1235.583789] ? lock_acquire.part.0+0xbc/0x260
[ 1235.589474] ? ksys_write+0x116/0x250
[ 1235.594382] vfs_write+0x657/0x9b0
[ 1235.598989] ksys_write+0x116/0x250
[ 1235.603700] ? __ia32_sys_read+0xc0/0xc0
[ 1235.608897] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.614484] ? rcu_is_watching+0x15/0xd0
[ 1235.619686] do_syscall_64+0xf3/0x650
[ 1235.624590] ? trace_hardirqs_off+0xd/0x30
[ 1235.629985] ? exc_page_fault+0xda/0xf0
[ 1235.635087] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.641547] RIP: 0033:0x7f9f0579622e
[ 1235.646355] RSP: 002b:00007ffe87669310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.655650] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9f0579622e
[ 1235.664457] RDX: 0000000000000001 RSI: 000055715138da10 RDI: 0000000000000007
[ 1235.673266] RBP: 00007ffe87669320 R08: 0000000000000000 R09: 0000000000000000
[ 1235.682074] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9f0560e390
[ 1235.690882] R13: 000055715138da10 R14: 0000000000000007 R15: 0000000000000003
[ 1235.699686]
[ 1235.702985] INFO: task python3:5889 is blocked on a mutex likely owned by task python3:3807.
[ 1235.713259] task:python3 state:D stack:25496 pid:3807 tgid:3807 ppid:3805 task_flags:0x400100 flags:0x00080802
[ 1235.726461] Call Trace:
[ 1235.729999]
[ 1235.733147] __schedule+0xcba/0x1940
[ 1235.737959] ? io_schedule_timeout+0x140/0x140
[ 1235.743744] ? find_held_lock+0x2b/0x80
[ 1235.748845] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.755022] schedule+0xd4/0x260
[ 1235.759440] schedule_timeout+0x13f/0x290
[ 1235.764735] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.771104] ? trace_contention_end+0xb3/0x1a0
[ 1235.776886] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.782576] ? ww_mutex_lock+0x160/0x160
[ 1235.787775] msleep+0x1b/0x30
[ 1235.791901] napi_set_threaded+0x3a5/0x440
[ 1235.797297] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.802788] netif_set_threaded+0x257/0x400
[ 1235.808282] threaded_store+0x1b8/0x220
[ 1235.813384] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.818680] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.823977] ? sysfs_kf_write+0x65/0x160
[ 1235.829174] ? sysfs_file_ops+0x140/0x140
[ 1235.834470] kernfs_fop_write_iter+0x335/0x510
[ 1235.840254] ? kernfs_ops+0xf0/0xf0
[ 1235.844962] new_sync_write+0x333/0x750
[ 1235.850062] ? __lock_acquire+0x508/0xc10
[ 1235.855356] ? new_sync_read+0x740/0x740
[ 1235.860555] ? lock_acquire.part.0+0xbc/0x260
[ 1235.866239] ? ksys_write+0x116/0x250
[ 1235.871149] vfs_write+0x657/0x9b0
[ 1235.875761] ksys_write+0x116/0x250
[ 1235.880470] ? __ia32_sys_read+0xc0/0xc0
[ 1235.885670] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.891249] ? rcu_is_watching+0x15/0xd0
[ 1235.896450] do_syscall_64+0xf3/0x650
[ 1235.901356] ? irq_exit_rcu+0x1a/0x30
[ 1235.906264] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.912731] RIP: 0033:0x7f3dca7e122e
[ 1235.917538] RSP: 002b:00007ffef370d590 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.926834] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3dca7e122e
[ 1235.935641] RDX: 0000000000000001 RSI: 000055fd84efca10 RDI: 0000000000000007
[ 1235.944447] RBP: 00007ffef370d5a0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.953256] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3dca659390
[ 1235.962059] R13: 000055fd84efca10 R14: 0000000000000007 R15: 0000000000000003
[ 1235.970871]
[ 1235.974141] \x0aShowing all locks held in the system:
[ 1235.982679] 1 lock held by khungtaskd/186:
[ 1235.988073] #0: ffffffffaeafdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1235.999555] 4 locks held by python3/3807:
[ 1236.004849] #0: ff1100012ed593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.014739] #1: ff1100017032e280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.025700] #2: ff110001214b0b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.036853] #3: ff11000121541d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.046951] 4 locks held by python3/5889:
[ 1236.052244] #0: ff1100012ed593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.062136] #1: ff110001e5595080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.073096] #2: ff110001214b0b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.084252] #3: ff11000121541d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.094346]
[ 1236.096810] =============================================\x0a
[ 1358.303438] INFO: task python3:5889 blocked for more than 491 seconds.
[ 1358.311587] Not tainted 7.1.0-rc1-lsza-gcf963a5b1508 #1
[ 1358.318836] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.328425] task:python3 state:D stack:25672 pid:5889 tgid:5889 ppid:5888 task_flags:0x400100 flags:0x00080002
[ 1358.341621] Call Trace:
[ 1358.345162]
[ 1358.348314] __schedule+0xcba/0x1940
[ 1358.353131] ? io_schedule_timeout+0x140/0x140
[ 1358.358919] ? find_held_lock+0x2b/0x80
[ 1358.364026] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.369914] schedule+0xd4/0x260
[ 1358.374332] schedule_preempt_disabled+0x18/0x30
[ 1358.380314] __mutex_lock+0x6a3/0x2000
[ 1358.385321] ? threaded_store+0x132/0x220
[ 1358.390624] ? ww_mutex_lock+0x160/0x160
[ 1358.395824] ? selinux_inode_free_security+0x330/0x330
[ 1358.402393] ? cap_capable+0x1d6/0x3e0
[ 1358.407402] ? threaded_store+0x132/0x220
[ 1358.412701] threaded_store+0x132/0x220
[ 1358.417805] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.423103] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.428404] ? sysfs_kf_write+0x65/0x160
[ 1358.433608] ? sysfs_file_ops+0x140/0x140
[ 1358.438905] kernfs_fop_write_iter+0x335/0x510
[ 1358.444684] ? kernfs_ops+0xf0/0xf0
[ 1358.449395] new_sync_write+0x333/0x750
[ 1358.454501] ? __lock_acquire+0x508/0xc10
[ 1358.459799] ? new_sync_read+0x740/0x740
[ 1358.465000] ? lock_acquire.part.0+0xbc/0x260
[ 1358.470686] ? ksys_write+0x116/0x250
[ 1358.475596] vfs_write+0x657/0x9b0
[ 1358.480212] ksys_write+0x116/0x250
[ 1358.484924] ? __ia32_sys_read+0xc0/0xc0
[ 1358.490117] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.495706] ? rcu_is_watching+0x15/0xd0
[ 1358.500912] do_syscall_64+0xf3/0x650
[ 1358.505820] ? trace_hardirqs_off+0xd/0x30
[ 1358.511216] ? exc_page_fault+0xda/0xf0
[ 1358.516321] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.522791] RIP: 0033:0x7f9f0579622e
[ 1358.527603] RSP: 002b:00007ffe87669310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.536903] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9f0579622e
[ 1358.545713] RDX: 0000000000000001 RSI: 000055715138da10 RDI: 0000000000000007
[ 1358.554520] RBP: 00007ffe87669320 R08: 0000000000000000 R09: 0000000000000000
[ 1358.563319] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9f0560e390
[ 1358.572126] R13: 000055715138da10 R14: 0000000000000007 R15: 0000000000000003
[ 1358.580938]
[ 1358.584210] INFO: task python3:5889 is blocked on a mutex likely owned by task python3:3807.
[ 1358.594485] task:python3 state:D stack:25496 pid:3807 tgid:3807 ppid:3805 task_flags:0x400100 flags:0x00080802
[ 1358.607689] Call Trace:
[ 1358.611227]
[ 1358.614379] __schedule+0xcba/0x1940
[ 1358.619191] ? io_schedule_timeout+0x140/0x140
[ 1358.624976] ? find_held_lock+0x2b/0x80
[ 1358.630072] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.636253] schedule+0xd4/0x260
[ 1358.640671] schedule_timeout+0x13f/0x290
[ 1358.645968] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.652336] ? trace_contention_end+0xb3/0x1a0
[ 1358.658120] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.663803] ? ww_mutex_lock+0x160/0x160
[ 1358.669002] msleep+0x1b/0x30
[ 1358.673130] napi_set_threaded+0x3a5/0x440
[ 1358.678528] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.684025] netif_set_threaded+0x257/0x400
[ 1358.689518] threaded_store+0x1b8/0x220
[ 1358.694620] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.699918] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.705208] ? sysfs_kf_write+0x65/0x160
[ 1358.710406] ? sysfs_file_ops+0x140/0x140
[ 1358.715704] kernfs_fop_write_iter+0x335/0x510
[ 1358.721490] ? kernfs_ops+0xf0/0xf0
[ 1358.726202] new_sync_write+0x333/0x750
[ 1358.731307] ? __lock_acquire+0x508/0xc10
[ 1358.736603] ? new_sync_read+0x740/0x740
[ 1358.741803] ? lock_acquire.part.0+0xbc/0x260
[ 1358.747481] ? ksys_write+0x116/0x250
[ 1358.752389] vfs_write+0x657/0x9b0
[ 1358.757005] ksys_write+0x116/0x250
[ 1358.761719] ? __ia32_sys_read+0xc0/0xc0
[ 1358.766917] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.772506] ? rcu_is_watching+0x15/0xd0
[ 1358.777708] do_syscall_64+0xf3/0x650
[ 1358.782615] ? irq_exit_rcu+0x1a/0x30
[ 1358.787514] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.793974] RIP: 0033:0x7f3dca7e122e
[ 1358.798784] RSP: 002b:00007ffef370d590 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.808083] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3dca7e122e
[ 1358.816892] RDX: 0000000000000001 RSI: 000055fd84efca10 RDI: 0000000000000007
[ 1358.825701] RBP: 00007ffef370d5a0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.834509] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3dca659390
[ 1358.843319] R13: 000055fd84efca10 R14: 0000000000000007 R15: 0000000000000003
[ 1358.852135]
[ 1358.855402] \x0aShowing all locks held in the system:
[ 1358.863938] 1 lock held by khungtaskd/186:
[ 1358.869331] #0: ffffffffaeafdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.880807] 1 lock held by systemd-journal/804:
[ 1358.886682] #0: ff1100180e3372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1358.896580] 4 locks held by python3/3807:
[ 1358.901877] #0: ff1100012ed593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.911767] #1: ff1100017032e280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.922732] #2: ff110001214b0b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.922741] #3: ff11000121541d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.922760] 4 locks held by python3/5889:
[ 1358.949301] #0: ff1100012ed593e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.959190] #1: ff110001e5595080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.970155] #2: ff110001214b0b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.981312] #3: ff11000121541d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.991400] 5 locks held by (systemd-user-)/7746:
[ 1358.997477] #0: ff1100012eff93e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.007366] #1: ff1100014cdcdc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.018326] #2: ffffffffaeb69c20 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1359.028987] #3: ffffffffae968970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x6b0
[ 1359.040624] #4: ffffffffaeb69990 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x6b0
[ 1359.053053]
[ 1359.055521] =============================================\x0a