[ 781.723000] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 781.725478] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 781.875487] kselftest: Running tests in drivers/net
[ 828.066727] block nvme0n1: No UUID available providing old NGUID
SUBSYSTEM=block
DEVICE=b259:0
[ 989.672847] INFO: task python3:5667 blocked for more than 122 seconds.
[ 989.681051] Not tainted 7.1.0-rc2-rsqx-g76b6f3c58902 #1
[ 989.688300] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.698238] task:python3 state:D stack:25320 pid:5667 tgid:5667 ppid:5666 task_flags:0x400100 flags:0x00080000
[ 989.711508] Call Trace:
[ 989.715046]
[ 989.718194] __schedule+0xcba/0x1940
[ 989.723013] ? io_schedule_timeout+0x140/0x140
[ 989.728799] ? find_held_lock+0x2b/0x80
[ 989.733902] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.739789] schedule+0xd4/0x260
[ 989.744210] schedule_preempt_disabled+0x18/0x30
[ 989.750187] __mutex_lock+0x6a3/0x2000
[ 989.755190] ? threaded_store+0x132/0x220
[ 989.760488] ? ww_mutex_lock+0x160/0x160
[ 989.765684] ? selinux_inode_free_security+0x330/0x330
[ 989.772252] ? cap_capable+0x1d6/0x3e0
[ 989.777258] ? threaded_store+0x132/0x220
[ 989.782555] threaded_store+0x132/0x220
[ 989.787657] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.792954] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.798242] ? sysfs_kf_write+0x65/0x160
[ 989.803440] ? sysfs_file_ops+0x140/0x140
[ 989.808732] kernfs_fop_write_iter+0x335/0x510
[ 989.814518] ? kernfs_ops+0xf0/0xf0
[ 989.819221] new_sync_write+0x333/0x750
[ 989.824323] ? __lock_acquire+0x508/0xc10
[ 989.829620] ? new_sync_read+0x740/0x740
[ 989.834820] ? lock_acquire.part.0+0xbc/0x260
[ 989.840495] ? ksys_write+0x116/0x250
[ 989.845405] vfs_write+0x657/0x9b0
[ 989.850019] ksys_write+0x116/0x250
[ 989.854729] ? __ia32_sys_read+0xc0/0xc0
[ 989.859925] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.865514] ? rcu_is_watching+0x15/0xd0
[ 989.870717] do_syscall_64+0xf3/0x650
[ 989.875620] ? trace_hardirqs_off+0xd/0x30
[ 989.881014] ? exc_page_fault+0xda/0xf0
[ 989.886113] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.892581] RIP: 0033:0x7f39fceb522e
[ 989.897388] RSP: 002b:00007ffef4d6cfd0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.906686] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f39fceb522e
[ 989.915495] RDX: 0000000000000001 RSI: 000055c9758e2fe0 RDI: 0000000000000007
[ 989.924302] RBP: 00007ffef4d6cfe0 R08: 0000000000000000 R09: 0000000000000000
[ 989.933102] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f39fcd2d390
[ 989.941910] R13: 000055c9758e2fe0 R14: 0000000000000007 R15: 0000000000000003
[ 989.950733]
[ 989.954022] INFO: task python3:5667 is blocked on a mutex likely owned by task python3:3622.
[ 989.964291] task:python3 state:D stack:25424 pid:3622 tgid:3622 ppid:3621 task_flags:0x400100 flags:0x00080802
[ 989.977492] Call Trace:
[ 989.981029]
[ 989.984178] __schedule+0xcba/0x1940
[ 989.988987] ? io_schedule_timeout+0x140/0x140
[ 989.994770] ? find_held_lock+0x2b/0x80
[ 989.999873] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.006049] schedule+0xd4/0x260
[ 990.010457] schedule_timeout+0x13f/0x290
[ 990.015752] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.022121] ? trace_contention_end+0xb3/0x1a0
[ 990.027906] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.033596] ? ww_mutex_lock+0x160/0x160
[ 990.038795] msleep+0x1b/0x30
[ 990.042919] napi_set_threaded+0x3a5/0x440
[ 990.048311] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.053803] netif_set_threaded+0x257/0x400
[ 990.059295] threaded_store+0x1b8/0x220
[ 990.064389] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.069686] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.074984] ? sysfs_kf_write+0x65/0x160
[ 990.080182] ? sysfs_file_ops+0x140/0x140
[ 990.085476] kernfs_fop_write_iter+0x335/0x510
[ 990.091261] ? kernfs_ops+0xf0/0xf0
[ 990.095964] new_sync_write+0x333/0x750
[ 990.101066] ? __lock_acquire+0x508/0xc10
[ 990.106355] ? new_sync_read+0x740/0x740
[ 990.111554] ? lock_acquire.part.0+0xbc/0x260
[ 990.117238] ? ksys_write+0x116/0x250
[ 990.122149] vfs_write+0x657/0x9b0
[ 990.126763] ksys_write+0x116/0x250
[ 990.131475] ? __ia32_sys_read+0xc0/0xc0
[ 990.136671] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.142261] ? rcu_is_watching+0x15/0xd0
[ 990.147451] do_syscall_64+0xf3/0x650
[ 990.152357] ? trace_hardirqs_off+0xd/0x30
[ 990.157752] ? exc_page_fault+0xda/0xf0
[ 990.162850] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.169314] RIP: 0033:0x7f403f66c22e
[ 990.174123] RSP: 002b:00007ffc39f58040 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.183421] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f403f66c22e
[ 990.192227] RDX: 0000000000000001 RSI: 0000557a430aafe0 RDI: 0000000000000007
[ 990.201033] RBP: 00007ffc39f58050 R08: 0000000000000000 R09: 0000000000000000
[ 990.209839] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f403f4e4390
[ 990.218646] R13: 0000557a430aafe0 R14: 0000000000000007 R15: 0000000000000003
[ 990.227451]
[ 990.230712] \x0aShowing all locks held in the system:
[ 990.239252] 1 lock held by khungtaskd/185:
[ 990.244643] #0: ffffffffa82fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.256125] 4 locks held by python3/3622:
[ 990.261420] #0: ff1100012f8343e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.271311] #1: ff11000164486e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.282273] #2: ff11000122d6ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.293428] #3: ff11000122db1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.303533] 4 locks held by python3/5667:
[ 990.308828] #0: ff1100012f8343e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.318715] #1: ff110001e3518880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.329674] #2: ff11000122d6ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.340837] #3: ff11000122db1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.350924]
[ 990.353388] =============================================\x0a
[ 1112.555162] INFO: task python3:5667 blocked for more than 245 seconds.
[ 1112.563315] Not tainted 7.1.0-rc2-rsqx-g76b6f3c58902 #1
[ 1112.570564] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.580142] task:python3 state:D stack:25320 pid:5667 tgid:5667 ppid:5666 task_flags:0x400100 flags:0x00080000
[ 1112.593348] Call Trace:
[ 1112.596887]
[ 1112.600038] __schedule+0xcba/0x1940
[ 1112.604855] ? io_schedule_timeout+0x140/0x140
[ 1112.610640] ? find_held_lock+0x2b/0x80
[ 1112.615744] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.621628] schedule+0xd4/0x260
[ 1112.626034] schedule_preempt_disabled+0x18/0x30
[ 1112.632010] __mutex_lock+0x6a3/0x2000
[ 1112.637014] ? threaded_store+0x132/0x220
[ 1112.642310] ? ww_mutex_lock+0x160/0x160
[ 1112.647508] ? selinux_inode_free_security+0x330/0x330
[ 1112.654077] ? cap_capable+0x1d6/0x3e0
[ 1112.659083] ? threaded_store+0x132/0x220
[ 1112.664369] threaded_store+0x132/0x220
[ 1112.669472] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.674762] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.680058] ? sysfs_kf_write+0x65/0x160
[ 1112.685259] ? sysfs_file_ops+0x140/0x140
[ 1112.690554] kernfs_fop_write_iter+0x335/0x510
[ 1112.696336] ? kernfs_ops+0xf0/0xf0
[ 1112.701047] new_sync_write+0x333/0x750
[ 1112.706142] ? __lock_acquire+0x508/0xc10
[ 1112.711438] ? new_sync_read+0x740/0x740
[ 1112.716640] ? lock_acquire.part.0+0xbc/0x260
[ 1112.722325] ? ksys_write+0x116/0x250
[ 1112.727233] vfs_write+0x657/0x9b0
[ 1112.731848] ksys_write+0x116/0x250
[ 1112.736561] ? __ia32_sys_read+0xc0/0xc0
[ 1112.741751] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.747338] ? rcu_is_watching+0x15/0xd0
[ 1112.752539] do_syscall_64+0xf3/0x650
[ 1112.757443] ? trace_hardirqs_off+0xd/0x30
[ 1112.762835] ? exc_page_fault+0xda/0xf0
[ 1112.767937] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.774402] RIP: 0033:0x7f39fceb522e
[ 1112.779213] RSP: 002b:00007ffef4d6cfd0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.788511] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f39fceb522e
[ 1112.797317] RDX: 0000000000000001 RSI: 000055c9758e2fe0 RDI: 0000000000000007
[ 1112.806123] RBP: 00007ffef4d6cfe0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.814931] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f39fcd2d390
[ 1112.823728] R13: 000055c9758e2fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.832542]
[ 1112.835827] INFO: task python3:5667 is blocked on a mutex likely owned by task python3:3622.
[ 1112.846098] task:python3 state:D stack:25424 pid:3622 tgid:3622 ppid:3621 task_flags:0x400100 flags:0x00080802
[ 1112.859297] Call Trace:
[ 1112.862834]
[ 1112.865983] __schedule+0xcba/0x1940
[ 1112.870793] ? io_schedule_timeout+0x140/0x140
[ 1112.876578] ? find_held_lock+0x2b/0x80
[ 1112.881672] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.887851] schedule+0xd4/0x260
[ 1112.892268] schedule_timeout+0x13f/0x290
[ 1112.897565] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.903931] ? trace_contention_end+0xb3/0x1a0
[ 1112.909713] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.915401] ? ww_mutex_lock+0x160/0x160
[ 1112.920592] msleep+0x1b/0x30
[ 1112.924716] napi_set_threaded+0x3a5/0x440
[ 1112.930111] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.935604] netif_set_threaded+0x257/0x400
[ 1112.941099] threaded_store+0x1b8/0x220
[ 1112.946200] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.951495] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.956791] ? sysfs_kf_write+0x65/0x160
[ 1112.961987] ? sysfs_file_ops+0x140/0x140
[ 1112.967281] kernfs_fop_write_iter+0x335/0x510
[ 1112.973066] ? kernfs_ops+0xf0/0xf0
[ 1112.977773] new_sync_write+0x333/0x750
[ 1112.982876] ? __lock_acquire+0x508/0xc10
[ 1112.988173] ? new_sync_read+0x740/0x740
[ 1112.993370] ? lock_acquire.part.0+0xbc/0x260
[ 1112.999054] ? ksys_write+0x116/0x250
[ 1113.003964] vfs_write+0x657/0x9b0
[ 1113.008579] ksys_write+0x116/0x250
[ 1113.013290] ? __ia32_sys_read+0xc0/0xc0
[ 1113.018490] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.024077] ? rcu_is_watching+0x15/0xd0
[ 1113.029277] do_syscall_64+0xf3/0x650
[ 1113.034173] ? trace_hardirqs_off+0xd/0x30
[ 1113.039564] ? exc_page_fault+0xda/0xf0
[ 1113.044662] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.051127] RIP: 0033:0x7f403f66c22e
[ 1113.055935] RSP: 002b:00007ffc39f58040 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.065228] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f403f66c22e
[ 1113.074034] RDX: 0000000000000001 RSI: 0000557a430aafe0 RDI: 0000000000000007
[ 1113.082842] RBP: 00007ffc39f58050 R08: 0000000000000000 R09: 0000000000000000
[ 1113.091649] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f403f4e4390
[ 1113.100455] R13: 0000557a430aafe0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.109267]
[ 1113.112528] \x0aShowing all locks held in the system:
[ 1113.121065] 1 lock held by khungtaskd/185:
[ 1113.126458] #0: ffffffffa82fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.137938] 4 locks held by python3/3622:
[ 1113.143232] #0: ff1100012f8343e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.153118] #1: ff11000164486e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.164077] #2: ff11000122d6ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.175230] #3: ff11000122db1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.185327] 4 locks held by python3/5667:
[ 1113.190619] #0: ff1100012f8343e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.200508] #1: ff110001e3518880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.211458] #2: ff11000122d6ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.222614] #3: ff11000122db1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.232702]
[ 1113.235169] =============================================\x0a
[ 1235.436446] INFO: task python3:5667 blocked for more than 368 seconds.
[ 1235.444595] Not tainted 7.1.0-rc2-rsqx-g76b6f3c58902 #1
[ 1235.451845] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.461434] task:python3 state:D stack:25320 pid:5667 tgid:5667 ppid:5666 task_flags:0x400100 flags:0x00080002
[ 1235.474631] Call Trace:
[ 1235.478167]
[ 1235.481319] __schedule+0xcba/0x1940
[ 1235.486136] ? io_schedule_timeout+0x140/0x140
[ 1235.491922] ? find_held_lock+0x2b/0x80
[ 1235.497027] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.502911] schedule+0xd4/0x260
[ 1235.507330] schedule_preempt_disabled+0x18/0x30
[ 1235.513307] __mutex_lock+0x6a3/0x2000
[ 1235.518312] ? threaded_store+0x132/0x220
[ 1235.523609] ? ww_mutex_lock+0x160/0x160
[ 1235.528806] ? selinux_inode_free_security+0x330/0x330
[ 1235.535374] ? cap_capable+0x1d6/0x3e0
[ 1235.540382] ? threaded_store+0x132/0x220
[ 1235.545677] threaded_store+0x132/0x220
[ 1235.550781] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.556077] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.561372] ? sysfs_kf_write+0x65/0x160
[ 1235.566573] ? sysfs_file_ops+0x140/0x140
[ 1235.571869] kernfs_fop_write_iter+0x335/0x510
[ 1235.577654] ? kernfs_ops+0xf0/0xf0
[ 1235.582364] new_sync_write+0x333/0x750
[ 1235.587460] ? __lock_acquire+0x508/0xc10
[ 1235.592746] ? new_sync_read+0x740/0x740
[ 1235.597948] ? lock_acquire.part.0+0xbc/0x260
[ 1235.603634] ? ksys_write+0x116/0x250
[ 1235.608543] vfs_write+0x657/0x9b0
[ 1235.613158] ksys_write+0x116/0x250
[ 1235.617861] ? __ia32_sys_read+0xc0/0xc0
[ 1235.623061] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.628646] ? rcu_is_watching+0x15/0xd0
[ 1235.633847] do_syscall_64+0xf3/0x650
[ 1235.638741] ? trace_hardirqs_off+0xd/0x30
[ 1235.644136] ? exc_page_fault+0xda/0xf0
[ 1235.649238] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.655694] RIP: 0033:0x7f39fceb522e
[ 1235.660501] RSP: 002b:00007ffef4d6cfd0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.669800] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f39fceb522e
[ 1235.678605] RDX: 0000000000000001 RSI: 000055c9758e2fe0 RDI: 0000000000000007
[ 1235.687410] RBP: 00007ffef4d6cfe0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.696217] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f39fcd2d390
[ 1235.705024] R13: 000055c9758e2fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.713835]
[ 1235.717148] INFO: task python3:5667 is blocked on a mutex likely owned by task python3:3622.
[ 1235.727422] task:python3 state:D stack:25424 pid:3622 tgid:3622 ppid:3621 task_flags:0x400100 flags:0x00080802
[ 1235.740625] Call Trace:
[ 1235.744163]
[ 1235.747310] __schedule+0xcba/0x1940
[ 1235.752123] ? io_schedule_timeout+0x140/0x140
[ 1235.757907] ? find_held_lock+0x2b/0x80
[ 1235.763009] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.769186] schedule+0xd4/0x260
[ 1235.773595] schedule_timeout+0x13f/0x290
[ 1235.778891] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.785261] ? trace_contention_end+0xb3/0x1a0
[ 1235.791043] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.796730] ? ww_mutex_lock+0x160/0x160
[ 1235.801929] msleep+0x1b/0x30
[ 1235.806051] napi_set_threaded+0x3a5/0x440
[ 1235.811446] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.816940] netif_set_threaded+0x257/0x400
[ 1235.822433] threaded_store+0x1b8/0x220
[ 1235.827534] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.832831] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.838126] ? sysfs_kf_write+0x65/0x160
[ 1235.843324] ? sysfs_file_ops+0x140/0x140
[ 1235.848617] kernfs_fop_write_iter+0x335/0x510
[ 1235.854399] ? kernfs_ops+0xf0/0xf0
[ 1235.859111] new_sync_write+0x333/0x750
[ 1235.864205] ? __lock_acquire+0x508/0xc10
[ 1235.869500] ? new_sync_read+0x740/0x740
[ 1235.874698] ? lock_acquire.part.0+0xbc/0x260
[ 1235.880385] ? ksys_write+0x116/0x250
[ 1235.885297] vfs_write+0x657/0x9b0
[ 1235.889911] ksys_write+0x116/0x250
[ 1235.894620] ? __ia32_sys_read+0xc0/0xc0
[ 1235.899820] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.905405] ? rcu_is_watching+0x15/0xd0
[ 1235.910605] do_syscall_64+0xf3/0x650
[ 1235.915509] ? trace_hardirqs_off+0xd/0x30
[ 1235.920901] ? exc_page_fault+0xda/0xf0
[ 1235.925999] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.932464] RIP: 0033:0x7f403f66c22e
[ 1235.937274] RSP: 002b:00007ffc39f58040 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.946569] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f403f66c22e
[ 1235.955377] RDX: 0000000000000001 RSI: 0000557a430aafe0 RDI: 0000000000000007
[ 1235.964184] RBP: 00007ffc39f58050 R08: 0000000000000000 R09: 0000000000000000
[ 1235.972986] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f403f4e4390
[ 1235.981793] R13: 0000557a430aafe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.990604]
[ 1235.993877] \x0aShowing all locks held in the system:
[ 1236.002418] 1 lock held by khungtaskd/185:
[ 1236.007812] #0: ffffffffa82fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.019305] 4 locks held by python3/3622:
[ 1236.024592] #0: ff1100012f8343e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.034482] #1: ff11000164486e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.045433] #2: ff11000122d6ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.056590] #3: ff11000122db1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.066682] 4 locks held by python3/5667:
[ 1236.071975] #0: ff1100012f8343e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.081863] #1: ff110001e3518880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.092824] #2: ff11000122d6ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.103981] #3: ff11000122db1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.114064]
[ 1236.116531] =============================================\x0a
[ 1358.317747] INFO: task python3:5667 blocked for more than 491 seconds.
[ 1358.325895] Not tainted 7.1.0-rc2-rsqx-g76b6f3c58902 #1
[ 1358.333145] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.342736] task:python3 state:D stack:25320 pid:5667 tgid:5667 ppid:5666 task_flags:0x400100 flags:0x00080002
[ 1358.355945] Call Trace:
[ 1358.359486]
[ 1358.362639] __schedule+0xcba/0x1940
[ 1358.367459] ? io_schedule_timeout+0x140/0x140
[ 1358.373245] ? find_held_lock+0x2b/0x80
[ 1358.378352] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.384237] schedule+0xd4/0x260
[ 1358.388656] schedule_preempt_disabled+0x18/0x30
[ 1358.394629] __mutex_lock+0x6a3/0x2000
[ 1358.399636] ? threaded_store+0x132/0x220
[ 1358.404937] ? ww_mutex_lock+0x160/0x160
[ 1358.410137] ? selinux_inode_free_security+0x330/0x330
[ 1358.416706] ? cap_capable+0x1d6/0x3e0
[ 1358.421713] ? threaded_store+0x132/0x220
[ 1358.427011] threaded_store+0x132/0x220
[ 1358.432106] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.437402] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.442692] ? sysfs_kf_write+0x65/0x160
[ 1358.447895] ? sysfs_file_ops+0x140/0x140
[ 1358.453193] kernfs_fop_write_iter+0x335/0x510
[ 1358.458976] ? kernfs_ops+0xf0/0xf0
[ 1358.463688] new_sync_write+0x333/0x750
[ 1358.468793] ? __lock_acquire+0x508/0xc10
[ 1358.474089] ? new_sync_read+0x740/0x740
[ 1358.479292] ? lock_acquire.part.0+0xbc/0x260
[ 1358.484977] ? ksys_write+0x116/0x250
[ 1358.489887] vfs_write+0x657/0x9b0
[ 1358.494503] ksys_write+0x116/0x250
[ 1358.499216] ? __ia32_sys_read+0xc0/0xc0
[ 1358.504414] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.510004] ? rcu_is_watching+0x15/0xd0
[ 1358.515209] do_syscall_64+0xf3/0x650
[ 1358.520118] ? trace_hardirqs_off+0xd/0x30
[ 1358.525514] ? exc_page_fault+0xda/0xf0
[ 1358.530615] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.537085] RIP: 0033:0x7f39fceb522e
[ 1358.541894] RSP: 002b:00007ffef4d6cfd0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.551195] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f39fceb522e
[ 1358.560005] RDX: 0000000000000001 RSI: 000055c9758e2fe0 RDI: 0000000000000007
[ 1358.568815] RBP: 00007ffef4d6cfe0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.577625] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f39fcd2d390
[ 1358.586436] R13: 000055c9758e2fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.595250]
[ 1358.598538] INFO: task python3:5667 is blocked on a mutex likely owned by task python3:3622.
[ 1358.608812] task:python3 state:D stack:25424 pid:3622 tgid:3622 ppid:3621 task_flags:0x400100 flags:0x00080802
[ 1358.622015] Call Trace:
[ 1358.625553]
[ 1358.628705] __schedule+0xcba/0x1940
[ 1358.633518] ? io_schedule_timeout+0x140/0x140
[ 1358.639306] ? find_held_lock+0x2b/0x80
[ 1358.644416] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.650601] schedule+0xd4/0x260
[ 1358.655020] schedule_timeout+0x13f/0x290
[ 1358.660318] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.666679] ? trace_contention_end+0xb3/0x1a0
[ 1358.672458] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.678148] ? ww_mutex_lock+0x160/0x160
[ 1358.683348] msleep+0x1b/0x30
[ 1358.687464] napi_set_threaded+0x3a5/0x440
[ 1358.692860] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.698352] netif_set_threaded+0x257/0x400
[ 1358.703843] threaded_store+0x1b8/0x220
[ 1358.708947] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.714242] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.719540] ? sysfs_kf_write+0x65/0x160
[ 1358.724736] ? sysfs_file_ops+0x140/0x140
[ 1358.730031] kernfs_fop_write_iter+0x335/0x510
[ 1358.735816] ? kernfs_ops+0xf0/0xf0
[ 1358.740528] new_sync_write+0x333/0x750
[ 1358.745631] ? __lock_acquire+0x508/0xc10
[ 1358.750929] ? new_sync_read+0x740/0x740
[ 1358.756129] ? lock_acquire.part.0+0xbc/0x260
[ 1358.761815] ? ksys_write+0x116/0x250
[ 1358.766725] vfs_write+0x657/0x9b0
[ 1358.771409] ksys_write+0x116/0x250
[ 1358.776114] ? __ia32_sys_read+0xc0/0xc0
[ 1358.781313] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.786899] ? rcu_is_watching+0x15/0xd0
[ 1358.792099] do_syscall_64+0xf3/0x650
[ 1358.797007] ? trace_hardirqs_off+0xd/0x30
[ 1358.802403] ? exc_page_fault+0xda/0xf0
[ 1358.807498] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.813964] RIP: 0033:0x7f403f66c22e
[ 1358.818772] RSP: 002b:00007ffc39f58040 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.828068] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f403f66c22e
[ 1358.836874] RDX: 0000000000000001 RSI: 0000557a430aafe0 RDI: 0000000000000007
[ 1358.845749] RBP: 00007ffc39f58050 R08: 0000000000000000 R09: 0000000000000000
[ 1358.854555] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f403f4e4390
[ 1358.863365] R13: 0000557a430aafe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.872179]
[ 1358.875452] \x0aShowing all locks held in the system:
[ 1358.883972] 1 lock held by systemd/1:
[ 1358.888897] 1 lock held by khungtaskd/185:
[ 1358.894294] #0: ffffffffa82fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.905774] 3 locks held by systemd-journal/801:
[ 1358.911754] #0: ff1100180dbb72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1358.921642] #1: ffffffffa85032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.934458] #2: ff110001a83ec650 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1358.946015] 4 locks held by python3/3622:
[ 1358.951312] #0: ff1100012f8343e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.961204] #1: ff11000164486e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.972165] #2: ff11000122d6ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.983314] #3: ff11000122db1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.993417] 4 locks held by python3/5667:
[ 1358.998714] #0: ff1100012f8343e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.008607] #1: ff110001e3518880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.019569] #2: ff11000122d6ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.030724] #3: ff11000122db1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.040815] 5 locks held by (systemd-user-)/7555:
[ 1359.046891] #0: ff1100012fa243e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.056781] #1: ff110001e968ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.067743] #2: ffffffffa8369ce0 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1359.078412] #3: ffffffffa8168970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650
[ 1359.090055] #4: ffffffffa8369a50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650
[ 1359.102481]
[ 1359.104949] =============================================\x0a