[ 783.758973] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 783.761360] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 783.916666] kselftest: Running tests in drivers/net
[ 976.621194] block nvme0n1: No UUID available providing old NGUID
SUBSYSTEM=block
DEVICE=b259:0
[ 989.651044] INFO: task python3:5730 blocked for more than 122 seconds.
[ 989.659250] Not tainted 7.1.0-rc2-bkbx-ga48c19c0d655 #1
[ 989.666916] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.676507] task:python3 state:D stack:25512 pid:5730 tgid:5730 ppid:5729 task_flags:0x400100 flags:0x00080000
[ 989.689713] Call Trace:
[ 989.693251]
[ 989.696405] __schedule+0xcba/0x1940
[ 989.701215] ? io_schedule_timeout+0x140/0x140
[ 989.707001] ? find_held_lock+0x2b/0x80
[ 989.712106] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.717993] schedule+0xd4/0x260
[ 989.722411] schedule_preempt_disabled+0x18/0x30
[ 989.728391] __mutex_lock+0x6a3/0x2000
[ 989.733396] ? threaded_store+0x132/0x220
[ 989.738697] ? ww_mutex_lock+0x160/0x160
[ 989.743898] ? selinux_inode_free_security+0x330/0x330
[ 989.750471] ? cap_capable+0x1d6/0x3e0
[ 989.755485] ? threaded_store+0x132/0x220
[ 989.760782] threaded_store+0x132/0x220
[ 989.765883] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.771178] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.776467] ? sysfs_kf_write+0x65/0x160
[ 989.781667] ? sysfs_file_ops+0x140/0x140
[ 989.786956] kernfs_fop_write_iter+0x335/0x510
[ 989.792741] ? kernfs_ops+0xf0/0xf0
[ 989.797451] new_sync_write+0x333/0x750
[ 989.802554] ? __lock_acquire+0x508/0xc10
[ 989.807844] ? new_sync_read+0x740/0x740
[ 989.813045] ? lock_acquire.part.0+0xbc/0x260
[ 989.818730] ? ksys_write+0x116/0x250
[ 989.823642] vfs_write+0x657/0x9b0
[ 989.828256] ksys_write+0x116/0x250
[ 989.832967] ? __ia32_sys_read+0xc0/0xc0
[ 989.838167] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.843756] ? rcu_is_watching+0x15/0xd0
[ 989.848959] do_syscall_64+0xf3/0x650
[ 989.853871] ? trace_hardirqs_off+0xd/0x30
[ 989.859266] ? exc_page_fault+0xda/0xf0
[ 989.864368] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.870828] RIP: 0033:0x7efe303c022e
[ 989.875638] RSP: 002b:00007ffcf5d26270 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.884926] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efe303c022e
[ 989.893729] RDX: 0000000000000001 RSI: 0000561e4877dfe0 RDI: 0000000000000007
[ 989.902537] RBP: 00007ffcf5d26280 R08: 0000000000000000 R09: 0000000000000000
[ 989.911347] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efe30238390
[ 989.920155] R13: 0000561e4877dfe0 R14: 0000000000000007 R15: 0000000000000003
[ 989.929003]
[ 989.932317] INFO: task python3:5730 is blocked on a mutex likely owned by task python3:3665.
[ 989.942591] task:python3 state:D stack:25672 pid:3665 tgid:3665 ppid:3664 task_flags:0x400100 flags:0x00080802
[ 989.955789] Call Trace:
[ 989.959326]
[ 989.962478] __schedule+0xcba/0x1940
[ 989.967294] ? io_schedule_timeout+0x140/0x140
[ 989.973081] ? find_held_lock+0x2b/0x80
[ 989.978184] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.984364] schedule+0xd4/0x260
[ 989.988783] schedule_timeout+0x13f/0x290
[ 989.994071] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.000440] ? trace_contention_end+0xb3/0x1a0
[ 990.006228] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.011921] ? ww_mutex_lock+0x160/0x160
[ 990.017121] msleep+0x1b/0x30
[ 990.021237] napi_set_threaded+0x3a5/0x440
[ 990.026635] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.032130] netif_set_threaded+0x257/0x400
[ 990.037622] threaded_store+0x1b8/0x220
[ 990.042723] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.048023] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.053320] ? sysfs_kf_write+0x65/0x160
[ 990.058518] ? sysfs_file_ops+0x140/0x140
[ 990.063816] kernfs_fop_write_iter+0x335/0x510
[ 990.069602] ? kernfs_ops+0xf0/0xf0
[ 990.074315] new_sync_write+0x333/0x750
[ 990.079418] ? __lock_acquire+0x508/0xc10
[ 990.084717] ? new_sync_read+0x740/0x740
[ 990.089918] ? lock_acquire.part.0+0xbc/0x260
[ 990.095606] ? ksys_write+0x116/0x250
[ 990.100516] vfs_write+0x657/0x9b0
[ 990.105131] ksys_write+0x116/0x250
[ 990.109842] ? __ia32_sys_read+0xc0/0xc0
[ 990.115042] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.120631] ? rcu_is_watching+0x15/0xd0
[ 990.125831] do_syscall_64+0xf3/0x650
[ 990.130728] ? irq_exit_rcu+0x1a/0x30
[ 990.135639] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.142104] RIP: 0033:0x7fee6d5c322e
[ 990.146912] RSP: 002b:00007ffc248466d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.156212] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fee6d5c322e
[ 990.165020] RDX: 0000000000000001 RSI: 000055fef21e4fe0 RDI: 0000000000000007
[ 990.173829] RBP: 00007ffc248466e0 R08: 0000000000000000 R09: 0000000000000000
[ 990.182654] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fee6d43b390
[ 990.191466] R13: 000055fef21e4fe0 R14: 0000000000000007 R15: 0000000000000003
[ 990.200282]
[ 990.203547] \x0aShowing all locks held in the system:
[ 990.212090] 1 lock held by khungtaskd/185:
[ 990.217485] #0: ffffffffb98fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.228976] 4 locks held by python3/3665:
[ 990.234273] #0: ff1100012faf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.244156] #1: ff11000169bc2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.255119] #2: ff1100012262cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.266275] #3: ff11000122669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.276375] 4 locks held by python3/5730:
[ 990.281664] #0: ff1100012faf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.291554] #1: ff110001ec9aac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.302516] #2: ff1100012262cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.313673] #3: ff11000122669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.323757]
[ 990.326225] =============================================\x0a
[ 1112.532457] INFO: task python3:5730 blocked for more than 245 seconds.
[ 1112.540610] Not tainted 7.1.0-rc2-bkbx-ga48c19c0d655 #1
[ 1112.547859] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.557448] task:python3 state:D stack:25512 pid:5730 tgid:5730 ppid:5729 task_flags:0x400100 flags:0x00080000
[ 1112.570654] Call Trace:
[ 1112.574193]
[ 1112.577345] __schedule+0xcba/0x1940
[ 1112.582161] ? io_schedule_timeout+0x140/0x140
[ 1112.587946] ? find_held_lock+0x2b/0x80
[ 1112.593051] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.598935] schedule+0xd4/0x260
[ 1112.603345] schedule_preempt_disabled+0x18/0x30
[ 1112.609321] __mutex_lock+0x6a3/0x2000
[ 1112.614324] ? threaded_store+0x132/0x220
[ 1112.619623] ? ww_mutex_lock+0x160/0x160
[ 1112.624820] ? selinux_inode_free_security+0x330/0x330
[ 1112.631389] ? cap_capable+0x1d6/0x3e0
[ 1112.636395] ? threaded_store+0x132/0x220
[ 1112.641690] threaded_store+0x132/0x220
[ 1112.646793] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.652079] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.657378] ? sysfs_kf_write+0x65/0x160
[ 1112.662580] ? sysfs_file_ops+0x140/0x140
[ 1112.667876] kernfs_fop_write_iter+0x335/0x510
[ 1112.673662] ? kernfs_ops+0xf0/0xf0
[ 1112.678363] new_sync_write+0x333/0x750
[ 1112.683467] ? __lock_acquire+0x508/0xc10
[ 1112.688762] ? new_sync_read+0x740/0x740
[ 1112.693963] ? lock_acquire.part.0+0xbc/0x260
[ 1112.699648] ? ksys_write+0x116/0x250
[ 1112.704557] vfs_write+0x657/0x9b0
[ 1112.709171] ksys_write+0x116/0x250
[ 1112.713875] ? __ia32_sys_read+0xc0/0xc0
[ 1112.719070] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.724656] ? rcu_is_watching+0x15/0xd0
[ 1112.729857] do_syscall_64+0xf3/0x650
[ 1112.734760] ? trace_hardirqs_off+0xd/0x30
[ 1112.740152] ? exc_page_fault+0xda/0xf0
[ 1112.745254] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.751709] RIP: 0033:0x7efe303c022e
[ 1112.756516] RSP: 002b:00007ffcf5d26270 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.765814] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efe303c022e
[ 1112.774619] RDX: 0000000000000001 RSI: 0000561e4877dfe0 RDI: 0000000000000007
[ 1112.783425] RBP: 00007ffcf5d26280 R08: 0000000000000000 R09: 0000000000000000
[ 1112.792231] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efe30238390
[ 1112.801038] R13: 0000561e4877dfe0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.809849]
[ 1112.813133] INFO: task python3:5730 is blocked on a mutex likely owned by task python3:3665.
[ 1112.823406] task:python3 state:D stack:25672 pid:3665 tgid:3665 ppid:3664 task_flags:0x400100 flags:0x00080802
[ 1112.836605] Call Trace:
[ 1112.840142]
[ 1112.843293] __schedule+0xcba/0x1940
[ 1112.848096] ? io_schedule_timeout+0x140/0x140
[ 1112.853881] ? find_held_lock+0x2b/0x80
[ 1112.858973] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.865152] schedule+0xd4/0x260
[ 1112.869571] schedule_timeout+0x13f/0x290
[ 1112.874867] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.881237] ? trace_contention_end+0xb3/0x1a0
[ 1112.887010] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.892699] ? ww_mutex_lock+0x160/0x160
[ 1112.897886] msleep+0x1b/0x30
[ 1112.902013] napi_set_threaded+0x3a5/0x440
[ 1112.907399] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.912894] netif_set_threaded+0x257/0x400
[ 1112.918385] threaded_store+0x1b8/0x220
[ 1112.923487] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.928781] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.934076] ? sysfs_kf_write+0x65/0x160
[ 1112.939273] ? sysfs_file_ops+0x140/0x140
[ 1112.944567] kernfs_fop_write_iter+0x335/0x510
[ 1112.950351] ? kernfs_ops+0xf0/0xf0
[ 1112.955059] new_sync_write+0x333/0x750
[ 1112.960159] ? __lock_acquire+0x508/0xc10
[ 1112.965456] ? new_sync_read+0x740/0x740
[ 1112.970655] ? lock_acquire.part.0+0xbc/0x260
[ 1112.976330] ? ksys_write+0x116/0x250
[ 1112.981237] vfs_write+0x657/0x9b0
[ 1112.985849] ksys_write+0x116/0x250
[ 1112.990559] ? __ia32_sys_read+0xc0/0xc0
[ 1112.995759] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.001348] ? rcu_is_watching+0x15/0xd0
[ 1113.006547] do_syscall_64+0xf3/0x650
[ 1113.011453] ? irq_exit_rcu+0x1a/0x30
[ 1113.016360] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.022827] RIP: 0033:0x7fee6d5c322e
[ 1113.027631] RSP: 002b:00007ffc248466d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.036925] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fee6d5c322e
[ 1113.045729] RDX: 0000000000000001 RSI: 000055fef21e4fe0 RDI: 0000000000000007
[ 1113.054537] RBP: 00007ffc248466e0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.063337] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fee6d43b390
[ 1113.072145] R13: 000055fef21e4fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.080956]
[ 1113.084219] \x0aShowing all locks held in the system:
[ 1113.092757] 1 lock held by khungtaskd/185:
[ 1113.098148] #0: ffffffffb98fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.109620] 2 locks held by systemd-journal/803:
[ 1113.115599] #0: ff1100180e8372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1113.125487] #1: ff110001a229e378 (&mm->mmap_lock){++++}-{4:4}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.136254] 4 locks held by python3/3665:
[ 1113.141546] #0: ff1100012faf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.151433] #1: ff11000169bc2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.162395] #2: ff1100012262cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.173544] #3: ff11000122669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.183637] 4 locks held by python3/5730:
[ 1113.188933] #0: ff1100012faf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.198822] #1: ff110001ec9aac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.209783] #2: ff1100012262cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.220939] #3: ff11000122669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.231027]
[ 1113.233490] =============================================\x0a
[ 1235.413861] INFO: task python3:5730 blocked for more than 368 seconds.
[ 1235.422009] Not tainted 7.1.0-rc2-bkbx-ga48c19c0d655 #1
[ 1235.429260] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.438850] task:python3 state:D stack:25512 pid:5730 tgid:5730 ppid:5729 task_flags:0x400100 flags:0x00080002
[ 1235.452057] Call Trace:
[ 1235.455598]
[ 1235.458750] __schedule+0xcba/0x1940
[ 1235.463567] ? io_schedule_timeout+0x140/0x140
[ 1235.469353] ? find_held_lock+0x2b/0x80
[ 1235.474460] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.480345] schedule+0xd4/0x260
[ 1235.484766] schedule_preempt_disabled+0x18/0x30
[ 1235.490748] __mutex_lock+0x6a3/0x2000
[ 1235.495755] ? threaded_store+0x132/0x220
[ 1235.501053] ? ww_mutex_lock+0x160/0x160
[ 1235.506253] ? selinux_inode_free_security+0x330/0x330
[ 1235.512823] ? cap_capable+0x1d6/0x3e0
[ 1235.517833] ? threaded_store+0x132/0x220
[ 1235.523132] threaded_store+0x132/0x220
[ 1235.528235] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.533532] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.538833] ? sysfs_kf_write+0x65/0x160
[ 1235.544033] ? sysfs_file_ops+0x140/0x140
[ 1235.549328] kernfs_fop_write_iter+0x335/0x510
[ 1235.555113] ? kernfs_ops+0xf0/0xf0
[ 1235.559825] new_sync_write+0x333/0x750
[ 1235.564929] ? __lock_acquire+0x508/0xc10
[ 1235.570228] ? new_sync_read+0x740/0x740
[ 1235.575431] ? lock_acquire.part.0+0xbc/0x260
[ 1235.581117] ? ksys_write+0x116/0x250
[ 1235.586026] vfs_write+0x657/0x9b0
[ 1235.590643] ksys_write+0x116/0x250
[ 1235.595354] ? __ia32_sys_read+0xc0/0xc0
[ 1235.600554] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.606135] ? rcu_is_watching+0x15/0xd0
[ 1235.611336] do_syscall_64+0xf3/0x650
[ 1235.616242] ? trace_hardirqs_off+0xd/0x30
[ 1235.621638] ? exc_page_fault+0xda/0xf0
[ 1235.626738] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.633208] RIP: 0033:0x7efe303c022e
[ 1235.638019] RSP: 002b:00007ffcf5d26270 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.647317] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efe303c022e
[ 1235.656127] RDX: 0000000000000001 RSI: 0000561e4877dfe0 RDI: 0000000000000007
[ 1235.664936] RBP: 00007ffcf5d26280 R08: 0000000000000000 R09: 0000000000000000
[ 1235.673745] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efe30238390
[ 1235.682556] R13: 0000561e4877dfe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.691368]
[ 1235.694639] INFO: task python3:5730 is blocked on a mutex likely owned by task python3:3665.
[ 1235.704911] task:python3 state:D stack:25672 pid:3665 tgid:3665 ppid:3664 task_flags:0x400100 flags:0x00080802
[ 1235.718115] Call Trace:
[ 1235.721652]
[ 1235.724801] __schedule+0xcba/0x1940
[ 1235.729614] ? io_schedule_timeout+0x140/0x140
[ 1235.735398] ? find_held_lock+0x2b/0x80
[ 1235.740501] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.746677] schedule+0xd4/0x260
[ 1235.751096] schedule_timeout+0x13f/0x290
[ 1235.756392] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.762761] ? trace_contention_end+0xb3/0x1a0
[ 1235.768549] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.774239] ? ww_mutex_lock+0x160/0x160
[ 1235.779440] msleep+0x1b/0x30
[ 1235.783564] napi_set_threaded+0x3a5/0x440
[ 1235.788964] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.794457] netif_set_threaded+0x257/0x400
[ 1235.799940] threaded_store+0x1b8/0x220
[ 1235.805044] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.810341] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.815639] ? sysfs_kf_write+0x65/0x160
[ 1235.820838] ? sysfs_file_ops+0x140/0x140
[ 1235.826134] kernfs_fop_write_iter+0x335/0x510
[ 1235.831920] ? kernfs_ops+0xf0/0xf0
[ 1235.836631] new_sync_write+0x333/0x750
[ 1235.841734] ? __lock_acquire+0x508/0xc10
[ 1235.847030] ? new_sync_read+0x740/0x740
[ 1235.852230] ? lock_acquire.part.0+0xbc/0x260
[ 1235.857916] ? ksys_write+0x116/0x250
[ 1235.862828] vfs_write+0x657/0x9b0
[ 1235.867444] ksys_write+0x116/0x250
[ 1235.872158] ? __ia32_sys_read+0xc0/0xc0
[ 1235.877358] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.882949] ? rcu_is_watching+0x15/0xd0
[ 1235.888150] do_syscall_64+0xf3/0x650
[ 1235.893056] ? irq_exit_rcu+0x1a/0x30
[ 1235.897965] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.904433] RIP: 0033:0x7fee6d5c322e
[ 1235.909240] RSP: 002b:00007ffc248466d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.918538] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fee6d5c322e
[ 1235.927347] RDX: 0000000000000001 RSI: 000055fef21e4fe0 RDI: 0000000000000007
[ 1235.936157] RBP: 00007ffc248466e0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.944964] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fee6d43b390
[ 1235.953765] R13: 000055fef21e4fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.962580]
[ 1235.965849] \x0aShowing all locks held in the system:
[ 1235.974387] 1 lock held by khungtaskd/185:
[ 1235.979783] #0: ffffffffb98fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1235.991264] 4 locks held by python3/3665:
[ 1235.996561] #0: ff1100012faf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.006453] #1: ff11000169bc2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.017416] #2: ff1100012262cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.028575] #3: ff11000122669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.038670] 4 locks held by python3/5730:
[ 1236.043965] #0: ff1100012faf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.053855] #1: ff110001ec9aac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.064819] #2: ff1100012262cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.075977] #3: ff11000122669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.086071]
[ 1236.088538] =============================================\x0a
[ 1358.295262] INFO: task python3:5730 blocked for more than 491 seconds.
[ 1358.303407] Not tainted 7.1.0-rc2-bkbx-ga48c19c0d655 #1
[ 1358.310650] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.320239] task:python3 state:D stack:25512 pid:5730 tgid:5730 ppid:5729 task_flags:0x400100 flags:0x00080002
[ 1358.333442] Call Trace:
[ 1358.336982]
[ 1358.340135] __schedule+0xcba/0x1940
[ 1358.344954] ? io_schedule_timeout+0x140/0x140
[ 1358.350741] ? find_held_lock+0x2b/0x80
[ 1358.355846] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.361731] schedule+0xd4/0x260
[ 1358.366149] schedule_preempt_disabled+0x18/0x30
[ 1358.372124] __mutex_lock+0x6a3/0x2000
[ 1358.377126] ? threaded_store+0x132/0x220
[ 1358.382423] ? ww_mutex_lock+0x160/0x160
[ 1358.387623] ? selinux_inode_free_security+0x330/0x330
[ 1358.394194] ? cap_capable+0x1d6/0x3e0
[ 1358.399205] ? threaded_store+0x132/0x220
[ 1358.404503] threaded_store+0x132/0x220
[ 1358.409604] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.414904] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.420206] ? sysfs_kf_write+0x65/0x160
[ 1358.425409] ? sysfs_file_ops+0x140/0x140
[ 1358.430705] kernfs_fop_write_iter+0x335/0x510
[ 1358.436490] ? kernfs_ops+0xf0/0xf0
[ 1358.441204] new_sync_write+0x333/0x750
[ 1358.446309] ? __lock_acquire+0x508/0xc10
[ 1358.451607] ? new_sync_read+0x740/0x740
[ 1358.456809] ? lock_acquire.part.0+0xbc/0x260
[ 1358.462495] ? ksys_write+0x116/0x250
[ 1358.467405] vfs_write+0x657/0x9b0
[ 1358.472021] ksys_write+0x116/0x250
[ 1358.476734] ? __ia32_sys_read+0xc0/0xc0
[ 1358.481932] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.487522] ? rcu_is_watching+0x15/0xd0
[ 1358.492725] do_syscall_64+0xf3/0x650
[ 1358.497634] ? trace_hardirqs_off+0xd/0x30
[ 1358.503028] ? exc_page_fault+0xda/0xf0
[ 1358.508132] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.514604] RIP: 0033:0x7efe303c022e
[ 1358.519414] RSP: 002b:00007ffcf5d26270 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.528714] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007efe303c022e
[ 1358.537524] RDX: 0000000000000001 RSI: 0000561e4877dfe0 RDI: 0000000000000007
[ 1358.546334] RBP: 00007ffcf5d26280 R08: 0000000000000000 R09: 0000000000000000
[ 1358.555144] R10: 0000000000000000 R11: 0000000000000202 R12: 00007efe30238390
[ 1358.563956] R13: 0000561e4877dfe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.572773]
[ 1358.576063] INFO: task python3:5730 is blocked on a mutex likely owned by task python3:3665.
[ 1358.586334] task:python3 state:D stack:25672 pid:3665 tgid:3665 ppid:3664 task_flags:0x400100 flags:0x00080802
[ 1358.599540] Call Trace:
[ 1358.599542]
[ 1358.599545] __schedule+0xcba/0x1940
[ 1358.599551] ? io_schedule_timeout+0x140/0x140
[ 1358.599554] ? find_held_lock+0x2b/0x80
[ 1358.599558] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.599565] schedule+0xd4/0x260
[ 1358.632573] schedule_timeout+0x13f/0x290
[ 1358.637872] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.644245] ? trace_contention_end+0xb3/0x1a0
[ 1358.650031] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.655721] ? ww_mutex_lock+0x160/0x160
[ 1358.660923] msleep+0x1b/0x30
[ 1358.665050] napi_set_threaded+0x3a5/0x440
[ 1358.670446] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.675943] netif_set_threaded+0x257/0x400
[ 1358.681438] threaded_store+0x1b8/0x220
[ 1358.686540] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.691839] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.697135] ? sysfs_kf_write+0x65/0x160
[ 1358.702337] ? sysfs_file_ops+0x140/0x140
[ 1358.707631] kernfs_fop_write_iter+0x335/0x510
[ 1358.713415] ? kernfs_ops+0xf0/0xf0
[ 1358.718125] new_sync_write+0x333/0x750
[ 1358.723229] ? __lock_acquire+0x508/0xc10
[ 1358.728527] ? new_sync_read+0x740/0x740
[ 1358.733717] ? lock_acquire.part.0+0xbc/0x260
[ 1358.739405] ? ksys_write+0x116/0x250
[ 1358.744314] vfs_write+0x657/0x9b0
[ 1358.748929] ksys_write+0x116/0x250
[ 1358.753635] ? __ia32_sys_read+0xc0/0xc0
[ 1358.758833] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.764421] ? rcu_is_watching+0x15/0xd0
[ 1358.769622] do_syscall_64+0xf3/0x650
[ 1358.774528] ? irq_exit_rcu+0x1a/0x30
[ 1358.779426] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.785892] RIP: 0033:0x7fee6d5c322e
[ 1358.790699] RSP: 002b:00007ffc248466d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.799995] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fee6d5c322e
[ 1358.808795] RDX: 0000000000000001 RSI: 000055fef21e4fe0 RDI: 0000000000000007
[ 1358.817604] RBP: 00007ffc248466e0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.826412] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fee6d43b390
[ 1358.835221] R13: 000055fef21e4fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.844036]
[ 1358.847309] \x0aShowing all locks held in the system:
[ 1358.855849] 1 lock held by khungtaskd/185:
[ 1358.861244] #0: ffffffffb98fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.872728] 4 locks held by python3/3665:
[ 1358.878013] #0: ff1100012faf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.887901] #1: ff11000169bc2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.898863] #2: ff1100012262cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.910020] #3: ff11000122669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.920111] 4 locks held by python3/5730:
[ 1358.925403] #0: ff1100012faf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.935291] #1: ff110001ec9aac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.946251] #2: ff1100012262cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.957409] #3: ff11000122669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.967492] 5 locks held by (systemd-user-)/7614:
[ 1358.973568] #0: ff1100012fd4c3e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.983458] #1: ff11000154fb9480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.994419] #2: ffffffffb9969ce0 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1359.005082] #3: ffffffffb9768970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650
[ 1359.016726] #4: ffffffffb9969a50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650
[ 1359.029145]
[ 1359.031610] =============================================\x0a