[ 793.587245] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 793.589696] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 793.718177] kselftest: Running tests in drivers/net
[ 989.694771] INFO: task python3:5870 blocked for more than 122 seconds.
[ 989.703005] Not tainted 7.1.0-rc4-feqy-g6c6104c235d1 #1
[ 989.710893] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.720491] task:python3 state:D stack:25184 pid:5870 tgid:5870 ppid:5869 task_flags:0x400100 flags:0x00080000
[ 989.733704] Call Trace:
[ 989.737245]
[ 989.740390] __schedule+0xcc3/0x19c0
[ 989.745215] ? io_schedule_timeout+0x140/0x140
[ 989.751002] ? find_held_lock+0x2b/0x80
[ 989.756113] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.762003] schedule+0xd8/0x260
[ 989.766425] schedule_preempt_disabled+0x18/0x30
[ 989.772406] __mutex_lock+0x6af/0x2010
[ 989.777414] ? threaded_store+0x132/0x220
[ 989.782716] ? ww_mutex_lock+0x160/0x160
[ 989.787921] ? selinux_inode_free_security+0x330/0x330
[ 989.794486] ? cap_capable+0x1d6/0x3e0
[ 989.799503] ? threaded_store+0x132/0x220
[ 989.804802] threaded_store+0x132/0x220
[ 989.809911] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.815215] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.820516] ? sysfs_kf_write+0x65/0x160
[ 989.825723] ? sysfs_file_ops+0x140/0x140
[ 989.831024] kernfs_fop_write_iter+0x335/0x510
[ 989.836811] ? kernfs_ops+0xf0/0xf0
[ 989.841517] new_sync_write+0x333/0x750
[ 989.846627] ? __lock_acquire+0x508/0xc10
[ 989.851930] ? new_sync_read+0x740/0x740
[ 989.857136] ? lock_acquire.part.0+0xbc/0x260
[ 989.862827] ? ksys_write+0x116/0x250
[ 989.867740] vfs_write+0x657/0x9b0
[ 989.872362] ksys_write+0x116/0x250
[ 989.877069] ? __ia32_sys_read+0xc0/0xc0
[ 989.882274] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.887867] ? rcu_is_watching+0x15/0xd0
[ 989.893074] do_syscall_64+0xf3/0x650
[ 989.897985] ? trace_hardirqs_off+0xd/0x30
[ 989.903385] ? exc_page_fault+0xda/0xf0
[ 989.908491] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.914965] RIP: 0033:0x7f550a8c722e
[ 989.919769] RSP: 002b:00007ffe3d923050 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.929073] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f550a8c722e
[ 989.937883] RDX: 0000000000000001 RSI: 0000559577ebea90 RDI: 0000000000000007
[ 989.946698] RBP: 00007ffe3d923060 R08: 0000000000000000 R09: 0000000000000000
[ 989.955511] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f550a73f390
[ 989.964327] R13: 0000559577ebea90 R14: 0000000000000007 R15: 0000000000000003
[ 989.973146]
[ 989.976470] INFO: task python3:5870 is blocked on a mutex likely owned by task python3:3820.
[ 989.986748] task:python3 state:D stack:25672 pid:3820 tgid:3820 ppid:3818 task_flags:0x400100 flags:0x00080802
[ 989.999960] Call Trace:
[ 990.003500]
[ 990.006654] __schedule+0xcc3/0x19c0
[ 990.011468] ? io_schedule_timeout+0x140/0x140
[ 990.017257] ? find_held_lock+0x2b/0x80
[ 990.022361] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.028548] schedule+0xd8/0x260
[ 990.032972] schedule_timeout+0x13f/0x290
[ 990.038274] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.044645] ? trace_contention_end+0xb3/0x1a0
[ 990.050425] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.056119] ? ww_mutex_lock+0x160/0x160
[ 990.061327] msleep+0x1b/0x30
[ 990.065456] napi_set_threaded+0x3a5/0x440
[ 990.070853] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.076350] netif_set_threaded+0x257/0x400
[ 990.081849] threaded_store+0x1b8/0x220
[ 990.086957] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.092262] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.097555] ? sysfs_kf_write+0x65/0x160
[ 990.102761] ? sysfs_file_ops+0x140/0x140
[ 990.108060] kernfs_fop_write_iter+0x335/0x510
[ 990.113850] ? kernfs_ops+0xf0/0xf0
[ 990.118564] new_sync_write+0x333/0x750
[ 990.123673] ? __lock_acquire+0x508/0xc10
[ 990.128974] ? new_sync_read+0x740/0x740
[ 990.134180] ? lock_acquire.part.0+0xbc/0x260
[ 990.139869] ? ksys_write+0x116/0x250
[ 990.144786] vfs_write+0x657/0x9b0
[ 990.149407] ksys_write+0x116/0x250
[ 990.154124] ? __ia32_sys_read+0xc0/0xc0
[ 990.159329] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.164924] ? rcu_is_watching+0x15/0xd0
[ 990.170128] do_syscall_64+0xf3/0x650
[ 990.175039] ? trace_hardirqs_off+0xd/0x30
[ 990.180434] ? exc_page_fault+0xda/0xf0
[ 990.185545] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.192016] RIP: 0033:0x7f70c163c22e
[ 990.196827] RSP: 002b:00007ffc730638e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.206128] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f70c163c22e
[ 990.214945] RDX: 0000000000000001 RSI: 0000558b8f6a8a90 RDI: 0000000000000007
[ 990.223767] RBP: 00007ffc730638f0 R08: 0000000000000000 R09: 0000000000000000
[ 990.232588] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f70c14b4390
[ 990.241405] R13: 0000558b8f6a8a90 R14: 0000000000000007 R15: 0000000000000003
[ 990.250215]
[ 990.253478] \x0aShowing all locks held in the system:
[ 990.262024] 1 lock held by khungtaskd/185:
[ 990.267423] #0: ffffffff904fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.278926] 4 locks held by python3/3820:
[ 990.284224] #0: ff1100012fdf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.294123] #1: ff1100016150fa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.305093] #2: ff11000111b0cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.316259] #3: ff11000123059d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.326375] 4 locks held by python3/5870:
[ 990.331665] #0: ff1100012fdf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.341562] #1: ff110001b1cb5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.352533] #2: ff11000111b0cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.363702] #3: ff11000123059d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.373791]
[ 990.376261] =============================================\x0a
[ 1112.575948] INFO: task python3:5870 blocked for more than 245 seconds.
[ 1112.584096] Not tainted 7.1.0-rc4-feqy-g6c6104c235d1 #1
[ 1112.591338] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.600929] task:python3 state:D stack:25184 pid:5870 tgid:5870 ppid:5869 task_flags:0x400100 flags:0x00080000
[ 1112.614135] Call Trace:
[ 1112.617677]
[ 1112.620826] __schedule+0xcc3/0x19c0
[ 1112.625642] ? io_schedule_timeout+0x140/0x140
[ 1112.631430] ? find_held_lock+0x2b/0x80
[ 1112.636534] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.642422] schedule+0xd8/0x260
[ 1112.646840] schedule_preempt_disabled+0x18/0x30
[ 1112.652818] __mutex_lock+0x6af/0x2010
[ 1112.657824] ? threaded_store+0x132/0x220
[ 1112.663127] ? ww_mutex_lock+0x160/0x160
[ 1112.668329] ? selinux_inode_free_security+0x330/0x330
[ 1112.674900] ? cap_capable+0x1d6/0x3e0
[ 1112.679910] ? threaded_store+0x132/0x220
[ 1112.685205] threaded_store+0x132/0x220
[ 1112.690307] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.695609] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.700909] ? sysfs_kf_write+0x65/0x160
[ 1112.706112] ? sysfs_file_ops+0x140/0x140
[ 1112.711406] kernfs_fop_write_iter+0x335/0x510
[ 1112.717189] ? kernfs_ops+0xf0/0xf0
[ 1112.721901] new_sync_write+0x333/0x750
[ 1112.727007] ? __lock_acquire+0x508/0xc10
[ 1112.732305] ? new_sync_read+0x740/0x740
[ 1112.737509] ? lock_acquire.part.0+0xbc/0x260
[ 1112.743197] ? ksys_write+0x116/0x250
[ 1112.748107] vfs_write+0x657/0x9b0
[ 1112.752721] ksys_write+0x116/0x250
[ 1112.757435] ? __ia32_sys_read+0xc0/0xc0
[ 1112.762634] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.768222] ? rcu_is_watching+0x15/0xd0
[ 1112.773424] do_syscall_64+0xf3/0x650
[ 1112.778329] ? trace_hardirqs_off+0xd/0x30
[ 1112.783725] ? exc_page_fault+0xda/0xf0
[ 1112.788829] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.795296] RIP: 0033:0x7f550a8c722e
[ 1112.800098] RSP: 002b:00007ffe3d923050 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.809399] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f550a8c722e
[ 1112.818209] RDX: 0000000000000001 RSI: 0000559577ebea90 RDI: 0000000000000007
[ 1112.827020] RBP: 00007ffe3d923060 R08: 0000000000000000 R09: 0000000000000000
[ 1112.835827] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f550a73f390
[ 1112.844638] R13: 0000559577ebea90 R14: 0000000000000007 R15: 0000000000000003
[ 1112.853453]
[ 1112.856757] INFO: task python3:5870 is blocked on a mutex likely owned by task python3:3820.
[ 1112.867030] task:python3 state:D stack:25672 pid:3820 tgid:3820 ppid:3818 task_flags:0x400100 flags:0x00080802
[ 1112.880231] Call Trace:
[ 1112.883770]
[ 1112.886922] __schedule+0xcc3/0x19c0
[ 1112.891736] ? io_schedule_timeout+0x140/0x140
[ 1112.897521] ? find_held_lock+0x2b/0x80
[ 1112.902626] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.908804] schedule+0xd8/0x260
[ 1112.913223] schedule_timeout+0x13f/0x290
[ 1112.918522] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.924892] ? trace_contention_end+0xb3/0x1a0
[ 1112.930671] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.936363] ? ww_mutex_lock+0x160/0x160
[ 1112.941564] msleep+0x1b/0x30
[ 1112.945689] napi_set_threaded+0x3a5/0x440
[ 1112.951086] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.956579] netif_set_threaded+0x257/0x400
[ 1112.962074] threaded_store+0x1b8/0x220
[ 1112.967180] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.972479] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.977778] ? sysfs_kf_write+0x65/0x160
[ 1112.982979] ? sysfs_file_ops+0x140/0x140
[ 1112.988275] kernfs_fop_write_iter+0x335/0x510
[ 1112.994062] ? kernfs_ops+0xf0/0xf0
[ 1112.998773] new_sync_write+0x333/0x750
[ 1113.003878] ? __lock_acquire+0x508/0xc10
[ 1113.009173] ? new_sync_read+0x740/0x740
[ 1113.014375] ? lock_acquire.part.0+0xbc/0x260
[ 1113.020060] ? ksys_write+0x116/0x250
[ 1113.024969] vfs_write+0x657/0x9b0
[ 1113.029587] ksys_write+0x116/0x250
[ 1113.034301] ? __ia32_sys_read+0xc0/0xc0
[ 1113.039502] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.045093] ? rcu_is_watching+0x15/0xd0
[ 1113.050292] do_syscall_64+0xf3/0x650
[ 1113.055201] ? trace_hardirqs_off+0xd/0x30
[ 1113.060596] ? exc_page_fault+0xda/0xf0
[ 1113.065697] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.072164] RIP: 0033:0x7f70c163c22e
[ 1113.076964] RSP: 002b:00007ffc730638e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.086262] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f70c163c22e
[ 1113.095072] RDX: 0000000000000001 RSI: 0000558b8f6a8a90 RDI: 0000000000000007
[ 1113.103877] RBP: 00007ffc730638f0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.112685] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f70c14b4390
[ 1113.121493] R13: 0000558b8f6a8a90 R14: 0000000000000007 R15: 0000000000000003
[ 1113.130308]
[ 1113.133570] \x0aShowing all locks held in the system:
[ 1113.142111] 1 lock held by khungtaskd/185:
[ 1113.147503] #0: ffffffff904fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.158990] 4 locks held by python3/3820:
[ 1113.164286] #0: ff1100012fdf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.174178] #1: ff1100016150fa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.185139] #2: ff11000111b0cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.196295] #3: ff11000123059d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.206386] 4 locks held by python3/5870:
[ 1113.211672] #0: ff1100012fdf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.221562] #1: ff110001b1cb5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.232523] #2: ff11000111b0cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.243671] #3: ff11000123059d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.253762]
[ 1113.256230] =============================================\x0a
[ 1235.457134] INFO: task python3:5870 blocked for more than 368 seconds.
[ 1235.465282] Not tainted 7.1.0-rc4-feqy-g6c6104c235d1 #1
[ 1235.472531] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.482119] task:python3 state:D stack:25184 pid:5870 tgid:5870 ppid:5869 task_flags:0x400100 flags:0x00080002
[ 1235.495326] Call Trace:
[ 1235.498865]
[ 1235.502013] __schedule+0xcc3/0x19c0
[ 1235.506829] ? io_schedule_timeout+0x140/0x140
[ 1235.512612] ? find_held_lock+0x2b/0x80
[ 1235.517706] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.523589] schedule+0xd8/0x260
[ 1235.528007] schedule_preempt_disabled+0x18/0x30
[ 1235.533985] __mutex_lock+0x6af/0x2010
[ 1235.538989] ? threaded_store+0x132/0x220
[ 1235.544289] ? ww_mutex_lock+0x160/0x160
[ 1235.549484] ? selinux_inode_free_security+0x330/0x330
[ 1235.556054] ? cap_capable+0x1d6/0x3e0
[ 1235.561060] ? threaded_store+0x132/0x220
[ 1235.566357] threaded_store+0x132/0x220
[ 1235.571459] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.576748] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.582046] ? sysfs_kf_write+0x65/0x160
[ 1235.587244] ? sysfs_file_ops+0x140/0x140
[ 1235.592537] kernfs_fop_write_iter+0x335/0x510
[ 1235.598322] ? kernfs_ops+0xf0/0xf0
[ 1235.603034] new_sync_write+0x333/0x750
[ 1235.608136] ? __lock_acquire+0x508/0xc10
[ 1235.613432] ? new_sync_read+0x740/0x740
[ 1235.618631] ? lock_acquire.part.0+0xbc/0x260
[ 1235.624318] ? ksys_write+0x116/0x250
[ 1235.629226] vfs_write+0x657/0x9b0
[ 1235.633830] ksys_write+0x116/0x250
[ 1235.638539] ? __ia32_sys_read+0xc0/0xc0
[ 1235.643738] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.649326] ? rcu_is_watching+0x15/0xd0
[ 1235.654527] do_syscall_64+0xf3/0x650
[ 1235.659433] ? trace_hardirqs_off+0xd/0x30
[ 1235.664825] ? exc_page_fault+0xda/0xf0
[ 1235.669929] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.676396] RIP: 0033:0x7f550a8c722e
[ 1235.681203] RSP: 002b:00007ffe3d923050 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.690499] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f550a8c722e
[ 1235.699307] RDX: 0000000000000001 RSI: 0000559577ebea90 RDI: 0000000000000007
[ 1235.708105] RBP: 00007ffe3d923060 R08: 0000000000000000 R09: 0000000000000000
[ 1235.716912] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f550a73f390
[ 1235.725720] R13: 0000559577ebea90 R14: 0000000000000007 R15: 0000000000000003
[ 1235.734522]
[ 1235.737804] INFO: task python3:5870 is blocked on a mutex likely owned by task python3:3820.
[ 1235.748078] task:python3 state:D stack:25672 pid:3820 tgid:3820 ppid:3818 task_flags:0x400100 flags:0x00080802
[ 1235.761278] Call Trace:
[ 1235.764815]
[ 1235.767963] __schedule+0xcc3/0x19c0
[ 1235.772774] ? io_schedule_timeout+0x140/0x140
[ 1235.778556] ? find_held_lock+0x2b/0x80
[ 1235.783657] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.789833] schedule+0xd8/0x260
[ 1235.794252] schedule_timeout+0x13f/0x290
[ 1235.799538] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.805906] ? trace_contention_end+0xb3/0x1a0
[ 1235.811690] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.817381] ? ww_mutex_lock+0x160/0x160
[ 1235.822579] msleep+0x1b/0x30
[ 1235.826703] napi_set_threaded+0x3a5/0x440
[ 1235.832099] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.837583] netif_set_threaded+0x257/0x400
[ 1235.843076] threaded_store+0x1b8/0x220
[ 1235.848179] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.853468] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.858752] ? sysfs_kf_write+0x65/0x160
[ 1235.863951] ? sysfs_file_ops+0x140/0x140
[ 1235.869243] kernfs_fop_write_iter+0x335/0x510
[ 1235.875025] ? kernfs_ops+0xf0/0xf0
[ 1235.879735] new_sync_write+0x333/0x750
[ 1235.884838] ? __lock_acquire+0x508/0xc10
[ 1235.890123] ? new_sync_read+0x740/0x740
[ 1235.895324] ? lock_acquire.part.0+0xbc/0x260
[ 1235.901010] ? ksys_write+0x116/0x250
[ 1235.905918] vfs_write+0x657/0x9b0
[ 1235.910534] ksys_write+0x116/0x250
[ 1235.915246] ? __ia32_sys_read+0xc0/0xc0
[ 1235.920435] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.926021] ? rcu_is_watching+0x15/0xd0
[ 1235.931219] do_syscall_64+0xf3/0x650
[ 1235.936123] ? trace_hardirqs_off+0xd/0x30
[ 1235.941517] ? exc_page_fault+0xda/0xf0
[ 1235.946619] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.953082] RIP: 0033:0x7f70c163c22e
[ 1235.957891] RSP: 002b:00007ffc730638e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.967188] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f70c163c22e
[ 1235.975995] RDX: 0000000000000001 RSI: 0000558b8f6a8a90 RDI: 0000000000000007
[ 1235.984801] RBP: 00007ffc730638f0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.993605] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f70c14b4390
[ 1236.002412] R13: 0000558b8f6a8a90 R14: 0000000000000007 R15: 0000000000000003
[ 1236.011223]
[ 1236.014486] \x0aShowing all locks held in the system:
[ 1236.023027] 1 lock held by khungtaskd/185:
[ 1236.028418] #0: ffffffff904fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.039896] 4 locks held by python3/3820:
[ 1236.045192] #0: ff1100012fdf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.055079] #1: ff1100016150fa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.066038] #2: ff11000111b0cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.077195] #3: ff11000123059d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.087293] 4 locks held by python3/5870:
[ 1236.092584] #0: ff1100012fdf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.102471] #1: ff110001b1cb5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.113429] #2: ff11000111b0cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.124584] #3: ff11000123059d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.134674]
[ 1236.137140] =============================================\x0a
[ 1241.666604] block nvme0n1: No UUID available providing old NGUID
SUBSYSTEM=block
DEVICE=b259:0
[ 1358.338281] INFO: task python3:5870 blocked for more than 491 seconds.
[ 1358.346427] Not tainted 7.1.0-rc4-feqy-g6c6104c235d1 #1
[ 1358.353669] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.363258] task:python3 state:D stack:25184 pid:5870 tgid:5870 ppid:5869 task_flags:0x400100 flags:0x00080002
[ 1358.376457] Call Trace:
[ 1358.379997]
[ 1358.383145] __schedule+0xcc3/0x19c0
[ 1358.387958] ? io_schedule_timeout+0x140/0x140
[ 1358.393742] ? find_held_lock+0x2b/0x80
[ 1358.398846] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.404730] schedule+0xd8/0x260
[ 1358.409148] schedule_preempt_disabled+0x18/0x30
[ 1358.415127] __mutex_lock+0x6af/0x2010
[ 1358.420131] ? threaded_store+0x132/0x220
[ 1358.425431] ? ww_mutex_lock+0x160/0x160
[ 1358.430618] ? selinux_inode_free_security+0x330/0x330
[ 1358.437188] ? cap_capable+0x1d6/0x3e0
[ 1358.442195] ? threaded_store+0x132/0x220
[ 1358.447490] threaded_store+0x132/0x220
[ 1358.452592] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.457885] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.463186] ? sysfs_kf_write+0x65/0x160
[ 1358.468384] ? sysfs_file_ops+0x140/0x140
[ 1358.473678] kernfs_fop_write_iter+0x335/0x510
[ 1358.479462] ? kernfs_ops+0xf0/0xf0
[ 1358.484171] new_sync_write+0x333/0x750
[ 1358.489272] ? __lock_acquire+0x508/0xc10
[ 1358.494566] ? new_sync_read+0x740/0x740
[ 1358.499766] ? lock_acquire.part.0+0xbc/0x260
[ 1358.505441] ? ksys_write+0x116/0x250
[ 1358.510349] vfs_write+0x657/0x9b0
[ 1358.514962] ksys_write+0x116/0x250
[ 1358.519671] ? __ia32_sys_read+0xc0/0xc0
[ 1358.524871] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.530460] ? rcu_is_watching+0x15/0xd0
[ 1358.535652] do_syscall_64+0xf3/0x650
[ 1358.540550] ? trace_hardirqs_off+0xd/0x30
[ 1358.545933] ? exc_page_fault+0xda/0xf0
[ 1358.551034] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.557501] RIP: 0033:0x7f550a8c722e
[ 1358.562310] RSP: 002b:00007ffe3d923050 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.571607] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f550a8c722e
[ 1358.580417] RDX: 0000000000000001 RSI: 0000559577ebea90 RDI: 0000000000000007
[ 1358.589225] RBP: 00007ffe3d923060 R08: 0000000000000000 R09: 0000000000000000
[ 1358.598034] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f550a73f390
[ 1358.606842] R13: 0000559577ebea90 R14: 0000000000000007 R15: 0000000000000003
[ 1358.615646]
[ 1358.618934] INFO: task python3:5870 is blocked on a mutex likely owned by task python3:3820.
[ 1358.629203] task:python3 state:D stack:25672 pid:3820 tgid:3820 ppid:3818 task_flags:0x400100 flags:0x00080802
[ 1358.642406] Call Trace:
[ 1358.645942]
[ 1358.649091] __schedule+0xcc3/0x19c0
[ 1358.653901] ? io_schedule_timeout+0x140/0x140
[ 1358.659684] ? find_held_lock+0x2b/0x80
[ 1358.664786] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.670961] schedule+0xd8/0x260
[ 1358.675377] schedule_timeout+0x13f/0x290
[ 1358.680672] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.687040] ? trace_contention_end+0xb3/0x1a0
[ 1358.692825] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.698515] ? ww_mutex_lock+0x160/0x160
[ 1358.703714] msleep+0x1b/0x30
[ 1358.707838] napi_set_threaded+0x3a5/0x440
[ 1358.713235] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.718717] netif_set_threaded+0x257/0x400
[ 1358.724211] threaded_store+0x1b8/0x220
[ 1358.729310] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.734608] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.739901] ? sysfs_kf_write+0x65/0x160
[ 1358.745099] ? sysfs_file_ops+0x140/0x140
[ 1358.750396] kernfs_fop_write_iter+0x335/0x510
[ 1358.756178] ? kernfs_ops+0xf0/0xf0
[ 1358.760887] new_sync_write+0x333/0x750
[ 1358.765988] ? __lock_acquire+0x508/0xc10
[ 1358.771283] ? new_sync_read+0x740/0x740
[ 1358.776480] ? lock_acquire.part.0+0xbc/0x260
[ 1358.782166] ? ksys_write+0x116/0x250
[ 1358.787074] vfs_write+0x657/0x9b0
[ 1358.791689] ksys_write+0x116/0x250
[ 1358.796392] ? __ia32_sys_read+0xc0/0xc0
[ 1358.801588] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.807174] ? rcu_is_watching+0x15/0xd0
[ 1358.812372] do_syscall_64+0xf3/0x650
[ 1358.817276] ? trace_hardirqs_off+0xd/0x30
[ 1358.822669] ? exc_page_fault+0xda/0xf0
[ 1358.827770] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.834236] RIP: 0033:0x7f70c163c22e
[ 1358.839044] RSP: 002b:00007ffc730638e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.848341] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f70c163c22e
[ 1358.857139] RDX: 0000000000000001 RSI: 0000558b8f6a8a90 RDI: 0000000000000007
[ 1358.865944] RBP: 00007ffc730638f0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.874748] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f70c14b4390
[ 1358.883552] R13: 0000558b8f6a8a90 R14: 0000000000000007 R15: 0000000000000003
[ 1358.892363]
[ 1358.895632] \x0aShowing all locks held in the system:
[ 1358.904171] 1 lock held by khungtaskd/185:
[ 1358.909564] #0: ffffffff904fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.921042] 4 locks held by python3/3820:
[ 1358.926339] #0: ff1100012fdf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.936226] #1: ff1100016150fa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.947188] #2: ff11000111b0cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.958346] #3: ff11000123059d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.968440] 4 locks held by python3/5870:
[ 1358.973733] #0: ff1100012fdf43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.983618] #1: ff110001b1cb5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.994578] #2: ff11000111b0cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.005734] #3: ff11000123059d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.015828]
[ 1359.018294] =============================================\x0a
[ 1362.434793] kworker/u130:6 (845) used greatest stack depth: 21936 bytes left