[ 786.296737] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 786.299270] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 786.490226] kselftest: Running tests in drivers/net
[ 989.710221] INFO: task python3:5839 blocked for more than 122 seconds.
[ 989.718455] Not tainted 7.1.0-rc3-ehnc-g5b2f5ff27f1c #1
[ 989.725710] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.735920] task:python3 state:D stack:25672 pid:5839 tgid:5839 ppid:5838 task_flags:0x400100 flags:0x00080000
[ 989.749126] Call Trace:
[ 989.752662]
[ 989.755811] __schedule+0xcc3/0x19c0
[ 989.760625] ? io_schedule_timeout+0x140/0x140
[ 989.766401] ? find_held_lock+0x2b/0x80
[ 989.771505] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.777392] schedule+0xd8/0x260
[ 989.781809] schedule_preempt_disabled+0x18/0x30
[ 989.787785] __mutex_lock+0x6af/0x2010
[ 989.792787] ? threaded_store+0x132/0x220
[ 989.798077] ? ww_mutex_lock+0x160/0x160
[ 989.803274] ? selinux_inode_free_security+0x330/0x330
[ 989.809840] ? cap_capable+0x1d6/0x3e0
[ 989.814847] ? threaded_store+0x132/0x220
[ 989.820145] threaded_store+0x132/0x220
[ 989.825247] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.830533] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.835831] ? sysfs_kf_write+0x65/0x160
[ 989.841028] ? sysfs_file_ops+0x140/0x140
[ 989.846321] kernfs_fop_write_iter+0x335/0x510
[ 989.852105] ? kernfs_ops+0xf0/0xf0
[ 989.856815] new_sync_write+0x333/0x750
[ 989.861916] ? __lock_acquire+0x508/0xc10
[ 989.867212] ? new_sync_read+0x740/0x740
[ 989.872411] ? lock_acquire.part.0+0xbc/0x260
[ 989.878093] ? ksys_write+0x116/0x250
[ 989.883000] vfs_write+0x657/0x9b0
[ 989.887615] ksys_write+0x116/0x250
[ 989.892325] ? __ia32_sys_read+0xc0/0xc0
[ 989.897525] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.903114] ? rcu_is_watching+0x15/0xd0
[ 989.908316] do_syscall_64+0xf3/0x650
[ 989.913222] ? trace_hardirqs_off+0xd/0x30
[ 989.918616] ? exc_page_fault+0xda/0xf0
[ 989.923715] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.930181] RIP: 0033:0x7f0d303ca22e
[ 989.934981] RSP: 002b:00007ffeed69f5f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.944279] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f0d303ca22e
[ 989.953087] RDX: 0000000000000001 RSI: 0000565261879cd0 RDI: 0000000000000007
[ 989.961895] RBP: 00007ffeed69f600 R08: 0000000000000000 R09: 0000000000000000
[ 989.970701] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f0d30242390
[ 989.979508] R13: 0000565261879cd0 R14: 0000000000000007 R15: 0000000000000003
[ 989.988326]
[ 989.991609] INFO: task python3:5839 is blocked on a mutex likely owned by task python3:3827.
[ 990.001880] task:python3 state:D stack:25672 pid:3827 tgid:3827 ppid:3826 task_flags:0x400100 flags:0x00080802
[ 990.015079] Call Trace:
[ 990.018616]
[ 990.021765] __schedule+0xcc3/0x19c0
[ 990.026574] ? io_schedule_timeout+0x140/0x140
[ 990.032356] ? find_held_lock+0x2b/0x80
[ 990.037460] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.043635] schedule+0xd8/0x260
[ 990.048054] schedule_timeout+0x13f/0x290
[ 990.053349] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.059717] ? trace_contention_end+0xb3/0x1a0
[ 990.065502] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.071183] ? ww_mutex_lock+0x160/0x160
[ 990.076381] msleep+0x1b/0x30
[ 990.080506] napi_set_threaded+0x3a5/0x440
[ 990.085901] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.091396] netif_set_threaded+0x257/0x400
[ 990.096887] threaded_store+0x1b8/0x220
[ 990.101982] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.107278] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.112571] ? sysfs_kf_write+0x65/0x160
[ 990.117770] ? sysfs_file_ops+0x140/0x140
[ 990.123065] kernfs_fop_write_iter+0x335/0x510
[ 990.128847] ? kernfs_ops+0xf0/0xf0
[ 990.133556] new_sync_write+0x333/0x750
[ 990.138657] ? __lock_acquire+0x508/0xc10
[ 990.143949] ? new_sync_read+0x740/0x740
[ 990.149149] ? lock_acquire.part.0+0xbc/0x260
[ 990.154835] ? ksys_write+0x116/0x250
[ 990.159742] vfs_write+0x657/0x9b0
[ 990.164359] ksys_write+0x116/0x250
[ 990.169072] ? __ia32_sys_read+0xc0/0xc0
[ 990.174268] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.179854] ? rcu_is_watching+0x15/0xd0
[ 990.185057] do_syscall_64+0xf3/0x650
[ 990.189958] ? trace_hardirqs_off+0xd/0x30
[ 990.195351] ? exc_page_fault+0xda/0xf0
[ 990.200452] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.206920] RIP: 0033:0x7f769c90e22e
[ 990.211717] RSP: 002b:00007ffce4b30220 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.221014] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f769c90e22e
[ 990.229814] RDX: 0000000000000001 RSI: 0000556284431cd0 RDI: 0000000000000007
[ 990.238622] RBP: 00007ffce4b30230 R08: 0000000000000000 R09: 0000000000000000
[ 990.247419] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f769c786390
[ 990.256227] R13: 0000556284431cd0 R14: 0000000000000007 R15: 0000000000000003
[ 990.265031]
[ 990.268285] \x0aShowing all locks held in the system:
[ 990.276823] 1 lock held by khungtaskd/185:
[ 990.282214] #0: ffffffffb8efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.293697] 4 locks held by python3/3827:
[ 990.298984] #0: ff110017d9e843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.308874] #1: ff1100017d967a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.319824] #2: ff11000123608b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.330979] #3: ff11000123669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.341079] 4 locks held by python3/5839:
[ 990.346371] #0: ff110017d9e843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.356257] #1: ff11000127947480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.367219] #2: ff11000123608b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.378366] #3: ff11000123669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.388443]
[ 990.390907] =============================================\x0a
[ 1112.591252] INFO: task python3:5839 blocked for more than 245 seconds.
[ 1112.599403] Not tainted 7.1.0-rc3-ehnc-g5b2f5ff27f1c #1
[ 1112.606653] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.616245] task:python3 state:D stack:25672 pid:5839 tgid:5839 ppid:5838 task_flags:0x400100 flags:0x00080000
[ 1112.629452] Call Trace:
[ 1112.632992]
[ 1112.636145] __schedule+0xcc3/0x19c0
[ 1112.640963] ? io_schedule_timeout+0x140/0x140
[ 1112.646752] ? find_held_lock+0x2b/0x80
[ 1112.651859] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.657744] schedule+0xd8/0x260
[ 1112.662165] schedule_preempt_disabled+0x18/0x30
[ 1112.668147] __mutex_lock+0x6af/0x2010
[ 1112.673153] ? threaded_store+0x132/0x220
[ 1112.678452] ? ww_mutex_lock+0x160/0x160
[ 1112.683651] ? selinux_inode_free_security+0x330/0x330
[ 1112.690220] ? cap_capable+0x1d6/0x3e0
[ 1112.695231] ? threaded_store+0x132/0x220
[ 1112.700530] threaded_store+0x132/0x220
[ 1112.705631] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.710928] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.716219] ? sysfs_kf_write+0x65/0x160
[ 1112.721435] ? sysfs_file_ops+0x140/0x140
[ 1112.726731] kernfs_fop_write_iter+0x335/0x510
[ 1112.732516] ? kernfs_ops+0xf0/0xf0
[ 1112.737218] new_sync_write+0x333/0x750
[ 1112.742322] ? __lock_acquire+0x508/0xc10
[ 1112.747613] ? new_sync_read+0x740/0x740
[ 1112.752815] ? lock_acquire.part.0+0xbc/0x260
[ 1112.758501] ? ksys_write+0x116/0x250
[ 1112.763414] vfs_write+0x657/0x9b0
[ 1112.768032] ksys_write+0x116/0x250
[ 1112.772744] ? __ia32_sys_read+0xc0/0xc0
[ 1112.777946] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.783536] ? rcu_is_watching+0x15/0xd0
[ 1112.788731] do_syscall_64+0xf3/0x650
[ 1112.793640] ? trace_hardirqs_off+0xd/0x30
[ 1112.799035] ? exc_page_fault+0xda/0xf0
[ 1112.804138] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.810608] RIP: 0033:0x7f0d303ca22e
[ 1112.815418] RSP: 002b:00007ffeed69f5f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.824716] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f0d303ca22e
[ 1112.833525] RDX: 0000000000000001 RSI: 0000565261879cd0 RDI: 0000000000000007
[ 1112.842333] RBP: 00007ffeed69f600 R08: 0000000000000000 R09: 0000000000000000
[ 1112.851142] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f0d30242390
[ 1112.859951] R13: 0000565261879cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.868762]
[ 1112.872031] INFO: task python3:5839 is blocked on a mutex likely owned by task python3:3827.
[ 1112.882302] task:python3 state:D stack:25672 pid:3827 tgid:3827 ppid:3826 task_flags:0x400100 flags:0x00080802
[ 1112.895505] Call Trace:
[ 1112.899042]
[ 1112.902194] __schedule+0xcc3/0x19c0
[ 1112.907005] ? io_schedule_timeout+0x140/0x140
[ 1112.912790] ? find_held_lock+0x2b/0x80
[ 1112.917885] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.924066] schedule+0xd8/0x260
[ 1112.928484] schedule_timeout+0x13f/0x290
[ 1112.933781] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.940150] ? trace_contention_end+0xb3/0x1a0
[ 1112.945937] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.951629] ? ww_mutex_lock+0x160/0x160
[ 1112.956829] msleep+0x1b/0x30
[ 1112.960954] napi_set_threaded+0x3a5/0x440
[ 1112.966352] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.971845] netif_set_threaded+0x257/0x400
[ 1112.977329] threaded_store+0x1b8/0x220
[ 1112.982434] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.987731] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.993021] ? sysfs_kf_write+0x65/0x160
[ 1112.998220] ? sysfs_file_ops+0x140/0x140
[ 1113.003517] kernfs_fop_write_iter+0x335/0x510
[ 1113.009304] ? kernfs_ops+0xf0/0xf0
[ 1113.014015] new_sync_write+0x333/0x750
[ 1113.019118] ? __lock_acquire+0x508/0xc10
[ 1113.024413] ? new_sync_read+0x740/0x740
[ 1113.029614] ? lock_acquire.part.0+0xbc/0x260
[ 1113.035300] ? ksys_write+0x116/0x250
[ 1113.040210] vfs_write+0x657/0x9b0
[ 1113.044826] ksys_write+0x116/0x250
[ 1113.049540] ? __ia32_sys_read+0xc0/0xc0
[ 1113.054741] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.060331] ? rcu_is_watching+0x15/0xd0
[ 1113.065532] do_syscall_64+0xf3/0x650
[ 1113.070441] ? trace_hardirqs_off+0xd/0x30
[ 1113.075835] ? exc_page_fault+0xda/0xf0
[ 1113.080936] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.087402] RIP: 0033:0x7f769c90e22e
[ 1113.092211] RSP: 002b:00007ffce4b30220 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.101507] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f769c90e22e
[ 1113.110315] RDX: 0000000000000001 RSI: 0000556284431cd0 RDI: 0000000000000007
[ 1113.119124] RBP: 00007ffce4b30230 R08: 0000000000000000 R09: 0000000000000000
[ 1113.127934] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f769c786390
[ 1113.136740] R13: 0000556284431cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.145553]
[ 1113.148816] \x0aShowing all locks held in the system:
[ 1113.157353] 1 lock held by khungtaskd/185:
[ 1113.162748] #0: ffffffffb8efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.174229] 4 locks held by python3/3827:
[ 1113.179527] #0: ff110017d9e843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.189408] #1: ff1100017d967a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.200368] #2: ff11000123608b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.211527] #3: ff11000123669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.221622] 4 locks held by python3/5839:
[ 1113.226917] #0: ff110017d9e843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.236805] #1: ff11000127947480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.247769] #2: ff11000123608b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.258929] #3: ff11000123669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.269020]
[ 1113.271488] =============================================\x0a
[ 1235.472284] INFO: task python3:5839 blocked for more than 368 seconds.
[ 1235.480447] Not tainted 7.1.0-rc3-ehnc-g5b2f5ff27f1c #1
[ 1235.487721] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.497336] task:python3 state:D stack:25672 pid:5839 tgid:5839 ppid:5838 task_flags:0x400100 flags:0x00080002
[ 1235.510570] Call Trace:
[ 1235.514118]
[ 1235.517276] __schedule+0xcc3/0x19c0
[ 1235.522110] ? io_schedule_timeout+0x140/0x140
[ 1235.527909] ? find_held_lock+0x2b/0x80
[ 1235.533029] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.538930] schedule+0xd8/0x260
[ 1235.543352] schedule_preempt_disabled+0x18/0x30
[ 1235.549332] __mutex_lock+0x6af/0x2010
[ 1235.554335] ? threaded_store+0x132/0x220
[ 1235.554343] ? ww_mutex_lock+0x160/0x160
[ 1235.554346] ? selinux_inode_free_security+0x330/0x330
[ 1235.554355] ? cap_capable+0x1d6/0x3e0
[ 1235.576476] ? threaded_store+0x132/0x220
[ 1235.581773] threaded_store+0x132/0x220
[ 1235.586878] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.592173] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.597469] ? sysfs_kf_write+0x65/0x160
[ 1235.602669] ? sysfs_file_ops+0x140/0x140
[ 1235.607964] kernfs_fop_write_iter+0x335/0x510
[ 1235.613748] ? kernfs_ops+0xf0/0xf0
[ 1235.618457] new_sync_write+0x333/0x750
[ 1235.623559] ? __lock_acquire+0x508/0xc10
[ 1235.628852] ? new_sync_read+0x740/0x740
[ 1235.634051] ? lock_acquire.part.0+0xbc/0x260
[ 1235.639735] ? ksys_write+0x116/0x250
[ 1235.644647] vfs_write+0x657/0x9b0
[ 1235.649262] ksys_write+0x116/0x250
[ 1235.653966] ? __ia32_sys_read+0xc0/0xc0
[ 1235.659156] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.664746] ? rcu_is_watching+0x15/0xd0
[ 1235.669946] do_syscall_64+0xf3/0x650
[ 1235.674849] ? trace_hardirqs_off+0xd/0x30
[ 1235.680242] ? exc_page_fault+0xda/0xf0
[ 1235.685344] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.691812] RIP: 0033:0x7f0d303ca22e
[ 1235.696620] RSP: 002b:00007ffeed69f5f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.705909] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f0d303ca22e
[ 1235.714709] RDX: 0000000000000001 RSI: 0000565261879cd0 RDI: 0000000000000007
[ 1235.723516] RBP: 00007ffeed69f600 R08: 0000000000000000 R09: 0000000000000000
[ 1235.732316] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f0d30242390
[ 1235.741123] R13: 0000565261879cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.749940]
[ 1235.753274] INFO: task python3:5839 is blocked on a mutex likely owned by task python3:3827.
[ 1235.763547] task:python3 state:D stack:25672 pid:3827 tgid:3827 ppid:3826 task_flags:0x400100 flags:0x00080802
[ 1235.776748] Call Trace:
[ 1235.780285]
[ 1235.783435] __schedule+0xcc3/0x19c0
[ 1235.788245] ? io_schedule_timeout+0x140/0x140
[ 1235.794019] ? find_held_lock+0x2b/0x80
[ 1235.799122] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.805302] schedule+0xd8/0x260
[ 1235.809719] schedule_timeout+0x13f/0x290
[ 1235.815014] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.821381] ? trace_contention_end+0xb3/0x1a0
[ 1235.827167] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.832857] ? ww_mutex_lock+0x160/0x160
[ 1235.838055] msleep+0x1b/0x30
[ 1235.842179] napi_set_threaded+0x3a5/0x440
[ 1235.847571] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.853062] netif_set_threaded+0x257/0x400
[ 1235.858554] threaded_store+0x1b8/0x220
[ 1235.863646] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.868943] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.874236] ? sysfs_kf_write+0x65/0x160
[ 1235.879436] ? sysfs_file_ops+0x140/0x140
[ 1235.884732] kernfs_fop_write_iter+0x335/0x510
[ 1235.890517] ? kernfs_ops+0xf0/0xf0
[ 1235.895217] new_sync_write+0x333/0x750
[ 1235.900315] ? __lock_acquire+0x508/0xc10
[ 1235.905610] ? new_sync_read+0x740/0x740
[ 1235.910810] ? lock_acquire.part.0+0xbc/0x260
[ 1235.916486] ? ksys_write+0x116/0x250
[ 1235.921396] vfs_write+0x657/0x9b0
[ 1235.926007] ksys_write+0x116/0x250
[ 1235.930721] ? __ia32_sys_read+0xc0/0xc0
[ 1235.935917] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.941507] ? rcu_is_watching+0x15/0xd0
[ 1235.946696] do_syscall_64+0xf3/0x650
[ 1235.951600] ? trace_hardirqs_off+0xd/0x30
[ 1235.956994] ? exc_page_fault+0xda/0xf0
[ 1235.962096] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.968551] RIP: 0033:0x7f769c90e22e
[ 1235.973357] RSP: 002b:00007ffce4b30220 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.982654] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f769c90e22e
[ 1235.991463] RDX: 0000000000000001 RSI: 0000556284431cd0 RDI: 0000000000000007
[ 1236.000271] RBP: 00007ffce4b30230 R08: 0000000000000000 R09: 0000000000000000
[ 1236.009079] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f769c786390
[ 1236.017887] R13: 0000556284431cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1236.026692]
[ 1236.029953] \x0aShowing all locks held in the system:
[ 1236.038596] 1 lock held by khungtaskd/185:
[ 1236.043990] #0: ffffffffb8efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.055470] 4 locks held by python3/3827:
[ 1236.060763] #0: ff110017d9e843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.070652] #1: ff1100017d967a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.081610] #2: ff11000123608b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.092763] #3: ff11000123669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.102868] 4 locks held by python3/5839:
[ 1236.108161] #0: ff110017d9e843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.118049] #1: ff11000127947480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.129008] #2: ff11000123608b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.140167] #3: ff11000123669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.150255] 5 locks held by (systemd-user-)/7284:
[ 1236.156330] #0: ff110017d9f443e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.166219] #1: ff110001cabde280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.177172] #2: ffffffffb8f69ce0 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1236.187839] #3: ffffffffb8d68870 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650
[ 1236.199484] #4: ffffffffb8f69a50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650
[ 1236.211910]
[ 1236.214386] =============================================\x0a
[ 1358.352346] INFO: task python3:5839 blocked for more than 491 seconds.
[ 1358.360492] Not tainted 7.1.0-rc3-ehnc-g5b2f5ff27f1c #1
[ 1358.367742] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.377334] task:python3 state:D stack:25672 pid:5839 tgid:5839 ppid:5838 task_flags:0x400100 flags:0x00080002
[ 1358.390542] Call Trace:
[ 1358.394083]
[ 1358.397232] __schedule+0xcc3/0x19c0
[ 1358.402051] ? io_schedule_timeout+0x140/0x140
[ 1358.407837] ? find_held_lock+0x2b/0x80
[ 1358.412944] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.418827] schedule+0xd8/0x260
[ 1358.423249] schedule_preempt_disabled+0x18/0x30
[ 1358.429230] __mutex_lock+0x6af/0x2010
[ 1358.434233] ? threaded_store+0x132/0x220
[ 1358.439532] ? ww_mutex_lock+0x160/0x160
[ 1358.444730] ? selinux_inode_free_security+0x330/0x330
[ 1358.451300] ? cap_capable+0x1d6/0x3e0
[ 1358.456309] ? threaded_store+0x132/0x220
[ 1358.461607] threaded_store+0x132/0x220
[ 1358.466709] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.472009] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.477310] ? sysfs_kf_write+0x65/0x160
[ 1358.482510] ? sysfs_file_ops+0x140/0x140
[ 1358.487798] kernfs_fop_write_iter+0x335/0x510
[ 1358.493585] ? kernfs_ops+0xf0/0xf0
[ 1358.498296] new_sync_write+0x333/0x750
[ 1358.503401] ? __lock_acquire+0x508/0xc10
[ 1358.508698] ? new_sync_read+0x740/0x740
[ 1358.513901] ? lock_acquire.part.0+0xbc/0x260
[ 1358.519588] ? ksys_write+0x116/0x250
[ 1358.524497] vfs_write+0x657/0x9b0
[ 1358.529114] ksys_write+0x116/0x250
[ 1358.533827] ? __ia32_sys_read+0xc0/0xc0
[ 1358.539029] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.544620] ? rcu_is_watching+0x15/0xd0
[ 1358.549820] do_syscall_64+0xf3/0x650
[ 1358.554721] ? trace_hardirqs_off+0xd/0x30
[ 1358.560117] ? exc_page_fault+0xda/0xf0
[ 1358.565219] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.571686] RIP: 0033:0x7f0d303ca22e
[ 1358.576487] RSP: 002b:00007ffeed69f5f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.585776] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f0d303ca22e
[ 1358.594586] RDX: 0000000000000001 RSI: 0000565261879cd0 RDI: 0000000000000007
[ 1358.603395] RBP: 00007ffeed69f600 R08: 0000000000000000 R09: 0000000000000000
[ 1358.612202] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f0d30242390
[ 1358.621012] R13: 0000565261879cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.629824]
[ 1358.633102] INFO: task python3:5839 is blocked on a mutex likely owned by task python3:3827.
[ 1358.643373] task:python3 state:D stack:25672 pid:3827 tgid:3827 ppid:3826 task_flags:0x400100 flags:0x00080802
[ 1358.656576] Call Trace:
[ 1358.660114]
[ 1358.663266] __schedule+0xcc3/0x19c0
[ 1358.668079] ? io_schedule_timeout+0x140/0x140
[ 1358.673863] ? find_held_lock+0x2b/0x80
[ 1358.678957] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.685135] schedule+0xd8/0x260
[ 1358.689554] schedule_timeout+0x13f/0x290
[ 1358.694851] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.701221] ? trace_contention_end+0xb3/0x1a0
[ 1358.707000] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.712691] ? ww_mutex_lock+0x160/0x160
[ 1358.717892] msleep+0x1b/0x30
[ 1358.722019] napi_set_threaded+0x3a5/0x440
[ 1358.727409] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.732904] netif_set_threaded+0x257/0x400
[ 1358.738399] threaded_store+0x1b8/0x220
[ 1358.743500] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.748799] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.754094] ? sysfs_kf_write+0x65/0x160
[ 1358.759294] ? sysfs_file_ops+0x140/0x140
[ 1358.764591] kernfs_fop_write_iter+0x335/0x510
[ 1358.770374] ? kernfs_ops+0xf0/0xf0
[ 1358.775086] new_sync_write+0x333/0x750
[ 1358.780193] ? __lock_acquire+0x508/0xc10
[ 1358.785489] ? new_sync_read+0x740/0x740
[ 1358.790691] ? lock_acquire.part.0+0xbc/0x260
[ 1358.796378] ? ksys_write+0x116/0x250
[ 1358.801279] vfs_write+0x657/0x9b0
[ 1358.805897] ksys_write+0x116/0x250
[ 1358.810610] ? __ia32_sys_read+0xc0/0xc0
[ 1358.815812] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.821403] ? rcu_is_watching+0x15/0xd0
[ 1358.826602] do_syscall_64+0xf3/0x650
[ 1358.831511] ? trace_hardirqs_off+0xd/0x30
[ 1358.836907] ? exc_page_fault+0xda/0xf0
[ 1358.842009] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.848477] RIP: 0033:0x7f769c90e22e
[ 1358.853276] RSP: 002b:00007ffce4b30220 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.862573] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f769c90e22e
[ 1358.871384] RDX: 0000000000000001 RSI: 0000556284431cd0 RDI: 0000000000000007
[ 1358.880195] RBP: 00007ffce4b30230 R08: 0000000000000000 R09: 0000000000000000
[ 1358.889005] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f769c786390
[ 1358.897814] R13: 0000556284431cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.906630]
[ 1358.909893] \x0aShowing all locks held in the system:
[ 1358.918434] 1 lock held by khungtaskd/185:
[ 1358.923826] #0: ffffffffb8efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.935306] 4 locks held by python3/3827:
[ 1358.940603] #0: ff110017d9e843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.950493] #1: ff1100017d967a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.961444] #2: ff11000123608b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.972601] #3: ff11000123669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.982685] 4 locks held by python3/5839:
[ 1358.987982] #0: ff110017d9e843e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.997872] #1: ff11000127947480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.008833] #2: ff11000123608b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.019988] #3: ff11000123669d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.030081]
[ 1359.032550] =============================================\x0a
[ 1374.737463] kworker/u129:12 (306) used greatest stack depth: 21936 bytes left