[ 784.485855] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 784.489434] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 784.638722] kselftest: Running tests in drivers/net
[ 989.669458] INFO: task python3:5718 blocked for more than 122 seconds.
[ 989.677689] Not tainted 7.1.0-rc4-ehha-g02f1b1291a39 #1
[ 989.684937] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.695116] task:python3 state:D stack:25568 pid:5718 tgid:5718 ppid:5717 task_flags:0x400100 flags:0x00080000
[ 989.708320] Call Trace:
[ 989.711857]
[ 989.715007] __schedule+0xcc3/0x19c0
[ 989.719822] ? io_schedule_timeout+0x140/0x140
[ 989.725605] ? find_held_lock+0x2b/0x80
[ 989.730711] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.736594] schedule+0xd8/0x260
[ 989.741009] schedule_preempt_disabled+0x18/0x30
[ 989.746988] __mutex_lock+0x6af/0x2010
[ 989.751992] ? threaded_store+0x132/0x220
[ 989.757295] ? ww_mutex_lock+0x160/0x160
[ 989.762492] ? selinux_inode_free_security+0x330/0x330
[ 989.769060] ? cap_capable+0x1d6/0x3e0
[ 989.774065] ? threaded_store+0x132/0x220
[ 989.779362] threaded_store+0x132/0x220
[ 989.784465] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.789761] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.795060] ? sysfs_kf_write+0x65/0x160
[ 989.800258] ? sysfs_file_ops+0x140/0x140
[ 989.805553] kernfs_fop_write_iter+0x335/0x510
[ 989.811335] ? kernfs_ops+0xf0/0xf0
[ 989.816047] new_sync_write+0x333/0x750
[ 989.821149] ? __lock_acquire+0x508/0xc10
[ 989.826442] ? new_sync_read+0x740/0x740
[ 989.831642] ? lock_acquire.part.0+0xbc/0x260
[ 989.837325] ? ksys_write+0x116/0x250
[ 989.842232] vfs_write+0x657/0x9b0
[ 989.846848] ksys_write+0x116/0x250
[ 989.851559] ? __ia32_sys_read+0xc0/0xc0
[ 989.856758] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.862347] ? rcu_is_watching+0x15/0xd0
[ 989.867549] do_syscall_64+0xf3/0x650
[ 989.872453] ? irq_exit_rcu+0x1a/0x30
[ 989.877359] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.883826] RIP: 0033:0x7fdabb37d22e
[ 989.888634] RSP: 002b:00007fff97e0a7b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.897937] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdabb37d22e
[ 989.906742] RDX: 0000000000000001 RSI: 0000556c8ee266b0 RDI: 0000000000000007
[ 989.915549] RBP: 00007fff97e0a7c0 R08: 0000000000000000 R09: 0000000000000000
[ 989.924354] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdabb1f5390
[ 989.933165] R13: 0000556c8ee266b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.941976]
[ 989.945247] INFO: task python3:5718 is blocked on a mutex likely owned by task python3:3667.
[ 989.955520] task:python3 state:D stack:25672 pid:3667 tgid:3667 ppid:3666 task_flags:0x400100 flags:0x00080802
[ 989.968723] Call Trace:
[ 989.972262]
[ 989.975412] __schedule+0xcc3/0x19c0
[ 989.980223] ? io_schedule_timeout+0x140/0x140
[ 989.986004] ? find_held_lock+0x2b/0x80
[ 989.991106] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.997277] schedule+0xd8/0x260
[ 990.001694] schedule_timeout+0x13f/0x290
[ 990.006989] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.013355] ? trace_contention_end+0xb3/0x1a0
[ 990.019138] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.024828] ? ww_mutex_lock+0x160/0x160
[ 990.030027] msleep+0x1b/0x30
[ 990.034151] napi_set_threaded+0x3a5/0x440
[ 990.039549] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.045041] netif_set_threaded+0x257/0x400
[ 990.050534] threaded_store+0x1b8/0x220
[ 990.055634] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.060930] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.066226] ? sysfs_kf_write+0x65/0x160
[ 990.071424] ? sysfs_file_ops+0x140/0x140
[ 990.076718] kernfs_fop_write_iter+0x335/0x510
[ 990.082503] ? kernfs_ops+0xf0/0xf0
[ 990.087206] new_sync_write+0x333/0x750
[ 990.092301] ? __lock_acquire+0x508/0xc10
[ 990.097594] ? new_sync_read+0x740/0x740
[ 990.102793] ? lock_acquire.part.0+0xbc/0x260
[ 990.108477] ? ksys_write+0x116/0x250
[ 990.113385] vfs_write+0x657/0x9b0
[ 990.117998] ksys_write+0x116/0x250
[ 990.122709] ? __ia32_sys_read+0xc0/0xc0
[ 990.127910] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.133499] ? rcu_is_watching+0x15/0xd0
[ 990.138697] do_syscall_64+0xf3/0x650
[ 990.143599] ? trace_hardirqs_off+0xd/0x30
[ 990.148994] ? exc_page_fault+0xda/0xf0
[ 990.154095] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.160562] RIP: 0033:0x7f3cd7ff222e
[ 990.165370] RSP: 002b:00007ffe519b9110 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.174667] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3cd7ff222e
[ 990.183473] RDX: 0000000000000001 RSI: 0000555ad98766b0 RDI: 0000000000000007
[ 990.192279] RBP: 00007ffe519b9120 R08: 0000000000000000 R09: 0000000000000000
[ 990.201085] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3cd7e6a390
[ 990.209894] R13: 0000555ad98766b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.218705]
[ 990.221964] \x0aShowing all locks held in the system:
[ 990.230503] 1 lock held by khungtaskd/184:
[ 990.235893] #0: ffffffff912fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.247364] 2 locks held by systemd-journal/803:
[ 990.253342] #0: ff1100180e8372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.263231] #1: ffffffff91502b20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.276054] 4 locks held by python3/3667:
[ 990.281347] #0: ff1100012f13c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.291234] #1: ff110001763b2680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.302196] #2: ff110001227c4b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.313352] #3: ff11000122801d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.323443] 4 locks held by python3/5718:
[ 990.328730] #0: ff1100012f13c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.338616] #1: ff110001e4148e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.349576] #2: ff110001227c4b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.360729] #3: ff11000122801d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.370817]
[ 990.373283] =============================================\x0a
[ 1112.549607] INFO: task python3:5718 blocked for more than 245 seconds.
[ 1112.557753] Not tainted 7.1.0-rc4-ehha-g02f1b1291a39 #1
[ 1112.565003] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.574594] task:python3 state:D stack:25568 pid:5718 tgid:5718 ppid:5717 task_flags:0x400100 flags:0x00080000
[ 1112.587799] Call Trace:
[ 1112.591340]
[ 1112.594493] __schedule+0xcc3/0x19c0
[ 1112.599308] ? io_schedule_timeout+0x140/0x140
[ 1112.605092] ? find_held_lock+0x2b/0x80
[ 1112.610199] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.616082] schedule+0xd8/0x260
[ 1112.620503] schedule_preempt_disabled+0x18/0x30
[ 1112.626482] __mutex_lock+0x6af/0x2010
[ 1112.631489] ? threaded_store+0x132/0x220
[ 1112.636787] ? ww_mutex_lock+0x160/0x160
[ 1112.641987] ? selinux_inode_free_security+0x330/0x330
[ 1112.648558] ? cap_capable+0x1d6/0x3e0
[ 1112.653568] ? threaded_store+0x132/0x220
[ 1112.658866] threaded_store+0x132/0x220
[ 1112.663972] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.669268] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.674567] ? sysfs_kf_write+0x65/0x160
[ 1112.679766] ? sysfs_file_ops+0x140/0x140
[ 1112.685063] kernfs_fop_write_iter+0x335/0x510
[ 1112.690837] ? kernfs_ops+0xf0/0xf0
[ 1112.695548] new_sync_write+0x333/0x750
[ 1112.700654] ? __lock_acquire+0x508/0xc10
[ 1112.705941] ? new_sync_read+0x740/0x740
[ 1112.711143] ? lock_acquire.part.0+0xbc/0x260
[ 1112.716831] ? ksys_write+0x116/0x250
[ 1112.721740] vfs_write+0x657/0x9b0
[ 1112.726358] ksys_write+0x116/0x250
[ 1112.731070] ? __ia32_sys_read+0xc0/0xc0
[ 1112.736260] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.741849] ? rcu_is_watching+0x15/0xd0
[ 1112.747049] do_syscall_64+0xf3/0x650
[ 1112.751958] ? irq_exit_rcu+0x1a/0x30
[ 1112.756867] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.763333] RIP: 0033:0x7fdabb37d22e
[ 1112.768145] RSP: 002b:00007fff97e0a7b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.777448] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdabb37d22e
[ 1112.786256] RDX: 0000000000000001 RSI: 0000556c8ee266b0 RDI: 0000000000000007
[ 1112.795063] RBP: 00007fff97e0a7c0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.803869] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdabb1f5390
[ 1112.812676] R13: 0000556c8ee266b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.821489]
[ 1112.824783] INFO: task python3:5718 is blocked on a mutex likely owned by task python3:3667.
[ 1112.835057] task:python3 state:D stack:25672 pid:3667 tgid:3667 ppid:3666 task_flags:0x400100 flags:0x00080802
[ 1112.848262] Call Trace:
[ 1112.851801]
[ 1112.854952] __schedule+0xcc3/0x19c0
[ 1112.859755] ? io_schedule_timeout+0x140/0x140
[ 1112.865540] ? find_held_lock+0x2b/0x80
[ 1112.870644] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.876822] schedule+0xd8/0x260
[ 1112.881241] schedule_timeout+0x13f/0x290
[ 1112.886541] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.892912] ? trace_contention_end+0xb3/0x1a0
[ 1112.898695] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.904384] ? ww_mutex_lock+0x160/0x160
[ 1112.909584] msleep+0x1b/0x30
[ 1112.913710] napi_set_threaded+0x3a5/0x440
[ 1112.919099] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.924597] netif_set_threaded+0x257/0x400
[ 1112.930091] threaded_store+0x1b8/0x220
[ 1112.935193] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.940483] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.945769] ? sysfs_kf_write+0x65/0x160
[ 1112.950970] ? sysfs_file_ops+0x140/0x140
[ 1112.956268] kernfs_fop_write_iter+0x335/0x510
[ 1112.962043] ? kernfs_ops+0xf0/0xf0
[ 1112.966754] new_sync_write+0x333/0x750
[ 1112.971857] ? __lock_acquire+0x508/0xc10
[ 1112.977153] ? new_sync_read+0x740/0x740
[ 1112.982355] ? lock_acquire.part.0+0xbc/0x260
[ 1112.988040] ? ksys_write+0x116/0x250
[ 1112.992949] vfs_write+0x657/0x9b0
[ 1112.997565] ksys_write+0x116/0x250
[ 1113.002276] ? __ia32_sys_read+0xc0/0xc0
[ 1113.007475] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.013065] ? rcu_is_watching+0x15/0xd0
[ 1113.018259] do_syscall_64+0xf3/0x650
[ 1113.023167] ? trace_hardirqs_off+0xd/0x30
[ 1113.028564] ? exc_page_fault+0xda/0xf0
[ 1113.033667] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.040135] RIP: 0033:0x7f3cd7ff222e
[ 1113.044945] RSP: 002b:00007ffe519b9110 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.054243] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3cd7ff222e
[ 1113.063051] RDX: 0000000000000001 RSI: 0000555ad98766b0 RDI: 0000000000000007
[ 1113.071851] RBP: 00007ffe519b9120 R08: 0000000000000000 R09: 0000000000000000
[ 1113.080658] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3cd7e6a390
[ 1113.089467] R13: 0000555ad98766b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.098280]
[ 1113.101548] \x0aShowing all locks held in the system:
[ 1113.110088] 1 lock held by khungtaskd/184:
[ 1113.115484] #0: ffffffff912fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.126956] 2 locks held by systemd-journal/803:
[ 1113.132943] 4 locks held by python3/3667:
[ 1113.138240] #0: ff1100012f13c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.148124] #1: ff110001763b2680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.159086] #2: ff110001227c4b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.170245] #3: ff11000122801d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.180338] 4 locks held by python3/5718:
[ 1113.185635] #0: ff1100012f13c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.195525] #1: ff110001e4148e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.206482] #2: ff110001227c4b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.217640] #3: ff11000122801d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.227717] 5 locks held by systemd/6776:
[ 1113.233011] #0: ff1100012fd7c3e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.242899] #1: ff1100014b897a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.253863] #2: ffffffff91369b60 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1113.264533] #3: ffffffff911686f0 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650
[ 1113.276180] #4: ffffffff913698d0 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650
[ 1113.288607]
[ 1113.291073] =============================================\x0a
[ 1235.431743] INFO: task python3:5718 blocked for more than 368 seconds.
[ 1235.439890] Not tainted 7.1.0-rc4-ehha-g02f1b1291a39 #1
[ 1235.447134] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.456729] task:python3 state:D stack:25568 pid:5718 tgid:5718 ppid:5717 task_flags:0x400100 flags:0x00080002
[ 1235.469945] Call Trace:
[ 1235.473487]
[ 1235.476643] __schedule+0xcc3/0x19c0
[ 1235.481463] ? io_schedule_timeout+0x140/0x140
[ 1235.487253] ? find_held_lock+0x2b/0x80
[ 1235.492363] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.498252] schedule+0xd8/0x260
[ 1235.502674] schedule_preempt_disabled+0x18/0x30
[ 1235.508659] __mutex_lock+0x6af/0x2010
[ 1235.513664] ? threaded_store+0x132/0x220
[ 1235.518972] ? ww_mutex_lock+0x160/0x160
[ 1235.524172] ? selinux_inode_free_security+0x330/0x330
[ 1235.530752] ? cap_capable+0x1d6/0x3e0
[ 1235.535762] ? threaded_store+0x132/0x220
[ 1235.541062] threaded_store+0x132/0x220
[ 1235.546167] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.551471] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.556774] ? sysfs_kf_write+0x65/0x160
[ 1235.561977] ? sysfs_file_ops+0x140/0x140
[ 1235.567277] kernfs_fop_write_iter+0x335/0x510
[ 1235.573066] ? kernfs_ops+0xf0/0xf0
[ 1235.577778] new_sync_write+0x333/0x750
[ 1235.582887] ? __lock_acquire+0x508/0xc10
[ 1235.588186] ? new_sync_read+0x740/0x740
[ 1235.593387] ? lock_acquire.part.0+0xbc/0x260
[ 1235.599075] ? ksys_write+0x116/0x250
[ 1235.603986] vfs_write+0x657/0x9b0
[ 1235.608605] ksys_write+0x116/0x250
[ 1235.613322] ? __ia32_sys_read+0xc0/0xc0
[ 1235.618524] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.624118] ? rcu_is_watching+0x15/0xd0
[ 1235.629325] do_syscall_64+0xf3/0x650
[ 1235.634235] ? irq_exit_rcu+0x1a/0x30
[ 1235.639144] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.645612] RIP: 0033:0x7fdabb37d22e
[ 1235.650424] RSP: 002b:00007fff97e0a7b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.659727] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdabb37d22e
[ 1235.668539] RDX: 0000000000000001 RSI: 0000556c8ee266b0 RDI: 0000000000000007
[ 1235.677352] RBP: 00007fff97e0a7c0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.686162] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdabb1f5390
[ 1235.694975] R13: 0000556c8ee266b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.703789]
[ 1235.707063] INFO: task python3:5718 is blocked on a mutex likely owned by task python3:3667.
[ 1235.717333] task:python3 state:D stack:25672 pid:3667 tgid:3667 ppid:3666 task_flags:0x400100 flags:0x00080802
[ 1235.730543] Call Trace:
[ 1235.734083]
[ 1235.737239] __schedule+0xcc3/0x19c0
[ 1235.742056] ? io_schedule_timeout+0x140/0x140
[ 1235.747844] ? find_held_lock+0x2b/0x80
[ 1235.752948] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.759133] schedule+0xd8/0x260
[ 1235.763556] schedule_timeout+0x13f/0x290
[ 1235.768860] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.775233] ? trace_contention_end+0xb3/0x1a0
[ 1235.781021] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.786714] ? ww_mutex_lock+0x160/0x160
[ 1235.791918] msleep+0x1b/0x30
[ 1235.796049] napi_set_threaded+0x3a5/0x440
[ 1235.801451] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.806952] netif_set_threaded+0x257/0x400
[ 1235.812452] threaded_store+0x1b8/0x220
[ 1235.817557] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.822860] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.828162] ? sysfs_kf_write+0x65/0x160
[ 1235.833366] ? sysfs_file_ops+0x140/0x140
[ 1235.838666] kernfs_fop_write_iter+0x335/0x510
[ 1235.844456] ? kernfs_ops+0xf0/0xf0
[ 1235.849169] new_sync_write+0x333/0x750
[ 1235.854276] ? __lock_acquire+0x508/0xc10
[ 1235.859577] ? new_sync_read+0x740/0x740
[ 1235.864783] ? lock_acquire.part.0+0xbc/0x260
[ 1235.870473] ? ksys_write+0x116/0x250
[ 1235.875394] vfs_write+0x657/0x9b0
[ 1235.880012] ksys_write+0x116/0x250
[ 1235.884729] ? __ia32_sys_read+0xc0/0xc0
[ 1235.889930] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.895522] ? rcu_is_watching+0x15/0xd0
[ 1235.900725] do_syscall_64+0xf3/0x650
[ 1235.905633] ? trace_hardirqs_off+0xd/0x30
[ 1235.911032] ? exc_page_fault+0xda/0xf0
[ 1235.916139] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.922609] RIP: 0033:0x7f3cd7ff222e
[ 1235.927419] RSP: 002b:00007ffe519b9110 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.936720] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3cd7ff222e
[ 1235.945537] RDX: 0000000000000001 RSI: 0000555ad98766b0 RDI: 0000000000000007
[ 1235.954350] RBP: 00007ffe519b9120 R08: 0000000000000000 R09: 0000000000000000
[ 1235.963163] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3cd7e6a390
[ 1235.971975] R13: 0000555ad98766b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.980797]
[ 1235.984065] \x0aShowing all locks held in the system:
[ 1235.992614] 1 lock held by khungtaskd/184:
[ 1235.998011] #0: ffffffff912fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.009494] 2 locks held by systemd-journal/803:
[ 1236.015475] #0: ff1100180e7b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.025372] #1: ffffffff91502b20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: dput.part.0+0x2fd/0x410
[ 1236.037619] 4 locks held by python3/3667:
[ 1236.042916] #0: ff1100012f13c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.052813] #1: ff110001763b2680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.063783] #2: ff110001227c4b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.074951] #3: ff11000122801d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.085052] 4 locks held by python3/5718:
[ 1236.090350] #0: ff1100012f13c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.100248] #1: ff110001e4148e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.111219] #2: ff110001227c4b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.122381] #3: ff11000122801d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.132479]
[ 1236.134950] =============================================\x0a
[ 1358.312929] INFO: task python3:5718 blocked for more than 491 seconds.
[ 1358.321087] Not tainted 7.1.0-rc4-ehha-g02f1b1291a39 #1
[ 1358.328339] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.337931] task:python3 state:D stack:25568 pid:5718 tgid:5718 ppid:5717 task_flags:0x400100 flags:0x00080002
[ 1358.351137] Call Trace:
[ 1358.354677]
[ 1358.357829] __schedule+0xcc3/0x19c0
[ 1358.362648] ? io_schedule_timeout+0x140/0x140
[ 1358.368431] ? find_held_lock+0x2b/0x80
[ 1358.373541] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.379438] schedule+0xd8/0x260
[ 1358.383862] schedule_preempt_disabled+0x18/0x30
[ 1358.389926] __mutex_lock+0x6af/0x2010
[ 1358.394931] ? threaded_store+0x132/0x220
[ 1358.400232] ? ww_mutex_lock+0x160/0x160
[ 1358.405432] ? selinux_inode_free_security+0x330/0x330
[ 1358.412005] ? cap_capable+0x1d6/0x3e0
[ 1358.417014] ? threaded_store+0x132/0x220
[ 1358.422313] threaded_store+0x132/0x220
[ 1358.427482] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.432780] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.438082] ? sysfs_kf_write+0x65/0x160
[ 1358.443283] ? sysfs_file_ops+0x140/0x140
[ 1358.448578] kernfs_fop_write_iter+0x335/0x510
[ 1358.454363] ? kernfs_ops+0xf0/0xf0
[ 1358.459074] new_sync_write+0x333/0x750
[ 1358.464169] ? __lock_acquire+0x508/0xc10
[ 1358.469467] ? new_sync_read+0x740/0x740
[ 1358.474735] ? lock_acquire.part.0+0xbc/0x260
[ 1358.480420] ? ksys_write+0x116/0x250
[ 1358.485332] vfs_write+0x657/0x9b0
[ 1358.489949] ksys_write+0x116/0x250
[ 1358.494662] ? __ia32_sys_read+0xc0/0xc0
[ 1358.499861] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.505455] ? rcu_is_watching+0x15/0xd0
[ 1358.510659] do_syscall_64+0xf3/0x650
[ 1358.515567] ? irq_exit_rcu+0x1a/0x30
[ 1358.520477] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.526943] RIP: 0033:0x7fdabb37d22e
[ 1358.531756] RSP: 002b:00007fff97e0a7b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.541054] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdabb37d22e
[ 1358.549861] RDX: 0000000000000001 RSI: 0000556c8ee266b0 RDI: 0000000000000007
[ 1358.558673] RBP: 00007fff97e0a7c0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.567483] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdabb1f5390
[ 1358.576294] R13: 0000556c8ee266b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.585109]
[ 1358.588386] INFO: task python3:5718 is blocked on a mutex likely owned by task python3:3667.
[ 1358.598662] task:python3 state:D stack:25672 pid:3667 tgid:3667 ppid:3666 task_flags:0x400100 flags:0x00080802
[ 1358.611859] Call Trace:
[ 1358.615396]
[ 1358.618547] __schedule+0xcc3/0x19c0
[ 1358.623360] ? io_schedule_timeout+0x140/0x140
[ 1358.629146] ? find_held_lock+0x2b/0x80
[ 1358.634250] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.640431] schedule+0xd8/0x260
[ 1358.644850] schedule_timeout+0x13f/0x290
[ 1358.650150] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.656521] ? trace_contention_end+0xb3/0x1a0
[ 1358.662306] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.667986] ? ww_mutex_lock+0x160/0x160
[ 1358.673179] msleep+0x1b/0x30
[ 1358.677373] napi_set_threaded+0x3a5/0x440
[ 1358.682768] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.688266] netif_set_threaded+0x257/0x400
[ 1358.693765] threaded_store+0x1b8/0x220
[ 1358.698932] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.704234] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.709599] ? sysfs_kf_write+0x65/0x160
[ 1358.714802] ? sysfs_file_ops+0x140/0x140
[ 1358.720099] kernfs_fop_write_iter+0x335/0x510
[ 1358.725876] ? kernfs_ops+0xf0/0xf0
[ 1358.730588] new_sync_write+0x333/0x750
[ 1358.735689] ? __lock_acquire+0x508/0xc10
[ 1358.740986] ? new_sync_read+0x740/0x740
[ 1358.746177] ? lock_acquire.part.0+0xbc/0x260
[ 1358.751855] ? ksys_write+0x116/0x250
[ 1358.756765] vfs_write+0x657/0x9b0
[ 1358.761380] ksys_write+0x116/0x250
[ 1358.766084] ? __ia32_sys_read+0xc0/0xc0
[ 1358.771285] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.776876] ? rcu_is_watching+0x15/0xd0
[ 1358.782076] do_syscall_64+0xf3/0x650
[ 1358.786981] ? trace_hardirqs_off+0xd/0x30
[ 1358.792442] ? exc_page_fault+0xda/0xf0
[ 1358.797545] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.804011] RIP: 0033:0x7f3cd7ff222e
[ 1358.808821] RSP: 002b:00007ffe519b9110 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.818124] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3cd7ff222e
[ 1358.826930] RDX: 0000000000000001 RSI: 0000555ad98766b0 RDI: 0000000000000007
[ 1358.835741] RBP: 00007ffe519b9120 R08: 0000000000000000 R09: 0000000000000000
[ 1358.844551] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3cd7e6a390
[ 1358.853360] R13: 0000555ad98766b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.862245]
[ 1358.865517] \x0aShowing all locks held in the system:
[ 1358.874061] 1 lock held by khungtaskd/184:
[ 1358.879457] #0: ffffffff912fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.890942] 4 locks held by python3/3667:
[ 1358.896238] #0: ff1100012f13c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.906132] #1: ff110001763b2680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.917095] #2: ff110001227c4b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.928255] #3: ff11000122801d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.938347] 4 locks held by python3/5718:
[ 1358.943643] #0: ff1100012f13c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.953530] #1: ff110001e4148e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.964492] #2: ff110001227c4b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.975652] #3: ff11000122801d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.985749]
[ 1358.988215] =============================================\x0a