[ 788.344588] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 788.347536] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 788.498315] kselftest: Running tests in drivers/net
[ 989.715324] INFO: task python3:5848 blocked for more than 122 seconds.
[ 989.723556] Not tainted 7.1.0-rc4-nquv-ge509ba3168f2 #1
[ 989.731438] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.741027] task:python3 state:D stack:25672 pid:5848 tgid:5848 ppid:5847 task_flags:0x400100 flags:0x00080000
[ 989.754235] Call Trace:
[ 989.757777]
[ 989.760928] __schedule+0xcc3/0x19c0
[ 989.765745] ? io_schedule_timeout+0x140/0x140
[ 989.771532] ? find_held_lock+0x2b/0x80
[ 989.776637] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.782513] schedule+0xd8/0x260
[ 989.786930] schedule_preempt_disabled+0x18/0x30
[ 989.792912] __mutex_lock+0x6af/0x2010
[ 989.797916] ? threaded_store+0x132/0x220
[ 989.803208] ? ww_mutex_lock+0x160/0x160
[ 989.808408] ? selinux_inode_free_security+0x330/0x330
[ 989.814980] ? cap_capable+0x1d6/0x3e0
[ 989.819991] ? threaded_store+0x132/0x220
[ 989.825292] threaded_store+0x132/0x220
[ 989.830397] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.835697] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.840996] ? sysfs_kf_write+0x65/0x160
[ 989.846198] ? sysfs_file_ops+0x140/0x140
[ 989.851495] kernfs_fop_write_iter+0x335/0x510
[ 989.857271] ? kernfs_ops+0xf0/0xf0
[ 989.861983] new_sync_write+0x333/0x750
[ 989.867088] ? __lock_acquire+0x508/0xc10
[ 989.872385] ? new_sync_read+0x740/0x740
[ 989.877579] ? lock_acquire.part.0+0xbc/0x260
[ 989.883267] ? ksys_write+0x116/0x250
[ 989.888179] vfs_write+0x657/0x9b0
[ 989.892794] ksys_write+0x116/0x250
[ 989.897499] ? __ia32_sys_read+0xc0/0xc0
[ 989.902698] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.908288] ? rcu_is_watching+0x15/0xd0
[ 989.913489] do_syscall_64+0xf3/0x650
[ 989.918395] ? trace_hardirqs_off+0xd/0x30
[ 989.923784] ? exc_page_fault+0xda/0xf0
[ 989.928889] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.935363] RIP: 0033:0x7fcc96f9d22e
[ 989.940173] RSP: 002b:00007fff20af7730 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.949472] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcc96f9d22e
[ 989.958280] RDX: 0000000000000001 RSI: 000055a73ed686b0 RDI: 0000000000000007
[ 989.967090] RBP: 00007fff20af7740 R08: 0000000000000000 R09: 0000000000000000
[ 989.975900] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcc96e15390
[ 989.984710] R13: 000055a73ed686b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.993525]
[ 989.996824] INFO: task python3:5848 is blocked on a mutex likely owned by task python3:3787.
[ 990.007095] task:python3 state:D stack:25672 pid:3787 tgid:3787 ppid:3786 task_flags:0x400100 flags:0x00080802
[ 990.020297] Call Trace:
[ 990.023836]
[ 990.026990] __schedule+0xcc3/0x19c0
[ 990.031803] ? io_schedule_timeout+0x140/0x140
[ 990.037588] ? find_held_lock+0x2b/0x80
[ 990.042694] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.048872] schedule+0xd8/0x260
[ 990.053291] schedule_timeout+0x13f/0x290
[ 990.058579] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.064949] ? trace_contention_end+0xb3/0x1a0
[ 990.070733] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.076425] ? ww_mutex_lock+0x160/0x160
[ 990.081626] msleep+0x1b/0x30
[ 990.085753] napi_set_threaded+0x3a5/0x440
[ 990.091147] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.096643] netif_set_threaded+0x257/0x400
[ 990.102138] threaded_store+0x1b8/0x220
[ 990.107241] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.112539] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.117826] ? sysfs_kf_write+0x65/0x160
[ 990.123027] ? sysfs_file_ops+0x140/0x140
[ 990.128324] kernfs_fop_write_iter+0x335/0x510
[ 990.134103] ? kernfs_ops+0xf0/0xf0
[ 990.138815] new_sync_write+0x333/0x750
[ 990.143918] ? __lock_acquire+0x508/0xc10
[ 990.149205] ? new_sync_read+0x740/0x740
[ 990.154408] ? lock_acquire.part.0+0xbc/0x260
[ 990.160094] ? ksys_write+0x116/0x250
[ 990.165004] vfs_write+0x657/0x9b0
[ 990.169621] ksys_write+0x116/0x250
[ 990.174333] ? __ia32_sys_read+0xc0/0xc0
[ 990.179531] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.185120] ? rcu_is_watching+0x15/0xd0
[ 990.190320] do_syscall_64+0xf3/0x650
[ 990.195225] ? irq_exit_rcu+0x1a/0x30
[ 990.200134] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.206603] RIP: 0033:0x7f25b475d22e
[ 990.211414] RSP: 002b:00007ffe04f340e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.220712] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25b475d22e
[ 990.229521] RDX: 0000000000000001 RSI: 00005604d48066b0 RDI: 0000000000000007
[ 990.238331] RBP: 00007ffe04f340f0 R08: 0000000000000000 R09: 0000000000000000
[ 990.247140] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25b45d5390
[ 990.255948] R13: 00005604d48066b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.264762]
[ 990.268023] \x0aShowing all locks held in the system:
[ 990.276563] 1 lock held by khungtaskd/185:
[ 990.281955] #0: ffffffffbb6fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.293438] 4 locks held by python3/3787:
[ 990.298725] #0: ff110001300cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.308616] #1: ff1100017277f480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.319575] #2: ff110001236d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.330731] #3: ff11000123719d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.340829] 4 locks held by python3/5848:
[ 990.346126] #0: ff110001300cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.356016] #1: ff1100012ce85080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.366977] #2: ff110001236d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.378138] #3: ff11000123719d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.388228]
[ 990.390696] =============================================\x0a
[ 1112.596549] INFO: task python3:5848 blocked for more than 245 seconds.
[ 1112.604697] Not tainted 7.1.0-rc4-nquv-ge509ba3168f2 #1
[ 1112.611947] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.621536] task:python3 state:D stack:25672 pid:5848 tgid:5848 ppid:5847 task_flags:0x400100 flags:0x00080000
[ 1112.634743] Call Trace:
[ 1112.638283]
[ 1112.641507] __schedule+0xcc3/0x19c0
[ 1112.646323] ? io_schedule_timeout+0x140/0x140
[ 1112.646328] ? find_held_lock+0x2b/0x80
[ 1112.646334] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.646340] schedule+0xd8/0x260
[ 1112.646343] schedule_preempt_disabled+0x18/0x30
[ 1112.646345] __mutex_lock+0x6af/0x2010
[ 1112.646349] ? threaded_store+0x132/0x220
[ 1112.683854] ? ww_mutex_lock+0x160/0x160
[ 1112.689054] ? selinux_inode_free_security+0x330/0x330
[ 1112.695625] ? cap_capable+0x1d6/0x3e0
[ 1112.700635] ? threaded_store+0x132/0x220
[ 1112.705933] threaded_store+0x132/0x220
[ 1112.711036] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.716337] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.721636] ? sysfs_kf_write+0x65/0x160
[ 1112.726829] ? sysfs_file_ops+0x140/0x140
[ 1112.732127] kernfs_fop_write_iter+0x335/0x510
[ 1112.737902] ? kernfs_ops+0xf0/0xf0
[ 1112.742614] new_sync_write+0x333/0x750
[ 1112.747716] ? __lock_acquire+0x508/0xc10
[ 1112.753013] ? new_sync_read+0x740/0x740
[ 1112.758217] ? lock_acquire.part.0+0xbc/0x260
[ 1112.763904] ? ksys_write+0x116/0x250
[ 1112.768814] vfs_write+0x657/0x9b0
[ 1112.773432] ksys_write+0x116/0x250
[ 1112.778143] ? __ia32_sys_read+0xc0/0xc0
[ 1112.783341] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.788929] ? rcu_is_watching+0x15/0xd0
[ 1112.794122] do_syscall_64+0xf3/0x650
[ 1112.799028] ? trace_hardirqs_off+0xd/0x30
[ 1112.804416] ? exc_page_fault+0xda/0xf0
[ 1112.809513] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.815983] RIP: 0033:0x7fcc96f9d22e
[ 1112.820795] RSP: 002b:00007fff20af7730 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.830094] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcc96f9d22e
[ 1112.838904] RDX: 0000000000000001 RSI: 000055a73ed686b0 RDI: 0000000000000007
[ 1112.847715] RBP: 00007fff20af7740 R08: 0000000000000000 R09: 0000000000000000
[ 1112.856525] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcc96e15390
[ 1112.865336] R13: 000055a73ed686b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.874151]
[ 1112.877445] INFO: task python3:5848 is blocked on a mutex likely owned by task python3:3787.
[ 1112.887721] task:python3 state:D stack:25672 pid:3787 tgid:3787 ppid:3786 task_flags:0x400100 flags:0x00080802
[ 1112.900914] Call Trace:
[ 1112.904454]
[ 1112.907603] __schedule+0xcc3/0x19c0
[ 1112.912416] ? io_schedule_timeout+0x140/0x140
[ 1112.918202] ? find_held_lock+0x2b/0x80
[ 1112.923309] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.929486] schedule+0xd8/0x260
[ 1112.933905] schedule_timeout+0x13f/0x290
[ 1112.939193] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.945563] ? trace_contention_end+0xb3/0x1a0
[ 1112.951341] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.957035] ? ww_mutex_lock+0x160/0x160
[ 1112.962235] msleep+0x1b/0x30
[ 1112.966362] napi_set_threaded+0x3a5/0x440
[ 1112.971758] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.977253] netif_set_threaded+0x257/0x400
[ 1112.982747] threaded_store+0x1b8/0x220
[ 1112.987849] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.993148] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.998444] ? sysfs_kf_write+0x65/0x160
[ 1113.003646] ? sysfs_file_ops+0x140/0x140
[ 1113.008943] kernfs_fop_write_iter+0x335/0x510
[ 1113.014721] ? kernfs_ops+0xf0/0xf0
[ 1113.019433] new_sync_write+0x333/0x750
[ 1113.024537] ? __lock_acquire+0x508/0xc10
[ 1113.029833] ? new_sync_read+0x740/0x740
[ 1113.035034] ? lock_acquire.part.0+0xbc/0x260
[ 1113.040721] ? ksys_write+0x116/0x250
[ 1113.045622] vfs_write+0x657/0x9b0
[ 1113.050239] ksys_write+0x116/0x250
[ 1113.054954] ? __ia32_sys_read+0xc0/0xc0
[ 1113.060153] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.065744] ? rcu_is_watching+0x15/0xd0
[ 1113.070943] do_syscall_64+0xf3/0x650
[ 1113.075852] ? irq_exit_rcu+0x1a/0x30
[ 1113.080761] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.087221] RIP: 0033:0x7f25b475d22e
[ 1113.092030] RSP: 002b:00007ffe04f340e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.101327] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25b475d22e
[ 1113.110137] RDX: 0000000000000001 RSI: 00005604d48066b0 RDI: 0000000000000007
[ 1113.118946] RBP: 00007ffe04f340f0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.127756] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25b45d5390
[ 1113.136565] R13: 00005604d48066b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.145386]
[ 1113.148646] \x0aShowing all locks held in the system:
[ 1113.157187] 1 lock held by khungtaskd/185:
[ 1113.162579] #0: ffffffffbb6fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.174051] 2 locks held by systemd-journal/803:
[ 1113.180032] #0: ff1100180e2372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1113.189921] #1: ffffffffbb9029a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.202746] 4 locks held by python3/3787:
[ 1113.208040] #0: ff110001300cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.217927] #1: ff1100017277f480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.228891] #2: ff110001236d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.240049] #3: ff11000123719d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.250147] 4 locks held by python3/5848:
[ 1113.255443] #0: ff110001300cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.265332] #1: ff1100012ce85080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.276296] #2: ff110001236d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.287454] #3: ff11000123719d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.297544] 5 locks held by (systemd-user-)/6893:
[ 1113.303610] #0: ff110001302343e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.313497] #1: ff1100018d5b8e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.324458] #2: ffffffffbb769b60 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1113.335121] #3: ffffffffbb5686f0 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650
[ 1113.346765] #4: ffffffffbb7698d0 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650
[ 1113.359182]
[ 1113.361647] =============================================\x0a
[ 1235.477662] INFO: task python3:5848 blocked for more than 368 seconds.
[ 1235.485809] Not tainted 7.1.0-rc4-nquv-ge509ba3168f2 #1
[ 1235.493058] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.502647] task:python3 state:D stack:25672 pid:5848 tgid:5848 ppid:5847 task_flags:0x400100 flags:0x00080002
[ 1235.515842] Call Trace:
[ 1235.519381]
[ 1235.522529] __schedule+0xcc3/0x19c0
[ 1235.527345] ? io_schedule_timeout+0x140/0x140
[ 1235.533131] ? find_held_lock+0x2b/0x80
[ 1235.538236] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.544120] schedule+0xd8/0x260
[ 1235.548535] schedule_preempt_disabled+0x18/0x30
[ 1235.554515] __mutex_lock+0x6af/0x2010
[ 1235.559513] ? threaded_store+0x132/0x220
[ 1235.564814] ? ww_mutex_lock+0x160/0x160
[ 1235.570011] ? selinux_inode_free_security+0x330/0x330
[ 1235.576581] ? cap_capable+0x1d6/0x3e0
[ 1235.581588] ? threaded_store+0x132/0x220
[ 1235.586885] threaded_store+0x132/0x220
[ 1235.591989] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.597287] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.602584] ? sysfs_kf_write+0x65/0x160
[ 1235.607785] ? sysfs_file_ops+0x140/0x140
[ 1235.613071] kernfs_fop_write_iter+0x335/0x510
[ 1235.618852] ? kernfs_ops+0xf0/0xf0
[ 1235.623562] new_sync_write+0x333/0x750
[ 1235.628662] ? __lock_acquire+0x508/0xc10
[ 1235.633956] ? new_sync_read+0x740/0x740
[ 1235.639158] ? lock_acquire.part.0+0xbc/0x260
[ 1235.644843] ? ksys_write+0x116/0x250
[ 1235.649752] vfs_write+0x657/0x9b0
[ 1235.654368] ksys_write+0x116/0x250
[ 1235.659080] ? __ia32_sys_read+0xc0/0xc0
[ 1235.664271] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.669861] ? rcu_is_watching+0x15/0xd0
[ 1235.675062] do_syscall_64+0xf3/0x650
[ 1235.679965] ? trace_hardirqs_off+0xd/0x30
[ 1235.685360] ? exc_page_fault+0xda/0xf0
[ 1235.690462] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.696918] RIP: 0033:0x7fcc96f9d22e
[ 1235.701727] RSP: 002b:00007fff20af7730 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.711015] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcc96f9d22e
[ 1235.719824] RDX: 0000000000000001 RSI: 000055a73ed686b0 RDI: 0000000000000007
[ 1235.728628] RBP: 00007fff20af7740 R08: 0000000000000000 R09: 0000000000000000
[ 1235.737432] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcc96e15390
[ 1235.746239] R13: 000055a73ed686b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.755052]
[ 1235.758339] INFO: task python3:5848 is blocked on a mutex likely owned by task python3:3787.
[ 1235.768611] task:python3 state:D stack:25672 pid:3787 tgid:3787 ppid:3786 task_flags:0x400100 flags:0x00080802
[ 1235.781812] Call Trace:
[ 1235.785351]
[ 1235.788498] __schedule+0xcc3/0x19c0
[ 1235.793311] ? io_schedule_timeout+0x140/0x140
[ 1235.799095] ? find_held_lock+0x2b/0x80
[ 1235.804199] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.810377] schedule+0xd8/0x260
[ 1235.814795] schedule_timeout+0x13f/0x290
[ 1235.820090] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.826460] ? trace_contention_end+0xb3/0x1a0
[ 1235.832242] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.837930] ? ww_mutex_lock+0x160/0x160
[ 1235.843130] msleep+0x1b/0x30
[ 1235.847256] napi_set_threaded+0x3a5/0x440
[ 1235.852651] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.858144] netif_set_threaded+0x257/0x400
[ 1235.863639] threaded_store+0x1b8/0x220
[ 1235.868741] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.874040] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.879335] ? sysfs_kf_write+0x65/0x160
[ 1235.884535] ? sysfs_file_ops+0x140/0x140
[ 1235.889822] kernfs_fop_write_iter+0x335/0x510
[ 1235.895605] ? kernfs_ops+0xf0/0xf0
[ 1235.900315] new_sync_write+0x333/0x750
[ 1235.905418] ? __lock_acquire+0x508/0xc10
[ 1235.910705] ? new_sync_read+0x740/0x740
[ 1235.915902] ? lock_acquire.part.0+0xbc/0x260
[ 1235.921585] ? ksys_write+0x116/0x250
[ 1235.926496] vfs_write+0x657/0x9b0
[ 1235.931111] ksys_write+0x116/0x250
[ 1235.935820] ? __ia32_sys_read+0xc0/0xc0
[ 1235.941018] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.946605] ? rcu_is_watching+0x15/0xd0
[ 1235.951804] do_syscall_64+0xf3/0x650
[ 1235.956710] ? irq_exit_rcu+0x1a/0x30
[ 1235.961615] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.968078] RIP: 0033:0x7f25b475d22e
[ 1235.972883] RSP: 002b:00007ffe04f340e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.982180] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25b475d22e
[ 1235.990986] RDX: 0000000000000001 RSI: 00005604d48066b0 RDI: 0000000000000007
[ 1235.999790] RBP: 00007ffe04f340f0 R08: 0000000000000000 R09: 0000000000000000
[ 1236.008596] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25b45d5390
[ 1236.017404] R13: 00005604d48066b0 R14: 0000000000000007 R15: 0000000000000003
[ 1236.026209]
[ 1236.029474] \x0aShowing all locks held in the system:
[ 1236.038010] 1 lock held by khungtaskd/185:
[ 1236.043403] #0: ffffffffbb6fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.054875] 2 locks held by systemd-journal/803:
[ 1236.060852] #0: ff1100180e6b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.070739] #1: ff110001a23de378 (&mm->mmap_lock){++++}-{4:4}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.081511] 4 locks held by python3/3787:
[ 1236.086806] #0: ff110001300cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.096692] #1: ff1100017277f480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.107654] #2: ff110001236d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.118810] #3: ff11000123719d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.128904] 4 locks held by python3/5848:
[ 1236.134198] #0: ff110001300cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.144085] #1: ff1100012ce85080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.155045] #2: ff110001236d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.166200] #3: ff11000123719d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.176288]
[ 1236.178753] =============================================\x0a
[ 1358.358771] INFO: task python3:5848 blocked for more than 491 seconds.
[ 1358.366918] Not tainted 7.1.0-rc4-nquv-ge509ba3168f2 #1
[ 1358.374172] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.383767] task:python3 state:D stack:25672 pid:5848 tgid:5848 ppid:5847 task_flags:0x400100 flags:0x00080002
[ 1358.396981] Call Trace:
[ 1358.400521]
[ 1358.403677] __schedule+0xcc3/0x19c0
[ 1358.408498] ? io_schedule_timeout+0x140/0x140
[ 1358.414288] ? find_held_lock+0x2b/0x80
[ 1358.419396] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.425290] schedule+0xd8/0x260
[ 1358.429711] schedule_preempt_disabled+0x18/0x30
[ 1358.435695] __mutex_lock+0x6af/0x2010
[ 1358.440703] ? threaded_store+0x132/0x220
[ 1358.446010] ? ww_mutex_lock+0x160/0x160
[ 1358.451204] ? selinux_inode_free_security+0x330/0x330
[ 1358.457784] ? cap_capable+0x1d6/0x3e0
[ 1358.462797] ? threaded_store+0x132/0x220
[ 1358.468098] threaded_store+0x132/0x220
[ 1358.473207] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.478508] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.483812] ? sysfs_kf_write+0x65/0x160
[ 1358.489018] ? sysfs_file_ops+0x140/0x140
[ 1358.494319] kernfs_fop_write_iter+0x335/0x510
[ 1358.500108] ? kernfs_ops+0xf0/0xf0
[ 1358.504822] new_sync_write+0x333/0x750
[ 1358.509932] ? __lock_acquire+0x508/0xc10
[ 1358.515234] ? new_sync_read+0x740/0x740
[ 1358.520444] ? lock_acquire.part.0+0xbc/0x260
[ 1358.526134] ? ksys_write+0x116/0x250
[ 1358.531055] vfs_write+0x657/0x9b0
[ 1358.535672] ksys_write+0x116/0x250
[ 1358.540388] ? __ia32_sys_read+0xc0/0xc0
[ 1358.545593] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.551188] ? rcu_is_watching+0x15/0xd0
[ 1358.556393] do_syscall_64+0xf3/0x650
[ 1358.561303] ? trace_hardirqs_off+0xd/0x30
[ 1358.566704] ? exc_page_fault+0xda/0xf0
[ 1358.571812] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.578285] RIP: 0033:0x7fcc96f9d22e
[ 1358.583098] RSP: 002b:00007fff20af7730 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.592400] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcc96f9d22e
[ 1358.601214] RDX: 0000000000000001 RSI: 000055a73ed686b0 RDI: 0000000000000007
[ 1358.610025] RBP: 00007fff20af7740 R08: 0000000000000000 R09: 0000000000000000
[ 1358.618841] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcc96e15390
[ 1358.627653] R13: 000055a73ed686b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.636478]
[ 1358.639795] INFO: task python3:5848 is blocked on a mutex likely owned by task python3:3787.
[ 1358.650078] task:python3 state:D stack:25672 pid:3787 tgid:3787 ppid:3786 task_flags:0x400100 flags:0x00080802
[ 1358.663288] Call Trace:
[ 1358.666828]
[ 1358.669981] __schedule+0xcc3/0x19c0
[ 1358.674798] ? io_schedule_timeout+0x140/0x140
[ 1358.680587] ? find_held_lock+0x2b/0x80
[ 1358.685698] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.691881] schedule+0xd8/0x260
[ 1358.696303] schedule_timeout+0x13f/0x290
[ 1358.701675] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.708050] ? trace_contention_end+0xb3/0x1a0
[ 1358.713839] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.719536] ? ww_mutex_lock+0x160/0x160
[ 1358.724738] msleep+0x1b/0x30
[ 1358.728867] napi_set_threaded+0x3a5/0x440
[ 1358.734269] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.739772] netif_set_threaded+0x257/0x400
[ 1358.745268] threaded_store+0x1b8/0x220
[ 1358.750375] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.755678] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.760980] ? sysfs_kf_write+0x65/0x160
[ 1358.766182] ? sysfs_file_ops+0x140/0x140
[ 1358.771483] kernfs_fop_write_iter+0x335/0x510
[ 1358.777271] ? kernfs_ops+0xf0/0xf0
[ 1358.781989] new_sync_write+0x333/0x750
[ 1358.787177] ? __lock_acquire+0x508/0xc10
[ 1358.792478] ? new_sync_read+0x740/0x740
[ 1358.797681] ? lock_acquire.part.0+0xbc/0x260
[ 1358.803369] ? ksys_write+0x116/0x250
[ 1358.808285] vfs_write+0x657/0x9b0
[ 1358.812909] ksys_write+0x116/0x250
[ 1358.817627] ? __ia32_sys_read+0xc0/0xc0
[ 1358.822832] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.828426] ? rcu_is_watching+0x15/0xd0
[ 1358.833634] do_syscall_64+0xf3/0x650
[ 1358.838547] ? irq_exit_rcu+0x1a/0x30
[ 1358.843459] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.849931] RIP: 0033:0x7f25b475d22e
[ 1358.854865] RSP: 002b:00007ffe04f340e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.864169] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f25b475d22e
[ 1358.872981] RDX: 0000000000000001 RSI: 00005604d48066b0 RDI: 0000000000000007
[ 1358.881797] RBP: 00007ffe04f340f0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.890607] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f25b45d5390
[ 1358.899419] R13: 00005604d48066b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.908246]
[ 1358.911515] \x0aShowing all locks held in the system:
[ 1358.920068] 1 lock held by khungtaskd/185:
[ 1358.925465] #0: ffffffffbb6fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.936962] 4 locks held by python3/3787:
[ 1358.942262] #0: ff110001300cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.952161] #1: ff1100017277f480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.963130] #2: ff110001236d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.974360] #3: ff11000123719d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.984466] 4 locks held by python3/5848:
[ 1358.989766] #0: ff110001300cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.999653] #1: ff1100012ce85080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.010627] #2: ff110001236d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.021793] #3: ff11000123719d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.031893] 1 lock held by systemd/7688:
[ 1359.037098]
[ 1359.039568] =============================================\x0a