[ 784.313495] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 784.315914] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 784.472093] kselftest: Running tests in drivers/net
[ 989.635087] INFO: task python3:5817 blocked for more than 122 seconds.
[ 989.643291] Not tainted 7.1.0-rc3-gwzx-gf524823000d3 #1
[ 989.651014] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.660605] task:python3 state:D stack:25672 pid:5817 tgid:5817 ppid:5816 task_flags:0x400100 flags:0x00080000
[ 989.673811] Call Trace:
[ 989.677349]
[ 989.680500] __schedule+0xcc3/0x19c0
[ 989.685319] ? io_schedule_timeout+0x140/0x140
[ 989.691100] ? find_held_lock+0x2b/0x80
[ 989.696203] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.702087] schedule+0xd4/0x260
[ 989.706503] schedule_preempt_disabled+0x18/0x30
[ 989.712478] __mutex_lock+0x6a3/0x2000
[ 989.717481] ? threaded_store+0x132/0x220
[ 989.722778] ? ww_mutex_lock+0x160/0x160
[ 989.727976] ? selinux_inode_free_security+0x330/0x330
[ 989.734546] ? cap_capable+0x1d6/0x3e0
[ 989.739555] ? threaded_store+0x132/0x220
[ 989.744850] threaded_store+0x132/0x220
[ 989.749951] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.755248] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.760548] ? sysfs_kf_write+0x65/0x160
[ 989.765748] ? sysfs_file_ops+0x140/0x140
[ 989.771044] kernfs_fop_write_iter+0x335/0x510
[ 989.776826] ? kernfs_ops+0xf0/0xf0
[ 989.781537] new_sync_write+0x333/0x750
[ 989.786641] ? __lock_acquire+0x508/0xc10
[ 989.791938] ? new_sync_read+0x740/0x740
[ 989.797135] ? lock_acquire.part.0+0xbc/0x260
[ 989.802821] ? ksys_write+0x116/0x250
[ 989.807730] vfs_write+0x657/0x9b0
[ 989.812343] ksys_write+0x116/0x250
[ 989.817055] ? __ia32_sys_read+0xc0/0xc0
[ 989.822245] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.827832] ? rcu_is_watching+0x15/0xd0
[ 989.833031] do_syscall_64+0xf3/0x650
[ 989.837936] ? trace_hardirqs_off+0xd/0x30
[ 989.843330] ? exc_page_fault+0xda/0xf0
[ 989.848433] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.854900] RIP: 0033:0x7f37f656222e
[ 989.859702] RSP: 002b:00007ffd2aa9d0f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.869000] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f37f656222e
[ 989.877808] RDX: 0000000000000001 RSI: 00005614c63f8cd0 RDI: 0000000000000007
[ 989.886613] RBP: 00007ffd2aa9d100 R08: 0000000000000000 R09: 0000000000000000
[ 989.895420] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f37f63da390
[ 989.904225] R13: 00005614c63f8cd0 R14: 0000000000000007 R15: 0000000000000003
[ 989.913046]
[ 989.916347] INFO: task python3:5817 is blocked on a mutex likely owned by task python3:3814.
[ 989.926617] task:python3 state:D stack:25672 pid:3814 tgid:3814 ppid:3813 task_flags:0x400100 flags:0x00080802
[ 989.939820] Call Trace:
[ 989.943356]
[ 989.946508] __schedule+0xcc3/0x19c0
[ 989.951316] ? io_schedule_timeout+0x140/0x140
[ 989.957100] ? find_held_lock+0x2b/0x80
[ 989.962201] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.968378] schedule+0xd4/0x260
[ 989.972795] schedule_timeout+0x13f/0x290
[ 989.978092] ? hrtimer_nanosleep_restart+0x270/0x270
[ 989.984458] ? trace_contention_end+0xb3/0x1a0
[ 989.990241] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 989.995934] ? ww_mutex_lock+0x160/0x160
[ 990.001131] msleep+0x1b/0x30
[ 990.005257] napi_set_threaded+0x3a5/0x440
[ 990.010651] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.016144] netif_set_threaded+0x257/0x400
[ 990.021625] threaded_store+0x1b8/0x220
[ 990.026725] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.032023] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.037310] ? sysfs_kf_write+0x65/0x160
[ 990.042507] ? sysfs_file_ops+0x140/0x140
[ 990.047800] kernfs_fop_write_iter+0x335/0x510
[ 990.053585] ? kernfs_ops+0xf0/0xf0
[ 990.058296] new_sync_write+0x333/0x750
[ 990.063396] ? __lock_acquire+0x508/0xc10
[ 990.068693] ? new_sync_read+0x740/0x740
[ 990.073894] ? lock_acquire.part.0+0xbc/0x260
[ 990.079569] ? ksys_write+0x116/0x250
[ 990.084478] vfs_write+0x657/0x9b0
[ 990.089091] ksys_write+0x116/0x250
[ 990.093801] ? __ia32_sys_read+0xc0/0xc0
[ 990.099001] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.104591] ? rcu_is_watching+0x15/0xd0
[ 990.109780] do_syscall_64+0xf3/0x650
[ 990.114685] ? trace_hardirqs_off+0xd/0x30
[ 990.120077] ? exc_page_fault+0xda/0xf0
[ 990.125176] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.131641] RIP: 0033:0x7f772adb622e
[ 990.136448] RSP: 002b:00007ffe395c7b80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.145741] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f772adb622e
[ 990.154548] RDX: 0000000000000001 RSI: 000055b1c3ef0cd0 RDI: 0000000000000007
[ 990.163355] RBP: 00007ffe395c7b90 R08: 0000000000000000 R09: 0000000000000000
[ 990.172162] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f772ac2e390
[ 990.180969] R13: 000055b1c3ef0cd0 R14: 0000000000000007 R15: 0000000000000003
[ 990.189778]
[ 990.193038] \x0aShowing all locks held in the system:
[ 990.201576] 1 lock held by khungtaskd/185:
[ 990.206970] #0: ffffffffa3efe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.218442] 3 locks held by systemd-journal/801:
[ 990.224419] #0: ff1100180e7b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.234305] #1: ffffffffa41033a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.247119] #2: ff110001a1768ff0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.258678] 4 locks held by python3/3814:
[ 990.263972] #0: ff110001311643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.273861] #1: ff1100017d60dc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.284825] #2: ff1100011cd78b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.295980] #3: ff1100011cdf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.306081] 4 locks held by python3/5817:
[ 990.311375] #0: ff110001311643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.321262] #1: ff110001f2f26880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.332220] #2: ff1100011cd78b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.343377] #3: ff1100011cdf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.353457]
[ 990.355920] =============================================\x0a
[ 1112.516174] INFO: task python3:5817 blocked for more than 245 seconds.
[ 1112.524323] Not tainted 7.1.0-rc3-gwzx-gf524823000d3 #1
[ 1112.531574] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.541165] task:python3 state:D stack:25672 pid:5817 tgid:5817 ppid:5816 task_flags:0x400100 flags:0x00080000
[ 1112.554373] Call Trace:
[ 1112.557916]
[ 1112.561069] __schedule+0xcc3/0x19c0
[ 1112.565886] ? io_schedule_timeout+0x140/0x140
[ 1112.571671] ? find_held_lock+0x2b/0x80
[ 1112.576777] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.582665] schedule+0xd4/0x260
[ 1112.587083] schedule_preempt_disabled+0x18/0x30
[ 1112.593063] __mutex_lock+0x6a3/0x2000
[ 1112.598058] ? threaded_store+0x132/0x220
[ 1112.603361] ? ww_mutex_lock+0x160/0x160
[ 1112.608560] ? selinux_inode_free_security+0x330/0x330
[ 1112.615130] ? cap_capable+0x1d6/0x3e0
[ 1112.620137] ? threaded_store+0x132/0x220
[ 1112.625434] threaded_store+0x132/0x220
[ 1112.630537] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.635836] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.641139] ? sysfs_kf_write+0x65/0x160
[ 1112.646342] ? sysfs_file_ops+0x140/0x140
[ 1112.651640] kernfs_fop_write_iter+0x335/0x510
[ 1112.657417] ? kernfs_ops+0xf0/0xf0
[ 1112.662131] new_sync_write+0x333/0x750
[ 1112.667235] ? __lock_acquire+0x508/0xc10
[ 1112.672533] ? new_sync_read+0x740/0x740
[ 1112.677735] ? lock_acquire.part.0+0xbc/0x260
[ 1112.683420] ? ksys_write+0x116/0x250
[ 1112.688332] vfs_write+0x657/0x9b0
[ 1112.692949] ksys_write+0x116/0x250
[ 1112.697660] ? __ia32_sys_read+0xc0/0xc0
[ 1112.702862] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.708452] ? rcu_is_watching+0x15/0xd0
[ 1112.713657] do_syscall_64+0xf3/0x650
[ 1112.718565] ? trace_hardirqs_off+0xd/0x30
[ 1112.723960] ? exc_page_fault+0xda/0xf0
[ 1112.729063] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.735532] RIP: 0033:0x7f37f656222e
[ 1112.740342] RSP: 002b:00007ffd2aa9d0f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.749632] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f37f656222e
[ 1112.758441] RDX: 0000000000000001 RSI: 00005614c63f8cd0 RDI: 0000000000000007
[ 1112.767251] RBP: 00007ffd2aa9d100 R08: 0000000000000000 R09: 0000000000000000
[ 1112.776059] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f37f63da390
[ 1112.784870] R13: 00005614c63f8cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.793682]
[ 1112.796963] INFO: task python3:5817 is blocked on a mutex likely owned by task python3:3814.
[ 1112.807234] task:python3 state:D stack:25672 pid:3814 tgid:3814 ppid:3813 task_flags:0x400100 flags:0x00080802
[ 1112.820435] Call Trace:
[ 1112.823975]
[ 1112.827125] __schedule+0xcc3/0x19c0
[ 1112.831936] ? io_schedule_timeout+0x140/0x140
[ 1112.837720] ? find_held_lock+0x2b/0x80
[ 1112.842824] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.849009] schedule+0xd4/0x260
[ 1112.853421] schedule_timeout+0x13f/0x290
[ 1112.858720] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.865088] ? trace_contention_end+0xb3/0x1a0
[ 1112.870874] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.876555] ? ww_mutex_lock+0x160/0x160
[ 1112.881754] msleep+0x1b/0x30
[ 1112.885877] napi_set_threaded+0x3a5/0x440
[ 1112.891275] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.896772] netif_set_threaded+0x257/0x400
[ 1112.902265] threaded_store+0x1b8/0x220
[ 1112.907370] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.912668] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.917956] ? sysfs_kf_write+0x65/0x160
[ 1112.923157] ? sysfs_file_ops+0x140/0x140
[ 1112.928456] kernfs_fop_write_iter+0x335/0x510
[ 1112.934241] ? kernfs_ops+0xf0/0xf0
[ 1112.938954] new_sync_write+0x333/0x750
[ 1112.944056] ? __lock_acquire+0x508/0xc10
[ 1112.949351] ? new_sync_read+0x740/0x740
[ 1112.954550] ? lock_acquire.part.0+0xbc/0x260
[ 1112.960227] ? ksys_write+0x116/0x250
[ 1112.965140] vfs_write+0x657/0x9b0
[ 1112.969757] ksys_write+0x116/0x250
[ 1112.974470] ? __ia32_sys_read+0xc0/0xc0
[ 1112.979671] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.985260] ? rcu_is_watching+0x15/0xd0
[ 1112.990462] do_syscall_64+0xf3/0x650
[ 1112.995367] ? trace_hardirqs_off+0xd/0x30
[ 1113.000760] ? exc_page_fault+0xda/0xf0
[ 1113.005861] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.012329] RIP: 0033:0x7f772adb622e
[ 1113.017138] RSP: 002b:00007ffe395c7b80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.026434] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f772adb622e
[ 1113.035235] RDX: 0000000000000001 RSI: 000055b1c3ef0cd0 RDI: 0000000000000007
[ 1113.044045] RBP: 00007ffe395c7b90 R08: 0000000000000000 R09: 0000000000000000
[ 1113.052856] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f772ac2e390
[ 1113.061664] R13: 000055b1c3ef0cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.070468]
[ 1113.073729] \x0aShowing all locks held in the system:
[ 1113.082267] 1 lock held by khungtaskd/185:
[ 1113.087664] #0: ffffffffa3efe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.099147] 4 locks held by python3/3814:
[ 1113.104443] #0: ff110001311643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.114336] #1: ff1100017d60dc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.125296] #2: ff1100011cd78b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.136455] #3: ff1100011cdf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.146555] 4 locks held by python3/5817:
[ 1113.151841] #0: ff110001311643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.161731] #1: ff110001f2f26880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.172693] #2: ff1100011cd78b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.183852] #3: ff1100011cdf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.193943]
[ 1113.196402] =============================================\x0a
[ 1235.397277] INFO: task python3:5817 blocked for more than 368 seconds.
[ 1235.405426] Not tainted 7.1.0-rc3-gwzx-gf524823000d3 #1
[ 1235.412676] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.422267] task:python3 state:D stack:25672 pid:5817 tgid:5817 ppid:5816 task_flags:0x400100 flags:0x00080002
[ 1235.435474] Call Trace:
[ 1235.439013]
[ 1235.442164] __schedule+0xcc3/0x19c0
[ 1235.446982] ? io_schedule_timeout+0x140/0x140
[ 1235.452769] ? find_held_lock+0x2b/0x80
[ 1235.457876] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.463760] schedule+0xd4/0x260
[ 1235.468180] schedule_preempt_disabled+0x18/0x30
[ 1235.474158] __mutex_lock+0x6a3/0x2000
[ 1235.479162] ? threaded_store+0x132/0x220
[ 1235.484461] ? ww_mutex_lock+0x160/0x160
[ 1235.489661] ? selinux_inode_free_security+0x330/0x330
[ 1235.496230] ? cap_capable+0x1d6/0x3e0
[ 1235.501238] ? threaded_store+0x132/0x220
[ 1235.506539] threaded_store+0x132/0x220
[ 1235.511645] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.516944] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.522246] ? sysfs_kf_write+0x65/0x160
[ 1235.527447] ? sysfs_file_ops+0x140/0x140
[ 1235.532734] kernfs_fop_write_iter+0x335/0x510
[ 1235.538521] ? kernfs_ops+0xf0/0xf0
[ 1235.543231] new_sync_write+0x333/0x750
[ 1235.548328] ? __lock_acquire+0x508/0xc10
[ 1235.553627] ? new_sync_read+0x740/0x740
[ 1235.558830] ? lock_acquire.part.0+0xbc/0x260
[ 1235.564516] ? ksys_write+0x116/0x250
[ 1235.569429] vfs_write+0x657/0x9b0
[ 1235.574045] ksys_write+0x116/0x250
[ 1235.578757] ? __ia32_sys_read+0xc0/0xc0
[ 1235.583949] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.589532] ? rcu_is_watching+0x15/0xd0
[ 1235.594735] do_syscall_64+0xf3/0x650
[ 1235.599643] ? trace_hardirqs_off+0xd/0x30
[ 1235.605039] ? exc_page_fault+0xda/0xf0
[ 1235.610140] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.616611] RIP: 0033:0x7f37f656222e
[ 1235.621420] RSP: 002b:00007ffd2aa9d0f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.630720] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f37f656222e
[ 1235.639527] RDX: 0000000000000001 RSI: 00005614c63f8cd0 RDI: 0000000000000007
[ 1235.648335] RBP: 00007ffd2aa9d100 R08: 0000000000000000 R09: 0000000000000000
[ 1235.657145] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f37f63da390
[ 1235.665954] R13: 00005614c63f8cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.674767]
[ 1235.678036] INFO: task python3:5817 is blocked on a mutex likely owned by task python3:3814.
[ 1235.688310] task:python3 state:D stack:25672 pid:3814 tgid:3814 ppid:3813 task_flags:0x400100 flags:0x00080802
[ 1235.701513] Call Trace:
[ 1235.705051]
[ 1235.708204] __schedule+0xcc3/0x19c0
[ 1235.713016] ? io_schedule_timeout+0x140/0x140
[ 1235.718801] ? find_held_lock+0x2b/0x80
[ 1235.723896] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.730073] schedule+0xd4/0x260
[ 1235.734491] schedule_timeout+0x13f/0x290
[ 1235.739788] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.746158] ? trace_contention_end+0xb3/0x1a0
[ 1235.751945] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.757636] ? ww_mutex_lock+0x160/0x160
[ 1235.762836] msleep+0x1b/0x30
[ 1235.766961] napi_set_threaded+0x3a5/0x440
[ 1235.772359] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.777852] netif_set_threaded+0x257/0x400
[ 1235.783346] threaded_store+0x1b8/0x220
[ 1235.788448] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.793746] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.799045] ? sysfs_kf_write+0x65/0x160
[ 1235.804246] ? sysfs_file_ops+0x140/0x140
[ 1235.809542] kernfs_fop_write_iter+0x335/0x510
[ 1235.815329] ? kernfs_ops+0xf0/0xf0
[ 1235.820040] new_sync_write+0x333/0x750
[ 1235.825144] ? __lock_acquire+0x508/0xc10
[ 1235.830438] ? new_sync_read+0x740/0x740
[ 1235.835639] ? lock_acquire.part.0+0xbc/0x260
[ 1235.841324] ? ksys_write+0x116/0x250
[ 1235.846237] vfs_write+0x657/0x9b0
[ 1235.850854] ksys_write+0x116/0x250
[ 1235.855567] ? __ia32_sys_read+0xc0/0xc0
[ 1235.860768] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.866349] ? rcu_is_watching+0x15/0xd0
[ 1235.871539] do_syscall_64+0xf3/0x650
[ 1235.876444] ? trace_hardirqs_off+0xd/0x30
[ 1235.881838] ? exc_page_fault+0xda/0xf0
[ 1235.886939] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.893407] RIP: 0033:0x7f772adb622e
[ 1235.898216] RSP: 002b:00007ffe395c7b80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.907512] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f772adb622e
[ 1235.916318] RDX: 0000000000000001 RSI: 000055b1c3ef0cd0 RDI: 0000000000000007
[ 1235.925126] RBP: 00007ffe395c7b90 R08: 0000000000000000 R09: 0000000000000000
[ 1235.933925] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f772ac2e390
[ 1235.942735] R13: 000055b1c3ef0cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.951551]
[ 1235.954815] \x0aShowing all locks held in the system:
[ 1235.963353] 1 lock held by khungtaskd/185:
[ 1235.968748] #0: ffffffffa3efe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1235.980223] 4 locks held by python3/3814:
[ 1235.985519] #0: ff110001311643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1235.995408] #1: ff1100017d60dc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.006360] #2: ff1100011cd78b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.017519] #3: ff1100011cdf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.027614] 4 locks held by python3/5817:
[ 1236.032911] #0: ff110001311643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.042799] #1: ff110001f2f26880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.053761] #2: ff1100011cd78b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.064918] #3: ff1100011cdf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.075010]
[ 1236.077478] =============================================\x0a
[ 1358.278434] INFO: task python3:5817 blocked for more than 491 seconds.
[ 1358.286583] Not tainted 7.1.0-rc3-gwzx-gf524823000d3 #1
[ 1358.293826] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.303415] task:python3 state:D stack:25672 pid:5817 tgid:5817 ppid:5816 task_flags:0x400100 flags:0x00080002
[ 1358.316621] Call Trace:
[ 1358.320161]
[ 1358.323310] __schedule+0xcc3/0x19c0
[ 1358.328127] ? io_schedule_timeout+0x140/0x140
[ 1358.333911] ? find_held_lock+0x2b/0x80
[ 1358.339016] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.344890] schedule+0xd4/0x260
[ 1358.349297] schedule_preempt_disabled+0x18/0x30
[ 1358.355276] __mutex_lock+0x6a3/0x2000
[ 1358.360281] ? threaded_store+0x132/0x220
[ 1358.365579] ? ww_mutex_lock+0x160/0x160
[ 1358.370776] ? selinux_inode_free_security+0x330/0x330
[ 1358.377345] ? cap_capable+0x1d6/0x3e0
[ 1358.382353] ? threaded_store+0x132/0x220
[ 1358.387653] threaded_store+0x132/0x220
[ 1358.392756] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.398054] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.403351] ? sysfs_kf_write+0x65/0x160
[ 1358.408550] ? sysfs_file_ops+0x140/0x140
[ 1358.413847] kernfs_fop_write_iter+0x335/0x510
[ 1358.419629] ? kernfs_ops+0xf0/0xf0
[ 1358.424338] new_sync_write+0x333/0x750
[ 1358.429441] ? __lock_acquire+0x508/0xc10
[ 1358.434735] ? new_sync_read+0x740/0x740
[ 1358.439936] ? lock_acquire.part.0+0xbc/0x260
[ 1358.445620] ? ksys_write+0x116/0x250
[ 1358.450529] vfs_write+0x657/0x9b0
[ 1358.455144] ksys_write+0x116/0x250
[ 1358.459856] ? __ia32_sys_read+0xc0/0xc0
[ 1358.465052] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.470638] ? rcu_is_watching+0x15/0xd0
[ 1358.475839] do_syscall_64+0xf3/0x650
[ 1358.480742] ? trace_hardirqs_off+0xd/0x30
[ 1358.486138] ? exc_page_fault+0xda/0xf0
[ 1358.491232] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.497688] RIP: 0033:0x7f37f656222e
[ 1358.502497] RSP: 002b:00007ffd2aa9d0f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.511796] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f37f656222e
[ 1358.520601] RDX: 0000000000000001 RSI: 00005614c63f8cd0 RDI: 0000000000000007
[ 1358.529406] RBP: 00007ffd2aa9d100 R08: 0000000000000000 R09: 0000000000000000
[ 1358.538211] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f37f63da390
[ 1358.547017] R13: 00005614c63f8cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.555827]
[ 1358.559103] INFO: task python3:5817 is blocked on a mutex likely owned by task python3:3814.
[ 1358.569373] task:python3 state:D stack:25672 pid:3814 tgid:3814 ppid:3813 task_flags:0x400100 flags:0x00080802
[ 1358.582575] Call Trace:
[ 1358.586114]
[ 1358.589263] __schedule+0xcc3/0x19c0
[ 1358.594079] ? io_schedule_timeout+0x140/0x140
[ 1358.599851] ? find_held_lock+0x2b/0x80
[ 1358.604955] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.611133] schedule+0xd4/0x260
[ 1358.615552] schedule_timeout+0x13f/0x290
[ 1358.620850] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.627219] ? trace_contention_end+0xb3/0x1a0
[ 1358.633003] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.638690] ? ww_mutex_lock+0x160/0x160
[ 1358.643889] msleep+0x1b/0x30
[ 1358.648014] napi_set_threaded+0x3a5/0x440
[ 1358.653409] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.658903] netif_set_threaded+0x257/0x400
[ 1358.664392] threaded_store+0x1b8/0x220
[ 1358.669493] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.674788] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.680083] ? sysfs_kf_write+0x65/0x160
[ 1358.685286] ? sysfs_file_ops+0x140/0x140
[ 1358.690578] kernfs_fop_write_iter+0x335/0x510
[ 1358.696361] ? kernfs_ops+0xf0/0xf0
[ 1358.701073] new_sync_write+0x333/0x750
[ 1358.706167] ? __lock_acquire+0x508/0xc10
[ 1358.711461] ? new_sync_read+0x740/0x740
[ 1358.716659] ? lock_acquire.part.0+0xbc/0x260
[ 1358.722346] ? ksys_write+0x116/0x250
[ 1358.727257] vfs_write+0x657/0x9b0
[ 1358.731871] ksys_write+0x116/0x250
[ 1358.736581] ? __ia32_sys_read+0xc0/0xc0
[ 1358.741781] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.747358] ? rcu_is_watching+0x15/0xd0
[ 1358.752558] do_syscall_64+0xf3/0x650
[ 1358.757462] ? trace_hardirqs_off+0xd/0x30
[ 1358.762853] ? exc_page_fault+0xda/0xf0
[ 1358.767951] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.774417] RIP: 0033:0x7f772adb622e
[ 1358.779222] RSP: 002b:00007ffe395c7b80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.788518] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f772adb622e
[ 1358.797322] RDX: 0000000000000001 RSI: 000055b1c3ef0cd0 RDI: 0000000000000007
[ 1358.806130] RBP: 00007ffe395c7b90 R08: 0000000000000000 R09: 0000000000000000
[ 1358.814937] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f772ac2e390
[ 1358.823744] R13: 000055b1c3ef0cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.832557]
[ 1358.835825] \x0aShowing all locks held in the system:
[ 1358.844361] 1 lock held by khungtaskd/185:
[ 1358.849754] #0: ffffffffa3efe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.861224] 2 locks held by systemd-journal/801:
[ 1358.867201] #0: ff1100180e6372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.877089] #1: ffffffffa41033a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: dput.part.0+0x2fd/0x410
[ 1358.889320] 4 locks held by python3/3814:
[ 1358.894612] #0: ff110001311643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.904498] #1: ff1100017d60dc80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.915456] #2: ff1100011cd78b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.926612] #3: ff1100011cdf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.936707] 4 locks held by python3/5817:
[ 1358.942005] #0: ff110001311643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.951891] #1: ff110001f2f26880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.962849] #2: ff1100011cd78b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.974004] #3: ff1100011cdf1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.984095]
[ 1358.986561] =============================================\x0a
[ 1370.565531] kworker/u129:9 (291) used greatest stack depth: 21936 bytes left