[ 791.228257] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 791.230651] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 791.387553] kselftest: Running tests in drivers/net
[ 989.688679] INFO: task python3:5838 blocked for more than 122 seconds.
[ 989.696913] Not tainted 7.1.0-rc5-hquf-g45765ebf7e7a #1
[ 989.704784] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.714372] task:python3 state:D stack:25672 pid:5838 tgid:5838 ppid:5837 task_flags:0x400100 flags:0x00080000
[ 989.727579] Call Trace:
[ 989.731118]
[ 989.734269] __schedule+0xcc3/0x19c0
[ 989.739088] ? io_schedule_timeout+0x140/0x140
[ 989.744874] ? find_held_lock+0x2b/0x80
[ 989.749976] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.755862] schedule+0xd8/0x260
[ 989.760282] schedule_preempt_disabled+0x18/0x30
[ 989.766258] __mutex_lock+0x6af/0x2010
[ 989.771260] ? threaded_store+0x132/0x220
[ 989.776558] ? ww_mutex_lock+0x160/0x160
[ 989.781758] ? selinux_inode_free_security+0x330/0x330
[ 989.788329] ? cap_capable+0x1d6/0x3e0
[ 989.793338] ? threaded_store+0x132/0x220
[ 989.798631] threaded_store+0x132/0x220
[ 989.803731] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.809028] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.814326] ? sysfs_kf_write+0x65/0x160
[ 989.819527] ? sysfs_file_ops+0x140/0x140
[ 989.824812] kernfs_fop_write_iter+0x335/0x510
[ 989.830596] ? kernfs_ops+0xf0/0xf0
[ 989.835308] new_sync_write+0x333/0x750
[ 989.840412] ? __lock_acquire+0x508/0xc10
[ 989.845708] ? new_sync_read+0x740/0x740
[ 989.850907] ? lock_acquire.part.0+0xbc/0x260
[ 989.856589] ? ksys_write+0x116/0x250
[ 989.861500] vfs_write+0x657/0x9b0
[ 989.866120] ksys_write+0x116/0x250
[ 989.870830] ? __ia32_sys_read+0xc0/0xc0
[ 989.876029] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.881616] ? rcu_is_watching+0x15/0xd0
[ 989.886817] do_syscall_64+0xf3/0x650
[ 989.891713] ? trace_hardirqs_off+0xd/0x30
[ 989.897107] ? exc_page_fault+0xda/0xf0
[ 989.902209] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.908676] RIP: 0033:0x7fb02e24722e
[ 989.913475] RSP: 002b:00007ffc320f6320 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.922771] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb02e24722e
[ 989.931577] RDX: 0000000000000001 RSI: 000055a215a926b0 RDI: 0000000000000007
[ 989.940385] RBP: 00007ffc320f6330 R08: 0000000000000000 R09: 0000000000000000
[ 989.949184] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb02e0bf390
[ 989.957983] R13: 000055a215a926b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.966794]
[ 989.970105] INFO: task python3:5838 is blocked on a mutex likely owned by task python3:3791.
[ 989.980378] task:python3 state:D stack:25672 pid:3791 tgid:3791 ppid:3790 task_flags:0x400100 flags:0x00080802
[ 989.993578] Call Trace:
[ 989.997107]
[ 990.000255] __schedule+0xcc3/0x19c0
[ 990.005069] ? io_schedule_timeout+0x140/0x140
[ 990.010850] ? find_held_lock+0x2b/0x80
[ 990.015950] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.022132] schedule+0xd8/0x260
[ 990.026548] schedule_timeout+0x13f/0x290
[ 990.031844] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.038212] ? trace_contention_end+0xb3/0x1a0
[ 990.043995] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.049684] ? ww_mutex_lock+0x160/0x160
[ 990.054883] msleep+0x1b/0x30
[ 990.059006] napi_set_threaded+0x3a5/0x440
[ 990.064402] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.069896] netif_set_threaded+0x257/0x400
[ 990.075388] threaded_store+0x1b8/0x220
[ 990.080491] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.085786] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.091084] ? sysfs_kf_write+0x65/0x160
[ 990.096281] ? sysfs_file_ops+0x140/0x140
[ 990.101575] kernfs_fop_write_iter+0x335/0x510
[ 990.107360] ? kernfs_ops+0xf0/0xf0
[ 990.112062] new_sync_write+0x333/0x750
[ 990.117161] ? __lock_acquire+0x508/0xc10
[ 990.122458] ? new_sync_read+0x740/0x740
[ 990.127657] ? lock_acquire.part.0+0xbc/0x260
[ 990.133341] ? ksys_write+0x116/0x250
[ 990.138251] vfs_write+0x657/0x9b0
[ 990.142865] ksys_write+0x116/0x250
[ 990.147575] ? __ia32_sys_read+0xc0/0xc0
[ 990.152772] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.158362] ? rcu_is_watching+0x15/0xd0
[ 990.163553] do_syscall_64+0xf3/0x650
[ 990.168450] ? trace_hardirqs_off+0xd/0x30
[ 990.173842] ? exc_page_fault+0xda/0xf0
[ 990.178942] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.185408] RIP: 0033:0x7fc0337fe22e
[ 990.190215] RSP: 002b:00007ffeedc54f10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.199515] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc0337fe22e
[ 990.208320] RDX: 0000000000000001 RSI: 000055ee96dd96b0 RDI: 0000000000000007
[ 990.217129] RBP: 00007ffeedc54f20 R08: 0000000000000000 R09: 0000000000000000
[ 990.225938] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc033676390
[ 990.234746] R13: 000055ee96dd96b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.243561]
[ 990.246819] \x0aShowing all locks held in the system:
[ 990.255362] 1 lock held by khungtaskd/184:
[ 990.260757] #0: ffffffffa9efdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.272236] 2 locks held by systemd-journal/802:
[ 990.278228] 4 locks held by python3/3791:
[ 990.283523] #0: ff1100011bc643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.293414] #1: ff1100014ef64480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.304373] #2: ff110001217ecb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.315531] #3: ff11000121821d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.325632] 4 locks held by python3/5838:
[ 990.330927] #0: ff1100011bc643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.340815] #1: ff11000216cb5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.351777] #2: ff110001217ecb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.362933] #3: ff11000121821d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.373019]
[ 990.375483] =============================================\x0a
[ 1022.455910] kworker/u130:6 (1211) used greatest stack depth: 21936 bytes left
[ 1112.569770] INFO: task python3:5838 blocked for more than 245 seconds.
[ 1112.577920] Not tainted 7.1.0-rc5-hquf-g45765ebf7e7a #1
[ 1112.585171] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.594760] task:python3 state:D stack:25672 pid:5838 tgid:5838 ppid:5837 task_flags:0x400100 flags:0x00080000
[ 1112.607968] Call Trace:
[ 1112.611508]
[ 1112.614659] __schedule+0xcc3/0x19c0
[ 1112.619474] ? io_schedule_timeout+0x140/0x140
[ 1112.625260] ? find_held_lock+0x2b/0x80
[ 1112.630368] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.636252] schedule+0xd8/0x260
[ 1112.640669] schedule_preempt_disabled+0x18/0x30
[ 1112.646651] __mutex_lock+0x6af/0x2010
[ 1112.651654] ? threaded_store+0x132/0x220
[ 1112.656956] ? ww_mutex_lock+0x160/0x160
[ 1112.662157] ? selinux_inode_free_security+0x330/0x330
[ 1112.668726] ? cap_capable+0x1d6/0x3e0
[ 1112.673735] ? threaded_store+0x132/0x220
[ 1112.679032] threaded_store+0x132/0x220
[ 1112.684133] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.689433] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.694733] ? sysfs_kf_write+0x65/0x160
[ 1112.699934] ? sysfs_file_ops+0x140/0x140
[ 1112.705221] kernfs_fop_write_iter+0x335/0x510
[ 1112.711008] ? kernfs_ops+0xf0/0xf0
[ 1112.715719] new_sync_write+0x333/0x750
[ 1112.720824] ? __lock_acquire+0x508/0xc10
[ 1112.726123] ? new_sync_read+0x740/0x740
[ 1112.731325] ? lock_acquire.part.0+0xbc/0x260
[ 1112.737010] ? ksys_write+0x116/0x250
[ 1112.741919] vfs_write+0x657/0x9b0
[ 1112.746538] ksys_write+0x116/0x250
[ 1112.751249] ? __ia32_sys_read+0xc0/0xc0
[ 1112.756450] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.762033] ? rcu_is_watching+0x15/0xd0
[ 1112.767232] do_syscall_64+0xf3/0x650
[ 1112.772141] ? trace_hardirqs_off+0xd/0x30
[ 1112.777537] ? exc_page_fault+0xda/0xf0
[ 1112.782639] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.789110] RIP: 0033:0x7fb02e24722e
[ 1112.793920] RSP: 002b:00007ffc320f6320 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.803219] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb02e24722e
[ 1112.812028] RDX: 0000000000000001 RSI: 000055a215a926b0 RDI: 0000000000000007
[ 1112.820837] RBP: 00007ffc320f6330 R08: 0000000000000000 R09: 0000000000000000
[ 1112.829648] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb02e0bf390
[ 1112.838458] R13: 000055a215a926b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.847272]
[ 1112.850562] INFO: task python3:5838 is blocked on a mutex likely owned by task python3:3791.
[ 1112.860837] task:python3 state:D stack:25672 pid:3791 tgid:3791 ppid:3790 task_flags:0x400100 flags:0x00080802
[ 1112.874040] Call Trace:
[ 1112.877580]
[ 1112.880729] __schedule+0xcc3/0x19c0
[ 1112.885542] ? io_schedule_timeout+0x140/0x140
[ 1112.891326] ? find_held_lock+0x2b/0x80
[ 1112.896429] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.902616] schedule+0xd8/0x260
[ 1112.907034] schedule_timeout+0x13f/0x290
[ 1112.912330] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.918703] ? trace_contention_end+0xb3/0x1a0
[ 1112.924489] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.930179] ? ww_mutex_lock+0x160/0x160
[ 1112.935379] msleep+0x1b/0x30
[ 1112.939504] napi_set_threaded+0x3a5/0x440
[ 1112.944901] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.950398] netif_set_threaded+0x257/0x400
[ 1112.955889] threaded_store+0x1b8/0x220
[ 1112.960984] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.966282] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.971580] ? sysfs_kf_write+0x65/0x160
[ 1112.976778] ? sysfs_file_ops+0x140/0x140
[ 1112.982073] kernfs_fop_write_iter+0x335/0x510
[ 1112.987859] ? kernfs_ops+0xf0/0xf0
[ 1112.992563] new_sync_write+0x333/0x750
[ 1112.997665] ? __lock_acquire+0x508/0xc10
[ 1113.002964] ? new_sync_read+0x740/0x740
[ 1113.008165] ? lock_acquire.part.0+0xbc/0x260
[ 1113.013842] ? ksys_write+0x116/0x250
[ 1113.018753] vfs_write+0x657/0x9b0
[ 1113.023372] ksys_write+0x116/0x250
[ 1113.028085] ? __ia32_sys_read+0xc0/0xc0
[ 1113.033287] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.038876] ? rcu_is_watching+0x15/0xd0
[ 1113.044075] do_syscall_64+0xf3/0x650
[ 1113.048982] ? trace_hardirqs_off+0xd/0x30
[ 1113.054376] ? exc_page_fault+0xda/0xf0
[ 1113.059478] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.065946] RIP: 0033:0x7fc0337fe22e
[ 1113.070755] RSP: 002b:00007ffeedc54f10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.080054] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc0337fe22e
[ 1113.088863] RDX: 0000000000000001 RSI: 000055ee96dd96b0 RDI: 0000000000000007
[ 1113.097674] RBP: 00007ffeedc54f20 R08: 0000000000000000 R09: 0000000000000000
[ 1113.106481] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc033676390
[ 1113.115282] R13: 000055ee96dd96b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.124097]
[ 1113.127360] \x0aShowing all locks held in the system:
[ 1113.135899] 1 lock held by khungtaskd/184:
[ 1113.141293] #0: ffffffffa9efdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.152766] 3 locks held by systemd-journal/802:
[ 1113.158746] #0: ff1100180e5b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1113.168635] #1: ffffffffaa102c20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.181451] #2: ff110001a42f0a70 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1113.193009] 4 locks held by python3/3791:
[ 1113.198303] #0: ff1100011bc643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.208192] #1: ff1100014ef64480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.219154] #2: ff110001217ecb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.230312] #3: ff11000121821d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.240401] 4 locks held by python3/5838:
[ 1113.245697] #0: ff1100011bc643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.255585] #1: ff11000216cb5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.266548] #2: ff110001217ecb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.277705] #3: ff11000121821d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.287782]
[ 1113.290251] =============================================\x0a
[ 1235.449892] INFO: task python3:5838 blocked for more than 368 seconds.
[ 1235.458038] Not tainted 7.1.0-rc5-hquf-g45765ebf7e7a #1
[ 1235.465290] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.474878] task:python3 state:D stack:25672 pid:5838 tgid:5838 ppid:5837 task_flags:0x400100 flags:0x00080002
[ 1235.488088] Call Trace:
[ 1235.491631]
[ 1235.494784] __schedule+0xcc3/0x19c0
[ 1235.499602] ? io_schedule_timeout+0x140/0x140
[ 1235.505388] ? find_held_lock+0x2b/0x80
[ 1235.510494] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.516378] schedule+0xd8/0x260
[ 1235.520795] schedule_preempt_disabled+0x18/0x30
[ 1235.526776] __mutex_lock+0x6af/0x2010
[ 1235.531782] ? threaded_store+0x132/0x220
[ 1235.537084] ? ww_mutex_lock+0x160/0x160
[ 1235.542283] ? selinux_inode_free_security+0x330/0x330
[ 1235.548851] ? cap_capable+0x1d6/0x3e0
[ 1235.553861] ? threaded_store+0x132/0x220
[ 1235.559160] threaded_store+0x132/0x220
[ 1235.564266] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.569562] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.574853] ? sysfs_kf_write+0x65/0x160
[ 1235.580055] ? sysfs_file_ops+0x140/0x140
[ 1235.585350] kernfs_fop_write_iter+0x335/0x510
[ 1235.591137] ? kernfs_ops+0xf0/0xf0
[ 1235.595847] new_sync_write+0x333/0x750
[ 1235.600952] ? __lock_acquire+0x508/0xc10
[ 1235.606239] ? new_sync_read+0x740/0x740
[ 1235.611440] ? lock_acquire.part.0+0xbc/0x260
[ 1235.617126] ? ksys_write+0x116/0x250
[ 1235.622037] vfs_write+0x657/0x9b0
[ 1235.626655] ksys_write+0x116/0x250
[ 1235.631367] ? __ia32_sys_read+0xc0/0xc0
[ 1235.636560] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.642149] ? rcu_is_watching+0x15/0xd0
[ 1235.647350] do_syscall_64+0xf3/0x650
[ 1235.652257] ? trace_hardirqs_off+0xd/0x30
[ 1235.657652] ? exc_page_fault+0xda/0xf0
[ 1235.662755] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.669225] RIP: 0033:0x7fb02e24722e
[ 1235.674035] RSP: 002b:00007ffc320f6320 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.683335] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb02e24722e
[ 1235.692146] RDX: 0000000000000001 RSI: 000055a215a926b0 RDI: 0000000000000007
[ 1235.700955] RBP: 00007ffc320f6330 R08: 0000000000000000 R09: 0000000000000000
[ 1235.709767] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb02e0bf390
[ 1235.718577] R13: 000055a215a926b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.727391]
[ 1235.730707] INFO: task python3:5838 is blocked on a mutex likely owned by task python3:3791.
[ 1235.740983] task:python3 state:D stack:25672 pid:3791 tgid:3791 ppid:3790 task_flags:0x400100 flags:0x00080802
[ 1235.754185] Call Trace:
[ 1235.757725]
[ 1235.760874] __schedule+0xcc3/0x19c0
[ 1235.765685] ? io_schedule_timeout+0x140/0x140
[ 1235.771470] ? find_held_lock+0x2b/0x80
[ 1235.776571] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.782751] schedule+0xd8/0x260
[ 1235.787172] schedule_timeout+0x13f/0x290
[ 1235.792470] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.798843] ? trace_contention_end+0xb3/0x1a0
[ 1235.804629] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.810318] ? ww_mutex_lock+0x160/0x160
[ 1235.815520] msleep+0x1b/0x30
[ 1235.819644] napi_set_threaded+0x3a5/0x440
[ 1235.825041] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.830528] netif_set_threaded+0x257/0x400
[ 1235.836020] threaded_store+0x1b8/0x220
[ 1235.841116] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.846412] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.851710] ? sysfs_kf_write+0x65/0x160
[ 1235.856900] ? sysfs_file_ops+0x140/0x140
[ 1235.862195] kernfs_fop_write_iter+0x335/0x510
[ 1235.867980] ? kernfs_ops+0xf0/0xf0
[ 1235.872685] new_sync_write+0x333/0x750
[ 1235.877789] ? __lock_acquire+0x508/0xc10
[ 1235.883084] ? new_sync_read+0x740/0x740
[ 1235.888284] ? lock_acquire.part.0+0xbc/0x260
[ 1235.893968] ? ksys_write+0x116/0x250
[ 1235.898882] vfs_write+0x657/0x9b0
[ 1235.903498] ksys_write+0x116/0x250
[ 1235.908211] ? __ia32_sys_read+0xc0/0xc0
[ 1235.913410] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.919000] ? rcu_is_watching+0x15/0xd0
[ 1235.924194] do_syscall_64+0xf3/0x650
[ 1235.929103] ? trace_hardirqs_off+0xd/0x30
[ 1235.934497] ? exc_page_fault+0xda/0xf0
[ 1235.939598] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.946066] RIP: 0033:0x7fc0337fe22e
[ 1235.950874] RSP: 002b:00007ffeedc54f10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.960169] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc0337fe22e
[ 1235.968980] RDX: 0000000000000001 RSI: 000055ee96dd96b0 RDI: 0000000000000007
[ 1235.977788] RBP: 00007ffeedc54f20 R08: 0000000000000000 R09: 0000000000000000
[ 1235.986597] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc033676390
[ 1235.995403] R13: 000055ee96dd96b0 R14: 0000000000000007 R15: 0000000000000003
[ 1236.004216]
[ 1236.007484] \x0aShowing all locks held in the system:
[ 1236.016028] 1 lock held by khungtaskd/184:
[ 1236.021425] #0: ffffffffa9efdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.032913] 4 locks held by python3/3791:
[ 1236.038208] #0: ff1100011bc643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.048097] #1: ff1100014ef64480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.059057] #2: ff110001217ecb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.070214] #3: ff11000121821d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.080312] 4 locks held by python3/5838:
[ 1236.085610] #0: ff1100011bc643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.095498] #1: ff11000216cb5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.106462] #2: ff110001217ecb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.117622] #3: ff11000121821d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.127713]
[ 1236.130187] =============================================\x0a
[ 1358.330972] INFO: task python3:5838 blocked for more than 491 seconds.
[ 1358.339121] Not tainted 7.1.0-rc5-hquf-g45765ebf7e7a #1
[ 1358.346370] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.355961] task:python3 state:D stack:25672 pid:5838 tgid:5838 ppid:5837 task_flags:0x400100 flags:0x00080002
[ 1358.369167] Call Trace:
[ 1358.372704]
[ 1358.375852] __schedule+0xcc3/0x19c0
[ 1358.380665] ? io_schedule_timeout+0x140/0x140
[ 1358.386450] ? find_held_lock+0x2b/0x80
[ 1358.391556] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.397440] schedule+0xd8/0x260
[ 1358.401859] schedule_preempt_disabled+0x18/0x30
[ 1358.407836] __mutex_lock+0x6af/0x2010
[ 1358.412837] ? threaded_store+0x132/0x220
[ 1358.418136] ? ww_mutex_lock+0x160/0x160
[ 1358.423334] ? selinux_inode_free_security+0x330/0x330
[ 1358.429894] ? cap_capable+0x1d6/0x3e0
[ 1358.434901] ? threaded_store+0x132/0x220
[ 1358.440199] threaded_store+0x132/0x220
[ 1358.445289] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.450589] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.455887] ? sysfs_kf_write+0x65/0x160
[ 1358.461088] ? sysfs_file_ops+0x140/0x140
[ 1358.466384] kernfs_fop_write_iter+0x335/0x510
[ 1358.472165] ? kernfs_ops+0xf0/0xf0
[ 1358.476877] new_sync_write+0x333/0x750
[ 1358.481978] ? __lock_acquire+0x508/0xc10
[ 1358.487274] ? new_sync_read+0x740/0x740
[ 1358.492476] ? lock_acquire.part.0+0xbc/0x260
[ 1358.498162] ? ksys_write+0x116/0x250
[ 1358.503070] vfs_write+0x657/0x9b0
[ 1358.507676] ksys_write+0x116/0x250
[ 1358.512379] ? __ia32_sys_read+0xc0/0xc0
[ 1358.517577] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.523164] ? rcu_is_watching+0x15/0xd0
[ 1358.528366] do_syscall_64+0xf3/0x650
[ 1358.533271] ? trace_hardirqs_off+0xd/0x30
[ 1358.538662] ? exc_page_fault+0xda/0xf0
[ 1358.543764] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.550220] RIP: 0033:0x7fb02e24722e
[ 1358.555028] RSP: 002b:00007ffc320f6320 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.564327] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb02e24722e
[ 1358.573134] RDX: 0000000000000001 RSI: 000055a215a926b0 RDI: 0000000000000007
[ 1358.581940] RBP: 00007ffc320f6330 R08: 0000000000000000 R09: 0000000000000000
[ 1358.590747] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb02e0bf390
[ 1358.599555] R13: 000055a215a926b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.608369]
[ 1358.611655] INFO: task python3:5838 is blocked on a mutex likely owned by task python3:3791.
[ 1358.621925] task:python3 state:D stack:25672 pid:3791 tgid:3791 ppid:3790 task_flags:0x400100 flags:0x00080802
[ 1358.635125] Call Trace:
[ 1358.638664]
[ 1358.641817] __schedule+0xcc3/0x19c0
[ 1358.646625] ? io_schedule_timeout+0x140/0x140
[ 1358.652406] ? find_held_lock+0x2b/0x80
[ 1358.657505] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.663683] schedule+0xd8/0x260
[ 1358.668101] schedule_timeout+0x13f/0x290
[ 1358.673399] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.679769] ? trace_contention_end+0xb3/0x1a0
[ 1358.685552] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.691243] ? ww_mutex_lock+0x160/0x160
[ 1358.696443] msleep+0x1b/0x30
[ 1358.700568] napi_set_threaded+0x3a5/0x440
[ 1358.705962] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.711455] netif_set_threaded+0x257/0x400
[ 1358.716949] threaded_store+0x1b8/0x220
[ 1358.722049] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.727345] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.732640] ? sysfs_kf_write+0x65/0x160
[ 1358.737840] ? sysfs_file_ops+0x140/0x140
[ 1358.743125] kernfs_fop_write_iter+0x335/0x510
[ 1358.748909] ? kernfs_ops+0xf0/0xf0
[ 1358.753621] new_sync_write+0x333/0x750
[ 1358.758723] ? __lock_acquire+0x508/0xc10
[ 1358.764019] ? new_sync_read+0x740/0x740
[ 1358.769216] ? lock_acquire.part.0+0xbc/0x260
[ 1358.774899] ? ksys_write+0x116/0x250
[ 1358.779808] vfs_write+0x657/0x9b0
[ 1358.784428] ksys_write+0x116/0x250
[ 1358.789136] ? __ia32_sys_read+0xc0/0xc0
[ 1358.794336] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.799924] ? rcu_is_watching+0x15/0xd0
[ 1358.805122] do_syscall_64+0xf3/0x650
[ 1358.810029] ? trace_hardirqs_off+0xd/0x30
[ 1358.815420] ? exc_page_fault+0xda/0xf0
[ 1358.820522] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.826987] RIP: 0033:0x7fc0337fe22e
[ 1358.831793] RSP: 002b:00007ffeedc54f10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.841088] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc0337fe22e
[ 1358.849895] RDX: 0000000000000001 RSI: 000055ee96dd96b0 RDI: 0000000000000007
[ 1358.858702] RBP: 00007ffeedc54f20 R08: 0000000000000000 R09: 0000000000000000
[ 1358.867508] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc033676390
[ 1358.876314] R13: 000055ee96dd96b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.885128]
[ 1358.888395] \x0aShowing all locks held in the system:
[ 1358.896931] 1 lock held by khungtaskd/184:
[ 1358.902326] #0: ffffffffa9efdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.913794] 3 locks held by systemd-journal/802:
[ 1358.919770] #0: ff1100180e7372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.929656] #1: ffffffffaa102c20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: dput.part.0+0x2fd/0x410
[ 1358.941883] #2: ff110001a42f14c0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1358.953431] 4 locks held by python3/3791:
[ 1358.958723] #0: ff1100011bc643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.968611] #1: ff1100014ef64480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.979573] #2: ff110001217ecb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.990729] #3: ff11000121821d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.000830] 4 locks held by python3/5838:
[ 1359.006121] #0: ff1100011bc643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.016008] #1: ff11000216cb5c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.026968] #2: ff110001217ecb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.038123] #3: ff11000121821d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.048214]
[ 1359.050671] =============================================\x0a