[ 782.848683] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 782.852391] nipa-hw-worker: [5/45] Retrying drivers/net:napi_threaded.py
[ 783.007240] kselftest: Running tests in drivers/net
[ 989.677919] INFO: task python3:5658 blocked for more than 122 seconds.
[ 989.686122] Not tainted 7.1.0-rc2-sajk-g122090ccd4e6 #1
[ 989.693795] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.703376] task:python3 state:D stack:25672 pid:5658 tgid:5658 ppid:5657 task_flags:0x400100 flags:0x00080000
[ 989.716585] Call Trace:
[ 989.720125]
[ 989.723278] __schedule+0xcba/0x1940
[ 989.728097] ? io_schedule_timeout+0x140/0x140
[ 989.733884] ? find_held_lock+0x2b/0x80
[ 989.738991] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.744877] schedule+0xd4/0x260
[ 989.749297] schedule_preempt_disabled+0x18/0x30
[ 989.755280] __mutex_lock+0x6a3/0x2000
[ 989.760287] ? threaded_store+0x132/0x220
[ 989.765589] ? ww_mutex_lock+0x160/0x160
[ 989.770787] ? selinux_inode_free_security+0x330/0x330
[ 989.777351] ? cap_capable+0x1d6/0x3e0
[ 989.782363] ? threaded_store+0x132/0x220
[ 989.787663] threaded_store+0x132/0x220
[ 989.792765] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.798055] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.803356] ? sysfs_kf_write+0x65/0x160
[ 989.808558] ? sysfs_file_ops+0x140/0x140
[ 989.813856] kernfs_fop_write_iter+0x335/0x510
[ 989.819640] ? kernfs_ops+0xf0/0xf0
[ 989.824346] new_sync_write+0x333/0x750
[ 989.829449] ? __lock_acquire+0x508/0xc10
[ 989.834750] ? new_sync_read+0x740/0x740
[ 989.839951] ? lock_acquire.part.0+0xbc/0x260
[ 989.845641] ? ksys_write+0x116/0x250
[ 989.850552] vfs_write+0x657/0x9b0
[ 989.855165] ksys_write+0x116/0x250
[ 989.859877] ? __ia32_sys_read+0xc0/0xc0
[ 989.865077] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.870667] ? rcu_is_watching+0x15/0xd0
[ 989.875870] do_syscall_64+0xf3/0x650
[ 989.880780] ? trace_hardirqs_off+0xd/0x30
[ 989.886177] ? exc_page_fault+0xda/0xf0
[ 989.891279] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.897757] RIP: 0033:0x7f80d0a3422e
[ 989.902567] RSP: 002b:00007ffda6898ca0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.911858] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f80d0a3422e
[ 989.920665] RDX: 0000000000000001 RSI: 00005607144183d0 RDI: 0000000000000007
[ 989.929475] RBP: 00007ffda6898cb0 R08: 0000000000000000 R09: 0000000000000000
[ 989.938286] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f80d08ac390
[ 989.947096] R13: 00005607144183d0 R14: 0000000000000007 R15: 0000000000000003
[ 989.955909]
[ 989.959208] INFO: task python3:5658 is blocked on a mutex likely owned by task python3:3594.
[ 989.969484] task:python3 state:D stack:25624 pid:3594 tgid:3594 ppid:3593 task_flags:0x400100 flags:0x00080802
[ 989.982678] Call Trace:
[ 989.986218]
[ 989.989369] __schedule+0xcba/0x1940
[ 989.994172] ? io_schedule_timeout+0x140/0x140
[ 989.999955] ? find_held_lock+0x2b/0x80
[ 990.005059] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.011237] schedule+0xd4/0x260
[ 990.015656] schedule_timeout+0x13f/0x290
[ 990.020945] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.027316] ? trace_contention_end+0xb3/0x1a0
[ 990.033100] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.038789] ? ww_mutex_lock+0x160/0x160
[ 990.043989] msleep+0x1b/0x30
[ 990.048118] napi_set_threaded+0x3a5/0x440
[ 990.053515] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.059011] netif_set_threaded+0x257/0x400
[ 990.064506] threaded_store+0x1b8/0x220
[ 990.069611] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.074909] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.080205] ? sysfs_kf_write+0x65/0x160
[ 990.085406] ? sysfs_file_ops+0x140/0x140
[ 990.090702] kernfs_fop_write_iter+0x335/0x510
[ 990.096490] ? kernfs_ops+0xf0/0xf0
[ 990.101203] new_sync_write+0x333/0x750
[ 990.106305] ? __lock_acquire+0x508/0xc10
[ 990.111605] ? new_sync_read+0x740/0x740
[ 990.116808] ? lock_acquire.part.0+0xbc/0x260
[ 990.122495] ? ksys_write+0x116/0x250
[ 990.127407] vfs_write+0x657/0x9b0
[ 990.132025] ksys_write+0x116/0x250
[ 990.136737] ? __ia32_sys_read+0xc0/0xc0
[ 990.141939] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.147526] ? rcu_is_watching+0x15/0xd0
[ 990.152729] do_syscall_64+0xf3/0x650
[ 990.157637] ? trace_hardirqs_off+0xd/0x30
[ 990.163032] ? exc_page_fault+0xda/0xf0
[ 990.168134] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.174603] RIP: 0033:0x7fe8eb0e622e
[ 990.179410] RSP: 002b:00007ffdeb78ec50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.188708] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe8eb0e622e
[ 990.197518] RDX: 0000000000000001 RSI: 0000563b722613d0 RDI: 0000000000000007
[ 990.206328] RBP: 00007ffdeb78ec60 R08: 0000000000000000 R09: 0000000000000000
[ 990.215138] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe8eaf5e390
[ 990.223946] R13: 0000563b722613d0 R14: 0000000000000007 R15: 0000000000000003
[ 990.232764]
[ 990.236022] \x0aShowing all locks held in the system:
[ 990.244550] 1 lock held by khungtaskd/185:
[ 990.249942] #0: ffffffffab2fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.261418] 2 locks held by systemd-journal/801:
[ 990.267397] #0: ff1100180e2b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.277284] #1: ffffffffab5032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.290101] 4 locks held by python3/3594:
[ 990.295398] #0: ff1100012f9bc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.305288] #1: ff1100016701a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.316253] #2: ff11000122422b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.327413] #3: ff110001224f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.337510] 4 locks held by python3/5658:
[ 990.342806] #0: ff1100012f9bc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.352697] #1: ff110002139e2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.363658] #2: ff11000122422b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.374817] #3: ff110001224f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.384905]
[ 990.387373] =============================================\x0a
[ 1100.271130] kworker/u129:11 (307) used greatest stack depth: 21936 bytes left
[ 1112.559272] INFO: task python3:5658 blocked for more than 245 seconds.
[ 1112.567423] Not tainted 7.1.0-rc2-sajk-g122090ccd4e6 #1
[ 1112.574676] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.584268] task:python3 state:D stack:25672 pid:5658 tgid:5658 ppid:5657 task_flags:0x400100 flags:0x00080000
[ 1112.597483] Call Trace:
[ 1112.601026]
[ 1112.604179] __schedule+0xcba/0x1940
[ 1112.608998] ? io_schedule_timeout+0x140/0x140
[ 1112.614791] ? find_held_lock+0x2b/0x80
[ 1112.619898] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.625792] schedule+0xd4/0x260
[ 1112.630212] schedule_preempt_disabled+0x18/0x30
[ 1112.636195] __mutex_lock+0x6a3/0x2000
[ 1112.641204] ? threaded_store+0x132/0x220
[ 1112.646510] ? ww_mutex_lock+0x160/0x160
[ 1112.651713] ? selinux_inode_free_security+0x330/0x330
[ 1112.658290] ? cap_capable+0x1d6/0x3e0
[ 1112.663302] ? threaded_store+0x132/0x220
[ 1112.668604] threaded_store+0x132/0x220
[ 1112.673712] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.679014] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.684316] ? sysfs_kf_write+0x65/0x160
[ 1112.689520] ? sysfs_file_ops+0x140/0x140
[ 1112.694821] kernfs_fop_write_iter+0x335/0x510
[ 1112.700610] ? kernfs_ops+0xf0/0xf0
[ 1112.705322] new_sync_write+0x333/0x750
[ 1112.710432] ? __lock_acquire+0x508/0xc10
[ 1112.715731] ? new_sync_read+0x740/0x740
[ 1112.720938] ? lock_acquire.part.0+0xbc/0x260
[ 1112.726617] ? ksys_write+0x116/0x250
[ 1112.731536] vfs_write+0x657/0x9b0
[ 1112.736157] ksys_write+0x116/0x250
[ 1112.740876] ? __ia32_sys_read+0xc0/0xc0
[ 1112.746076] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.751670] ? rcu_is_watching+0x15/0xd0
[ 1112.756876] do_syscall_64+0xf3/0x650
[ 1112.761786] ? trace_hardirqs_off+0xd/0x30
[ 1112.767182] ? exc_page_fault+0xda/0xf0
[ 1112.772291] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.778753] RIP: 0033:0x7f80d0a3422e
[ 1112.783568] RSP: 002b:00007ffda6898ca0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.792871] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f80d0a3422e
[ 1112.801686] RDX: 0000000000000001 RSI: 00005607144183d0 RDI: 0000000000000007
[ 1112.810488] RBP: 00007ffda6898cb0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.819304] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f80d08ac390
[ 1112.828118] R13: 00005607144183d0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.836943]
[ 1112.840233] INFO: task python3:5658 is blocked on a mutex likely owned by task python3:3594.
[ 1112.850518] task:python3 state:D stack:25624 pid:3594 tgid:3594 ppid:3593 task_flags:0x400100 flags:0x00080802
[ 1112.863724] Call Trace:
[ 1112.867265]
[ 1112.870420] __schedule+0xcba/0x1940
[ 1112.875239] ? io_schedule_timeout+0x140/0x140
[ 1112.881016] ? find_held_lock+0x2b/0x80
[ 1112.886127] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.892310] schedule+0xd4/0x260
[ 1112.896735] schedule_timeout+0x13f/0x290
[ 1112.902034] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.908401] ? trace_contention_end+0xb3/0x1a0
[ 1112.914190] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.919887] ? ww_mutex_lock+0x160/0x160
[ 1112.925091] msleep+0x1b/0x30
[ 1112.929223] napi_set_threaded+0x3a5/0x440
[ 1112.934622] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.940125] netif_set_threaded+0x257/0x400
[ 1112.945623] threaded_store+0x1b8/0x220
[ 1112.950731] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.956033] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.961334] ? sysfs_kf_write+0x65/0x160
[ 1112.966537] ? sysfs_file_ops+0x140/0x140
[ 1112.971835] kernfs_fop_write_iter+0x335/0x510
[ 1112.977624] ? kernfs_ops+0xf0/0xf0
[ 1112.982340] new_sync_write+0x333/0x750
[ 1112.987449] ? __lock_acquire+0x508/0xc10
[ 1112.992749] ? new_sync_read+0x740/0x740
[ 1112.997954] ? lock_acquire.part.0+0xbc/0x260
[ 1113.003644] ? ksys_write+0x116/0x250
[ 1113.008556] vfs_write+0x657/0x9b0
[ 1113.013180] ksys_write+0x116/0x250
[ 1113.017894] ? __ia32_sys_read+0xc0/0xc0
[ 1113.023098] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.028689] ? rcu_is_watching+0x15/0xd0
[ 1113.033887] do_syscall_64+0xf3/0x650
[ 1113.038791] ? trace_hardirqs_off+0xd/0x30
[ 1113.044187] ? exc_page_fault+0xda/0xf0
[ 1113.049291] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.055768] RIP: 0033:0x7fe8eb0e622e
[ 1113.060581] RSP: 002b:00007ffdeb78ec50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.069884] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe8eb0e622e
[ 1113.078696] RDX: 0000000000000001 RSI: 0000563b722613d0 RDI: 0000000000000007
[ 1113.087510] RBP: 00007ffdeb78ec60 R08: 0000000000000000 R09: 0000000000000000
[ 1113.096321] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe8eaf5e390
[ 1113.105134] R13: 0000563b722613d0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.113950]
[ 1113.117217] \x0aShowing all locks held in the system:
[ 1113.125758] 1 lock held by khungtaskd/185:
[ 1113.131157] #0: ffffffffab2fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.142651] 4 locks held by python3/3594:
[ 1113.147953] #0: ff1100012f9bc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.157854] #1: ff1100016701a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.168821] #2: ff11000122422b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.179988] #3: ff110001224f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.190092] 4 locks held by python3/5658:
[ 1113.195392] #0: ff1100012f9bc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.205281] #1: ff110002139e2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.216252] #2: ff11000122422b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.227420] #3: ff110001224f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.237516]
[ 1113.239986] =============================================\x0a
[ 1235.440645] INFO: task python3:5658 blocked for more than 368 seconds.
[ 1235.448795] Not tainted 7.1.0-rc2-sajk-g122090ccd4e6 #1
[ 1235.456047] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.465636] task:python3 state:D stack:25672 pid:5658 tgid:5658 ppid:5657 task_flags:0x400100 flags:0x00080002
[ 1235.478833] Call Trace:
[ 1235.482371]
[ 1235.485521] __schedule+0xcba/0x1940
[ 1235.490338] ? io_schedule_timeout+0x140/0x140
[ 1235.496124] ? find_held_lock+0x2b/0x80
[ 1235.501226] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.507110] schedule+0xd4/0x260
[ 1235.511530] schedule_preempt_disabled+0x18/0x30
[ 1235.517500] __mutex_lock+0x6a3/0x2000
[ 1235.522502] ? threaded_store+0x132/0x220
[ 1235.527798] ? ww_mutex_lock+0x160/0x160
[ 1235.532995] ? selinux_inode_free_security+0x330/0x330
[ 1235.539563] ? cap_capable+0x1d6/0x3e0
[ 1235.544573] ? threaded_store+0x132/0x220
[ 1235.549870] threaded_store+0x132/0x220
[ 1235.554968] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.560264] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.565553] ? sysfs_kf_write+0x65/0x160
[ 1235.570753] ? sysfs_file_ops+0x140/0x140
[ 1235.576048] kernfs_fop_write_iter+0x335/0x510
[ 1235.581834] ? kernfs_ops+0xf0/0xf0
[ 1235.586535] new_sync_write+0x333/0x750
[ 1235.591639] ? __lock_acquire+0x508/0xc10
[ 1235.596925] ? new_sync_read+0x740/0x740
[ 1235.602127] ? lock_acquire.part.0+0xbc/0x260
[ 1235.607812] ? ksys_write+0x116/0x250
[ 1235.612721] vfs_write+0x657/0x9b0
[ 1235.617336] ksys_write+0x116/0x250
[ 1235.622039] ? __ia32_sys_read+0xc0/0xc0
[ 1235.627239] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.632820] ? rcu_is_watching+0x15/0xd0
[ 1235.638021] do_syscall_64+0xf3/0x650
[ 1235.642916] ? trace_hardirqs_off+0xd/0x30
[ 1235.648311] ? exc_page_fault+0xda/0xf0
[ 1235.653414] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.659879] RIP: 0033:0x7f80d0a3422e
[ 1235.664686] RSP: 002b:00007ffda6898ca0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.673984] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f80d0a3422e
[ 1235.682794] RDX: 0000000000000001 RSI: 00005607144183d0 RDI: 0000000000000007
[ 1235.691601] RBP: 00007ffda6898cb0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.700397] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f80d08ac390
[ 1235.709205] R13: 00005607144183d0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.718019]
[ 1235.721298] INFO: task python3:5658 is blocked on a mutex likely owned by task python3:3594.
[ 1235.731570] task:python3 state:D stack:25624 pid:3594 tgid:3594 ppid:3593 task_flags:0x400100 flags:0x00080802
[ 1235.744772] Call Trace:
[ 1235.748307]
[ 1235.751454] __schedule+0xcba/0x1940
[ 1235.756264] ? io_schedule_timeout+0x140/0x140
[ 1235.762046] ? find_held_lock+0x2b/0x80
[ 1235.767148] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.773325] schedule+0xd4/0x260
[ 1235.777743] schedule_timeout+0x13f/0x290
[ 1235.783042] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.789412] ? trace_contention_end+0xb3/0x1a0
[ 1235.795189] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.800881] ? ww_mutex_lock+0x160/0x160
[ 1235.806078] msleep+0x1b/0x30
[ 1235.810204] napi_set_threaded+0x3a5/0x440
[ 1235.815598] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.821091] netif_set_threaded+0x257/0x400
[ 1235.826584] threaded_store+0x1b8/0x220
[ 1235.831674] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.836970] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.842265] ? sysfs_kf_write+0x65/0x160
[ 1235.847461] ? sysfs_file_ops+0x140/0x140
[ 1235.852756] kernfs_fop_write_iter+0x335/0x510
[ 1235.858540] ? kernfs_ops+0xf0/0xf0
[ 1235.863250] new_sync_write+0x333/0x750
[ 1235.868350] ? __lock_acquire+0x508/0xc10
[ 1235.873645] ? new_sync_read+0x740/0x740
[ 1235.878844] ? lock_acquire.part.0+0xbc/0x260
[ 1235.884520] ? ksys_write+0x116/0x250
[ 1235.889429] vfs_write+0x657/0x9b0
[ 1235.894043] ksys_write+0x116/0x250
[ 1235.898754] ? __ia32_sys_read+0xc0/0xc0
[ 1235.903951] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.909537] ? rcu_is_watching+0x15/0xd0
[ 1235.914735] do_syscall_64+0xf3/0x650
[ 1235.919640] ? trace_hardirqs_off+0xd/0x30
[ 1235.925032] ? exc_page_fault+0xda/0xf0
[ 1235.930134] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.936590] RIP: 0033:0x7fe8eb0e622e
[ 1235.941399] RSP: 002b:00007ffdeb78ec50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.950689] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe8eb0e622e
[ 1235.959495] RDX: 0000000000000001 RSI: 0000563b722613d0 RDI: 0000000000000007
[ 1235.968302] RBP: 00007ffdeb78ec60 R08: 0000000000000000 R09: 0000000000000000
[ 1235.977109] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe8eaf5e390
[ 1235.985916] R13: 0000563b722613d0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.994729]
[ 1235.997993] \x0aShowing all locks held in the system:
[ 1236.006529] 1 lock held by khungtaskd/185:
[ 1236.011924] #0: ffffffffab2fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.023398] 4 locks held by python3/3594:
[ 1236.028695] #0: ff1100012f9bc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.038583] #1: ff1100016701a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.049544] #2: ff11000122422b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.060693] #3: ff110001224f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.070788] 4 locks held by python3/5658:
[ 1236.076083] #0: ff1100012f9bc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.085972] #1: ff110002139e2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.096930] #2: ff11000122422b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.108090] #3: ff110001224f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.118181]
[ 1236.120649] =============================================\x0a
[ 1358.322016] INFO: task python3:5658 blocked for more than 491 seconds.
[ 1358.330772] Not tainted 7.1.0-rc2-sajk-g122090ccd4e6 #1
[ 1358.338035] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.347627] task:python3 state:D stack:25672 pid:5658 tgid:5658 ppid:5657 task_flags:0x400100 flags:0x00080002
[ 1358.360840] Call Trace:
[ 1358.364380]
[ 1358.367532] __schedule+0xcba/0x1940
[ 1358.372347] ? io_schedule_timeout+0x140/0x140
[ 1358.378132] ? find_held_lock+0x2b/0x80
[ 1358.383317] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.389203] schedule+0xd4/0x260
[ 1358.393622] schedule_preempt_disabled+0x18/0x30
[ 1358.399603] __mutex_lock+0x6a3/0x2000
[ 1358.399609] ? threaded_store+0x132/0x220
[ 1358.399615] ? ww_mutex_lock+0x160/0x160
[ 1358.399618] ? selinux_inode_free_security+0x330/0x330
[ 1358.399626] ? cap_capable+0x1d6/0x3e0
[ 1358.426757] ? threaded_store+0x132/0x220
[ 1358.432050] threaded_store+0x132/0x220
[ 1358.437153] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.442450] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.447747] ? sysfs_kf_write+0x65/0x160
[ 1358.452943] ? sysfs_file_ops+0x140/0x140
[ 1358.458238] kernfs_fop_write_iter+0x335/0x510
[ 1358.464020] ? kernfs_ops+0xf0/0xf0
[ 1358.468729] new_sync_write+0x333/0x750
[ 1358.473834] ? __lock_acquire+0x508/0xc10
[ 1358.479129] ? new_sync_read+0x740/0x740
[ 1358.484328] ? lock_acquire.part.0+0xbc/0x260
[ 1358.490005] ? ksys_write+0x116/0x250
[ 1358.494915] vfs_write+0x657/0x9b0
[ 1358.499531] ksys_write+0x116/0x250
[ 1358.504243] ? __ia32_sys_read+0xc0/0xc0
[ 1358.509442] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.515032] ? rcu_is_watching+0x15/0xd0
[ 1358.520231] do_syscall_64+0xf3/0x650
[ 1358.525135] ? trace_hardirqs_off+0xd/0x30
[ 1358.530529] ? exc_page_fault+0xda/0xf0
[ 1358.535629] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.542097] RIP: 0033:0x7f80d0a3422e
[ 1358.546907] RSP: 002b:00007ffda6898ca0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.556207] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f80d0a3422e
[ 1358.565016] RDX: 0000000000000001 RSI: 00005607144183d0 RDI: 0000000000000007
[ 1358.573830] RBP: 00007ffda6898cb0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.582634] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f80d08ac390
[ 1358.591441] R13: 00005607144183d0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.600254]
[ 1358.603587] INFO: task python3:5658 is blocked on a mutex likely owned by task python3:3594.
[ 1358.613858] task:python3 state:D stack:25624 pid:3594 tgid:3594 ppid:3593 task_flags:0x400100 flags:0x00080802
[ 1358.627059] Call Trace:
[ 1358.630595]
[ 1358.633744] __schedule+0xcba/0x1940
[ 1358.638557] ? io_schedule_timeout+0x140/0x140
[ 1358.644339] ? find_held_lock+0x2b/0x80
[ 1358.649439] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.655614] schedule+0xd4/0x260
[ 1358.660031] schedule_timeout+0x13f/0x290
[ 1358.665325] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.671693] ? trace_contention_end+0xb3/0x1a0
[ 1358.677478] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.683167] ? ww_mutex_lock+0x160/0x160
[ 1358.688366] msleep+0x1b/0x30
[ 1358.692490] napi_set_threaded+0x3a5/0x440
[ 1358.697885] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.703380] netif_set_threaded+0x257/0x400
[ 1358.708874] threaded_store+0x1b8/0x220
[ 1358.713975] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.719270] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.724567] ? sysfs_kf_write+0x65/0x160
[ 1358.729764] ? sysfs_file_ops+0x140/0x140
[ 1358.735061] kernfs_fop_write_iter+0x335/0x510
[ 1358.740847] ? kernfs_ops+0xf0/0xf0
[ 1358.745556] new_sync_write+0x333/0x750
[ 1358.750657] ? __lock_acquire+0x508/0xc10
[ 1358.755956] ? new_sync_read+0x740/0x740
[ 1358.761156] ? lock_acquire.part.0+0xbc/0x260
[ 1358.766836] ? ksys_write+0x116/0x250
[ 1358.771744] vfs_write+0x657/0x9b0
[ 1358.776359] ksys_write+0x116/0x250
[ 1358.781072] ? __ia32_sys_read+0xc0/0xc0
[ 1358.786267] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.791856] ? rcu_is_watching+0x15/0xd0
[ 1358.797056] do_syscall_64+0xf3/0x650
[ 1358.801954] ? trace_hardirqs_off+0xd/0x30
[ 1358.807347] ? exc_page_fault+0xda/0xf0
[ 1358.812446] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.818914] RIP: 0033:0x7fe8eb0e622e
[ 1358.823722] RSP: 002b:00007ffdeb78ec50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.833018] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe8eb0e622e
[ 1358.841831] RDX: 0000000000000001 RSI: 0000563b722613d0 RDI: 0000000000000007
[ 1358.850639] RBP: 00007ffdeb78ec60 R08: 0000000000000000 R09: 0000000000000000
[ 1358.859444] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe8eaf5e390
[ 1358.868251] R13: 0000563b722613d0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.877063]
[ 1358.880330] \x0aShowing all locks held in the system:
[ 1358.888872] 1 lock held by khungtaskd/185:
[ 1358.894266] #0: ffffffffab2fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.905749] 4 locks held by python3/3594:
[ 1358.911043] #0: ff1100012f9bc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.920935] #1: ff1100016701a680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.931896] #2: ff11000122422b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.943045] #3: ff110001224f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.953151] 4 locks held by python3/5658:
[ 1358.958444] #0: ff1100012f9bc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.968334] #1: ff110002139e2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.979286] #2: ff11000122422b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.990436] #3: ff110001224f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.000527] 5 locks held by (systemd-user-)/7502:
[ 1359.006602] #0: ff1100012fae43e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.016492] #1: ff1100012f732680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.027453] #2: ffffffffab369ce0 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1359.038121] #3: ffffffffab168970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650
[ 1359.049762] #4: ffffffffab369a50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650
[ 1359.062189]
[ 1359.064656] =============================================\x0a