[ 788.244263] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 788.246759] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 788.378349] kselftest: Running tests in drivers/net
[ 989.679571] INFO: task python3:5787 blocked for more than 122 seconds.
[ 989.687796] Not tainted 7.1.0-rc4-smgu-gc3c13c6c5345 #1
[ 989.695754] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.705336] task:python3 state:D stack:25672 pid:5787 tgid:5787 ppid:5786 task_flags:0x400100 flags:0x00080000
[ 989.718532] Call Trace:
[ 989.722074]
[ 989.725225] __schedule+0xcc3/0x19c0
[ 989.730045] ? io_schedule_timeout+0x140/0x140
[ 989.735833] ? find_held_lock+0x2b/0x80
[ 989.740937] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.746823] schedule+0xd8/0x260
[ 989.751242] schedule_preempt_disabled+0x18/0x30
[ 989.757224] __mutex_lock+0x6af/0x2010
[ 989.762227] ? threaded_store+0x132/0x220
[ 989.767517] ? ww_mutex_lock+0x160/0x160
[ 989.772718] ? selinux_inode_free_security+0x330/0x330
[ 989.779289] ? cap_capable+0x1d6/0x3e0
[ 989.784298] ? threaded_store+0x132/0x220
[ 989.789596] threaded_store+0x132/0x220
[ 989.794699] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.799993] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.805293] ? sysfs_kf_write+0x65/0x160
[ 989.810495] ? sysfs_file_ops+0x140/0x140
[ 989.815793] kernfs_fop_write_iter+0x335/0x510
[ 989.821578] ? kernfs_ops+0xf0/0xf0
[ 989.826291] new_sync_write+0x333/0x750
[ 989.831401] ? __lock_acquire+0x508/0xc10
[ 989.836699] ? new_sync_read+0x740/0x740
[ 989.841903] ? lock_acquire.part.0+0xbc/0x260
[ 989.847591] ? ksys_write+0x116/0x250
[ 989.852501] vfs_write+0x657/0x9b0
[ 989.857119] ksys_write+0x116/0x250
[ 989.861833] ? __ia32_sys_read+0xc0/0xc0
[ 989.867031] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.872618] ? rcu_is_watching+0x15/0xd0
[ 989.877820] do_syscall_64+0xf3/0x650
[ 989.882726] ? trace_hardirqs_off+0xd/0x30
[ 989.888122] ? exc_page_fault+0xda/0xf0
[ 989.893226] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.899695] RIP: 0033:0x7f4cd1cce22e
[ 989.904508] RSP: 002b:00007fff4792c520 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.913808] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cd1cce22e
[ 989.922618] RDX: 0000000000000001 RSI: 0000557cb39d1a90 RDI: 0000000000000007
[ 989.931428] RBP: 00007fff4792c530 R08: 0000000000000000 R09: 0000000000000000
[ 989.940235] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cd1b46390
[ 989.949044] R13: 0000557cb39d1a90 R14: 0000000000000007 R15: 0000000000000003
[ 989.957869]
[ 989.961160] INFO: task python3:5787 is blocked on a mutex likely owned by task python3:3748.
[ 989.971432] task:python3 state:D stack:25672 pid:3748 tgid:3748 ppid:3747 task_flags:0x400100 flags:0x00080802
[ 989.984637] Call Trace:
[ 989.988176]
[ 989.991327] __schedule+0xcc3/0x19c0
[ 989.996140] ? io_schedule_timeout+0x140/0x140
[ 990.001923] ? find_held_lock+0x2b/0x80
[ 990.007027] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.013205] schedule+0xd8/0x260
[ 990.017623] schedule_timeout+0x13f/0x290
[ 990.022920] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.029289] ? trace_contention_end+0xb3/0x1a0
[ 990.035076] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.040768] ? ww_mutex_lock+0x160/0x160
[ 990.045969] msleep+0x1b/0x30
[ 990.050096] napi_set_threaded+0x3a5/0x440
[ 990.055492] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.060987] netif_set_threaded+0x257/0x400
[ 990.066482] threaded_store+0x1b8/0x220
[ 990.071587] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.076886] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.082181] ? sysfs_kf_write+0x65/0x160
[ 990.087380] ? sysfs_file_ops+0x140/0x140
[ 990.092677] kernfs_fop_write_iter+0x335/0x510
[ 990.098465] ? kernfs_ops+0xf0/0xf0
[ 990.103176] new_sync_write+0x333/0x750
[ 990.108279] ? __lock_acquire+0x508/0xc10
[ 990.113577] ? new_sync_read+0x740/0x740
[ 990.118778] ? lock_acquire.part.0+0xbc/0x260
[ 990.124464] ? ksys_write+0x116/0x250
[ 990.129377] vfs_write+0x657/0x9b0
[ 990.133994] ksys_write+0x116/0x250
[ 990.138706] ? __ia32_sys_read+0xc0/0xc0
[ 990.143908] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.149499] ? rcu_is_watching+0x15/0xd0
[ 990.154698] do_syscall_64+0xf3/0x650
[ 990.159606] ? trace_hardirqs_off+0xd/0x30
[ 990.165000] ? exc_page_fault+0xda/0xf0
[ 990.170102] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.176571] RIP: 0033:0x7fb17913022e
[ 990.181379] RSP: 002b:00007fff4dc08930 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.190675] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb17913022e
[ 990.199474] RDX: 0000000000000001 RSI: 0000561af3efea90 RDI: 0000000000000007
[ 990.208277] RBP: 00007fff4dc08940 R08: 0000000000000000 R09: 0000000000000000
[ 990.217084] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb178fa8390
[ 990.225891] R13: 0000561af3efea90 R14: 0000000000000007 R15: 0000000000000003
[ 990.234705]
[ 990.237967] \x0aShowing all locks held in the system:
[ 990.246508] 1 lock held by khungtaskd/185:
[ 990.251900] #0: ffffffff988fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.263373] 2 locks held by systemd-journal/802:
[ 990.269353] #0: ff1100180e2b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.279241] #1: ffffffff98b029a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.292067] 4 locks held by python3/3748:
[ 990.297365] #0: ff110001303943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.307254] #1: ff11000169033880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.318220] #2: ff1100012387ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.329378] #3: ff110001238f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.339476] 4 locks held by python3/5787:
[ 990.344778] #0: ff110001303943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.354665] #1: ff110001e7c86280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.365626] #2: ff1100012387ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.376776] #3: ff110001238f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.386867]
[ 990.389323] =============================================\x0a
[ 1112.560596] INFO: task python3:5787 blocked for more than 245 seconds.
[ 1112.568743] Not tainted 7.1.0-rc4-smgu-gc3c13c6c5345 #1
[ 1112.575994] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.585586] task:python3 state:D stack:25672 pid:5787 tgid:5787 ppid:5786 task_flags:0x400100 flags:0x00080000
[ 1112.598794] Call Trace:
[ 1112.602336]
[ 1112.605485] __schedule+0xcc3/0x19c0
[ 1112.610304] ? io_schedule_timeout+0x140/0x140
[ 1112.616092] ? find_held_lock+0x2b/0x80
[ 1112.621196] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.627081] schedule+0xd8/0x260
[ 1112.631499] schedule_preempt_disabled+0x18/0x30
[ 1112.637476] __mutex_lock+0x6af/0x2010
[ 1112.642480] ? threaded_store+0x132/0x220
[ 1112.647779] ? ww_mutex_lock+0x160/0x160
[ 1112.652980] ? selinux_inode_free_security+0x330/0x330
[ 1112.659550] ? cap_capable+0x1d6/0x3e0
[ 1112.664559] ? threaded_store+0x132/0x220
[ 1112.669858] threaded_store+0x132/0x220
[ 1112.674960] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.680252] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.685553] ? sysfs_kf_write+0x65/0x160
[ 1112.690754] ? sysfs_file_ops+0x140/0x140
[ 1112.696051] kernfs_fop_write_iter+0x335/0x510
[ 1112.701835] ? kernfs_ops+0xf0/0xf0
[ 1112.706547] new_sync_write+0x333/0x750
[ 1112.711652] ? __lock_acquire+0x508/0xc10
[ 1112.716939] ? new_sync_read+0x740/0x740
[ 1112.722143] ? lock_acquire.part.0+0xbc/0x260
[ 1112.727830] ? ksys_write+0x116/0x250
[ 1112.732731] vfs_write+0x657/0x9b0
[ 1112.737345] ksys_write+0x116/0x250
[ 1112.742050] ? __ia32_sys_read+0xc0/0xc0
[ 1112.747249] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.752840] ? rcu_is_watching+0x15/0xd0
[ 1112.758041] do_syscall_64+0xf3/0x650
[ 1112.762940] ? trace_hardirqs_off+0xd/0x30
[ 1112.768338] ? exc_page_fault+0xda/0xf0
[ 1112.773442] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.779912] RIP: 0033:0x7f4cd1cce22e
[ 1112.784723] RSP: 002b:00007fff4792c520 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.794024] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cd1cce22e
[ 1112.802835] RDX: 0000000000000001 RSI: 0000557cb39d1a90 RDI: 0000000000000007
[ 1112.811645] RBP: 00007fff4792c530 R08: 0000000000000000 R09: 0000000000000000
[ 1112.820455] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cd1b46390
[ 1112.829263] R13: 0000557cb39d1a90 R14: 0000000000000007 R15: 0000000000000003
[ 1112.838077]
[ 1112.841376] INFO: task python3:5787 is blocked on a mutex likely owned by task python3:3748.
[ 1112.851649] task:python3 state:D stack:25672 pid:3748 tgid:3748 ppid:3747 task_flags:0x400100 flags:0x00080802
[ 1112.864854] Call Trace:
[ 1112.868392]
[ 1112.871540] __schedule+0xcc3/0x19c0
[ 1112.876354] ? io_schedule_timeout+0x140/0x140
[ 1112.882140] ? find_held_lock+0x2b/0x80
[ 1112.887245] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.893431] schedule+0xd8/0x260
[ 1112.897850] schedule_timeout+0x13f/0x290
[ 1112.903147] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.909515] ? trace_contention_end+0xb3/0x1a0
[ 1112.915302] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.920994] ? ww_mutex_lock+0x160/0x160
[ 1112.926194] msleep+0x1b/0x30
[ 1112.930311] napi_set_threaded+0x3a5/0x440
[ 1112.935705] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.941202] netif_set_threaded+0x257/0x400
[ 1112.946696] threaded_store+0x1b8/0x220
[ 1112.951801] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.957099] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.962394] ? sysfs_kf_write+0x65/0x160
[ 1112.967594] ? sysfs_file_ops+0x140/0x140
[ 1112.972891] kernfs_fop_write_iter+0x335/0x510
[ 1112.978674] ? kernfs_ops+0xf0/0xf0
[ 1112.983384] new_sync_write+0x333/0x750
[ 1112.988488] ? __lock_acquire+0x508/0xc10
[ 1112.993784] ? new_sync_read+0x740/0x740
[ 1112.998985] ? lock_acquire.part.0+0xbc/0x260
[ 1113.004670] ? ksys_write+0x116/0x250
[ 1113.009579] vfs_write+0x657/0x9b0
[ 1113.014195] ksys_write+0x116/0x250
[ 1113.018908] ? __ia32_sys_read+0xc0/0xc0
[ 1113.024100] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.029681] ? rcu_is_watching+0x15/0xd0
[ 1113.034880] do_syscall_64+0xf3/0x650
[ 1113.039789] ? trace_hardirqs_off+0xd/0x30
[ 1113.045184] ? exc_page_fault+0xda/0xf0
[ 1113.050286] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.056755] RIP: 0033:0x7fb17913022e
[ 1113.061565] RSP: 002b:00007fff4dc08930 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.070862] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb17913022e
[ 1113.079663] RDX: 0000000000000001 RSI: 0000561af3efea90 RDI: 0000000000000007
[ 1113.088472] RBP: 00007fff4dc08940 R08: 0000000000000000 R09: 0000000000000000
[ 1113.097274] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb178fa8390
[ 1113.106082] R13: 0000561af3efea90 R14: 0000000000000007 R15: 0000000000000003
[ 1113.114896]
[ 1113.118163] \x0aShowing all locks held in the system:
[ 1113.126705] 1 lock held by khungtaskd/185:
[ 1113.132097] #0: ffffffff988fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.143584] 4 locks held by python3/3748:
[ 1113.148881] #0: ff110001303943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.158771] #1: ff11000169033880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.169733] #2: ff1100012387ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.180890] #3: ff110001238f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.190988] 4 locks held by python3/5787:
[ 1113.196284] #0: ff110001303943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.206173] #1: ff110001e7c86280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.217138] #2: ff1100012387ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.228296] #3: ff110001238f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.238387]
[ 1113.240855] =============================================\x0a
[ 1235.441614] INFO: task python3:5787 blocked for more than 368 seconds.
[ 1235.449765] Not tainted 7.1.0-rc4-smgu-gc3c13c6c5345 #1
[ 1235.457016] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.466604] task:python3 state:D stack:25672 pid:5787 tgid:5787 ppid:5786 task_flags:0x400100 flags:0x00080002
[ 1235.479809] Call Trace:
[ 1235.483349]
[ 1235.486497] __schedule+0xcc3/0x19c0
[ 1235.491311] ? io_schedule_timeout+0x140/0x140
[ 1235.497096] ? find_held_lock+0x2b/0x80
[ 1235.502199] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.508084] schedule+0xd8/0x260
[ 1235.512502] schedule_preempt_disabled+0x18/0x30
[ 1235.518480] __mutex_lock+0x6af/0x2010
[ 1235.523482] ? threaded_store+0x132/0x220
[ 1235.528781] ? ww_mutex_lock+0x160/0x160
[ 1235.533979] ? selinux_inode_free_security+0x330/0x330
[ 1235.540550] ? cap_capable+0x1d6/0x3e0
[ 1235.545560] ? threaded_store+0x132/0x220
[ 1235.550859] threaded_store+0x132/0x220
[ 1235.555959] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.561256] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.566552] ? sysfs_kf_write+0x65/0x160
[ 1235.571749] ? sysfs_file_ops+0x140/0x140
[ 1235.577041] kernfs_fop_write_iter+0x335/0x510
[ 1235.582824] ? kernfs_ops+0xf0/0xf0
[ 1235.587535] new_sync_write+0x333/0x750
[ 1235.592636] ? __lock_acquire+0x508/0xc10
[ 1235.597930] ? new_sync_read+0x740/0x740
[ 1235.603128] ? lock_acquire.part.0+0xbc/0x260
[ 1235.608815] ? ksys_write+0x116/0x250
[ 1235.613716] vfs_write+0x657/0x9b0
[ 1235.618329] ksys_write+0x116/0x250
[ 1235.623041] ? __ia32_sys_read+0xc0/0xc0
[ 1235.628230] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.633817] ? rcu_is_watching+0x15/0xd0
[ 1235.639018] do_syscall_64+0xf3/0x650
[ 1235.643921] ? trace_hardirqs_off+0xd/0x30
[ 1235.649313] ? exc_page_fault+0xda/0xf0
[ 1235.654413] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.660879] RIP: 0033:0x7f4cd1cce22e
[ 1235.665677] RSP: 002b:00007fff4792c520 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.674973] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cd1cce22e
[ 1235.683779] RDX: 0000000000000001 RSI: 0000557cb39d1a90 RDI: 0000000000000007
[ 1235.692585] RBP: 00007fff4792c530 R08: 0000000000000000 R09: 0000000000000000
[ 1235.701391] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cd1b46390
[ 1235.710198] R13: 0000557cb39d1a90 R14: 0000000000000007 R15: 0000000000000003
[ 1235.719008]
[ 1235.722310] INFO: task python3:5787 is blocked on a mutex likely owned by task python3:3748.
[ 1235.732583] task:python3 state:D stack:25672 pid:3748 tgid:3748 ppid:3747 task_flags:0x400100 flags:0x00080802
[ 1235.745784] Call Trace:
[ 1235.749323]
[ 1235.752471] __schedule+0xcc3/0x19c0
[ 1235.757280] ? io_schedule_timeout+0x140/0x140
[ 1235.763061] ? find_held_lock+0x2b/0x80
[ 1235.768162] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.774342] schedule+0xd8/0x260
[ 1235.778760] schedule_timeout+0x13f/0x290
[ 1235.784058] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.790424] ? trace_contention_end+0xb3/0x1a0
[ 1235.796207] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.801896] ? ww_mutex_lock+0x160/0x160
[ 1235.807094] msleep+0x1b/0x30
[ 1235.811216] napi_set_threaded+0x3a5/0x440
[ 1235.816611] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.822106] netif_set_threaded+0x257/0x400
[ 1235.827597] threaded_store+0x1b8/0x220
[ 1235.832699] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.837995] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.843291] ? sysfs_kf_write+0x65/0x160
[ 1235.848488] ? sysfs_file_ops+0x140/0x140
[ 1235.853782] kernfs_fop_write_iter+0x335/0x510
[ 1235.859565] ? kernfs_ops+0xf0/0xf0
[ 1235.864273] new_sync_write+0x333/0x750
[ 1235.869373] ? __lock_acquire+0x508/0xc10
[ 1235.874669] ? new_sync_read+0x740/0x740
[ 1235.879868] ? lock_acquire.part.0+0xbc/0x260
[ 1235.885552] ? ksys_write+0x116/0x250
[ 1235.890464] vfs_write+0x657/0x9b0
[ 1235.895079] ksys_write+0x116/0x250
[ 1235.899780] ? __ia32_sys_read+0xc0/0xc0
[ 1235.904979] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.910567] ? rcu_is_watching+0x15/0xd0
[ 1235.915767] do_syscall_64+0xf3/0x650
[ 1235.920674] ? trace_hardirqs_off+0xd/0x30
[ 1235.926065] ? exc_page_fault+0xda/0xf0
[ 1235.931165] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.937630] RIP: 0033:0x7fb17913022e
[ 1235.942438] RSP: 002b:00007fff4dc08930 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.951734] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb17913022e
[ 1235.960539] RDX: 0000000000000001 RSI: 0000561af3efea90 RDI: 0000000000000007
[ 1235.969348] RBP: 00007fff4dc08940 R08: 0000000000000000 R09: 0000000000000000
[ 1235.978156] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb178fa8390
[ 1235.986963] R13: 0000561af3efea90 R14: 0000000000000007 R15: 0000000000000003
[ 1235.995776]
[ 1235.999046] \x0aShowing all locks held in the system:
[ 1236.007586] 1 lock held by khungtaskd/185:
[ 1236.012980] #0: ffffffff988fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.024465] 4 locks held by python3/3748:
[ 1236.029760] #0: ff110001303943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.039647] #1: ff11000169033880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.050607] #2: ff1100012387ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.061761] #3: ff110001238f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.071858] 4 locks held by python3/5787:
[ 1236.077154] #0: ff110001303943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.087042] #1: ff110001e7c86280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.098005] #2: ff1100012387ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.109160] #3: ff110001238f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.119250]
[ 1236.121714] =============================================\x0a
[ 1358.322642] INFO: task python3:5787 blocked for more than 491 seconds.
[ 1358.330789] Not tainted 7.1.0-rc4-smgu-gc3c13c6c5345 #1
[ 1358.338032] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.347621] task:python3 state:D stack:25672 pid:5787 tgid:5787 ppid:5786 task_flags:0x400100 flags:0x00080002
[ 1358.360821] Call Trace:
[ 1358.364363]
[ 1358.367513] __schedule+0xcc3/0x19c0
[ 1358.372329] ? io_schedule_timeout+0x140/0x140
[ 1358.378118] ? find_held_lock+0x2b/0x80
[ 1358.383223] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.389110] schedule+0xd8/0x260
[ 1358.393528] schedule_preempt_disabled+0x18/0x30
[ 1358.399507] __mutex_lock+0x6af/0x2010
[ 1358.404512] ? threaded_store+0x132/0x220
[ 1358.409812] ? ww_mutex_lock+0x160/0x160
[ 1358.415014] ? selinux_inode_free_security+0x330/0x330
[ 1358.421585] ? cap_capable+0x1d6/0x3e0
[ 1358.426595] ? threaded_store+0x132/0x220
[ 1358.431890] threaded_store+0x132/0x220
[ 1358.436993] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.442293] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.447594] ? sysfs_kf_write+0x65/0x160
[ 1358.452796] ? sysfs_file_ops+0x140/0x140
[ 1358.458095] kernfs_fop_write_iter+0x335/0x510
[ 1358.463882] ? kernfs_ops+0xf0/0xf0
[ 1358.468595] new_sync_write+0x333/0x750
[ 1358.473701] ? __lock_acquire+0x508/0xc10
[ 1358.478997] ? new_sync_read+0x740/0x740
[ 1358.484201] ? lock_acquire.part.0+0xbc/0x260
[ 1358.489888] ? ksys_write+0x116/0x250
[ 1358.494798] vfs_write+0x657/0x9b0
[ 1358.499416] ksys_write+0x116/0x250
[ 1358.504130] ? __ia32_sys_read+0xc0/0xc0
[ 1358.509329] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.514921] ? rcu_is_watching+0x15/0xd0
[ 1358.520123] do_syscall_64+0xf3/0x650
[ 1358.525029] ? trace_hardirqs_off+0xd/0x30
[ 1358.530425] ? exc_page_fault+0xda/0xf0
[ 1358.535529] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.541996] RIP: 0033:0x7f4cd1cce22e
[ 1358.546807] RSP: 002b:00007fff4792c520 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.556105] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4cd1cce22e
[ 1358.564915] RDX: 0000000000000001 RSI: 0000557cb39d1a90 RDI: 0000000000000007
[ 1358.573724] RBP: 00007fff4792c530 R08: 0000000000000000 R09: 0000000000000000
[ 1358.582536] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4cd1b46390
[ 1358.591345] R13: 0000557cb39d1a90 R14: 0000000000000007 R15: 0000000000000003
[ 1358.600159]
[ 1358.603439] INFO: task python3:5787 is blocked on a mutex likely owned by task python3:3748.
[ 1358.613711] task:python3 state:D stack:25672 pid:3748 tgid:3748 ppid:3747 task_flags:0x400100 flags:0x00080802
[ 1358.626916] Call Trace:
[ 1358.630454]
[ 1358.633608] __schedule+0xcc3/0x19c0
[ 1358.638420] ? io_schedule_timeout+0x140/0x140
[ 1358.644205] ? find_held_lock+0x2b/0x80
[ 1358.649310] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.655493] schedule+0xd8/0x260
[ 1358.659912] schedule_timeout+0x13f/0x290
[ 1358.665209] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.671580] ? trace_contention_end+0xb3/0x1a0
[ 1358.677364] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.683055] ? ww_mutex_lock+0x160/0x160
[ 1358.688256] msleep+0x1b/0x30
[ 1358.692381] napi_set_threaded+0x3a5/0x440
[ 1358.697780] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.703273] netif_set_threaded+0x257/0x400
[ 1358.708767] threaded_store+0x1b8/0x220
[ 1358.713872] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.719170] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.724460] ? sysfs_kf_write+0x65/0x160
[ 1358.729661] ? sysfs_file_ops+0x140/0x140
[ 1358.734957] kernfs_fop_write_iter+0x335/0x510
[ 1358.740741] ? kernfs_ops+0xf0/0xf0
[ 1358.745452] new_sync_write+0x333/0x750
[ 1358.750557] ? __lock_acquire+0x508/0xc10
[ 1358.755852] ? new_sync_read+0x740/0x740
[ 1358.761054] ? lock_acquire.part.0+0xbc/0x260
[ 1358.766739] ? ksys_write+0x116/0x250
[ 1358.771649] vfs_write+0x657/0x9b0
[ 1358.776265] ksys_write+0x116/0x250
[ 1358.780979] ? __ia32_sys_read+0xc0/0xc0
[ 1358.786180] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.791770] ? rcu_is_watching+0x15/0xd0
[ 1358.796963] do_syscall_64+0xf3/0x650
[ 1358.801872] ? trace_hardirqs_off+0xd/0x30
[ 1358.807267] ? exc_page_fault+0xda/0xf0
[ 1358.812369] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.818836] RIP: 0033:0x7fb17913022e
[ 1358.823637] RSP: 002b:00007fff4dc08930 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.832926] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb17913022e
[ 1358.841732] RDX: 0000000000000001 RSI: 0000561af3efea90 RDI: 0000000000000007
[ 1358.850539] RBP: 00007fff4dc08940 R08: 0000000000000000 R09: 0000000000000000
[ 1358.859348] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb178fa8390
[ 1358.868156] R13: 0000561af3efea90 R14: 0000000000000007 R15: 0000000000000003
[ 1358.876971]
[ 1358.880243] \x0aShowing all locks held in the system:
[ 1358.888782] 1 lock held by khungtaskd/185:
[ 1358.894175] #0: ffffffff988fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.905657] 4 locks held by python3/3748:
[ 1358.910954] #0: ff110001303943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.920847] #1: ff11000169033880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.931807] #2: ff1100012387ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.942964] #3: ff110001238f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.953059] 4 locks held by python3/5787:
[ 1358.958355] #0: ff110001303943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.968244] #1: ff110001e7c86280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.979199] #2: ff1100012387ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.990356] #3: ff110001238f9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.000441]
[ 1359.002909] =============================================\x0a