[ 790.126046] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 790.128509] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 790.286612] kselftest: Running tests in drivers/net
[ 989.684498] INFO: task python3:5880 blocked for more than 122 seconds.
[ 989.692712] Not tainted 7.1.0-rc5-sswl-g3968d78bede8 #1
[ 989.700468] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.710056] task:python3 state:D stack:25672 pid:5880 tgid:5880 ppid:5879 task_flags:0x400100 flags:0x00080000
[ 989.723262] Call Trace:
[ 989.726799]
[ 989.729948] __schedule+0xcc3/0x19c0
[ 989.734767] ? io_schedule_timeout+0x140/0x140
[ 989.740553] ? find_held_lock+0x2b/0x80
[ 989.745658] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.751541] schedule+0xd8/0x260
[ 989.755960] schedule_preempt_disabled+0x18/0x30
[ 989.761940] __mutex_lock+0x6af/0x2010
[ 989.766937] ? threaded_store+0x132/0x220
[ 989.772238] ? ww_mutex_lock+0x160/0x160
[ 989.777435] ? selinux_inode_free_security+0x330/0x330
[ 989.784004] ? cap_capable+0x1d6/0x3e0
[ 989.789011] ? threaded_store+0x132/0x220
[ 989.794309] threaded_store+0x132/0x220
[ 989.799415] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.804711] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.810007] ? sysfs_kf_write+0x65/0x160
[ 989.815206] ? sysfs_file_ops+0x140/0x140
[ 989.820500] kernfs_fop_write_iter+0x335/0x510
[ 989.826283] ? kernfs_ops+0xf0/0xf0
[ 989.830993] new_sync_write+0x333/0x750
[ 989.836086] ? __lock_acquire+0x508/0xc10
[ 989.841380] ? new_sync_read+0x740/0x740
[ 989.846582] ? lock_acquire.part.0+0xbc/0x260
[ 989.852266] ? ksys_write+0x116/0x250
[ 989.857173] vfs_write+0x657/0x9b0
[ 989.861789] ksys_write+0x116/0x250
[ 989.866501] ? __ia32_sys_read+0xc0/0xc0
[ 989.871697] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.877283] ? rcu_is_watching+0x15/0xd0
[ 989.882485] do_syscall_64+0xf3/0x650
[ 989.887390] ? trace_hardirqs_off+0xd/0x30
[ 989.892786] ? exc_page_fault+0xda/0xf0
[ 989.897888] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.904353] RIP: 0033:0x7fb03694c22e
[ 989.909163] RSP: 002b:00007ffd04741f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.918460] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb03694c22e
[ 989.927267] RDX: 0000000000000001 RSI: 000056033dd736b0 RDI: 0000000000000007
[ 989.936072] RBP: 00007ffd04741f60 R08: 0000000000000000 R09: 0000000000000000
[ 989.944877] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb0367c4390
[ 989.953684] R13: 000056033dd736b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.962502]
[ 989.965829] INFO: task python3:5880 is blocked on a mutex likely owned by task python3:3841.
[ 989.976109] task:python3 state:D stack:25672 pid:3841 tgid:3841 ppid:3840 task_flags:0x400100 flags:0x00080802
[ 989.989313] Call Trace:
[ 989.992854]
[ 989.996006] __schedule+0xcc3/0x19c0
[ 990.000818] ? io_schedule_timeout+0x140/0x140
[ 990.006600] ? find_held_lock+0x2b/0x80
[ 990.011704] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.017881] schedule+0xd8/0x260
[ 990.022296] schedule_timeout+0x13f/0x290
[ 990.027592] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.033960] ? trace_contention_end+0xb3/0x1a0
[ 990.039745] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.045436] ? ww_mutex_lock+0x160/0x160
[ 990.050636] msleep+0x1b/0x30
[ 990.054752] napi_set_threaded+0x3a5/0x440
[ 990.060144] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.065639] netif_set_threaded+0x257/0x400
[ 990.071133] threaded_store+0x1b8/0x220
[ 990.076236] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.081524] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.086819] ? sysfs_kf_write+0x65/0x160
[ 990.092017] ? sysfs_file_ops+0x140/0x140
[ 990.097311] kernfs_fop_write_iter+0x335/0x510
[ 990.103094] ? kernfs_ops+0xf0/0xf0
[ 990.107804] new_sync_write+0x333/0x750
[ 990.112906] ? __lock_acquire+0x508/0xc10
[ 990.118199] ? new_sync_read+0x740/0x740
[ 990.123399] ? lock_acquire.part.0+0xbc/0x260
[ 990.129086] ? ksys_write+0x116/0x250
[ 990.133993] vfs_write+0x657/0x9b0
[ 990.138605] ksys_write+0x116/0x250
[ 990.143321] ? __ia32_sys_read+0xc0/0xc0
[ 990.148519] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.154106] ? rcu_is_watching+0x15/0xd0
[ 990.159303] do_syscall_64+0xf3/0x650
[ 990.164207] ? trace_hardirqs_off+0xd/0x30
[ 990.169600] ? exc_page_fault+0xda/0xf0
[ 990.174702] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.181167] RIP: 0033:0x7f83ed83f22e
[ 990.185975] RSP: 002b:00007ffc63ac91f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.195272] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f83ed83f22e
[ 990.204081] RDX: 0000000000000001 RSI: 0000557c30dba6b0 RDI: 0000000000000007
[ 990.212891] RBP: 00007ffc63ac9200 R08: 0000000000000000 R09: 0000000000000000
[ 990.221697] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83ed6b7390
[ 990.230508] R13: 0000557c30dba6b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.239328]
[ 990.242589] \x0aShowing all locks held in the system:
[ 990.251132] 1 lock held by khungtaskd/184:
[ 990.256523] #0: ffffffff9b0fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.268018] 4 locks held by python3/3841:
[ 990.273314] #0: ff1100012faac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.283211] #1: ff11000182514a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.294174] #2: ff110001233a8b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.305331] #3: ff110001233f1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.315434] 4 locks held by python3/5880:
[ 990.320729] #0: ff1100012faac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.330618] #1: ff110001f252f480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.341580] #2: ff110001233a8b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.352740] #3: ff110001233f1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.362828]
[ 990.365294] =============================================\x0a
[ 1112.566120] INFO: task python3:5880 blocked for more than 245 seconds.
[ 1112.574268] Not tainted 7.1.0-rc5-sswl-g3968d78bede8 #1
[ 1112.581519] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.591109] task:python3 state:D stack:25672 pid:5880 tgid:5880 ppid:5879 task_flags:0x400100 flags:0x00080000
[ 1112.604317] Call Trace:
[ 1112.607856]
[ 1112.611010] __schedule+0xcc3/0x19c0
[ 1112.615829] ? io_schedule_timeout+0x140/0x140
[ 1112.621616] ? find_held_lock+0x2b/0x80
[ 1112.626722] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.632606] schedule+0xd8/0x260
[ 1112.637026] schedule_preempt_disabled+0x18/0x30
[ 1112.642998] __mutex_lock+0x6af/0x2010
[ 1112.648006] ? threaded_store+0x132/0x220
[ 1112.653305] ? ww_mutex_lock+0x160/0x160
[ 1112.658495] ? selinux_inode_free_security+0x330/0x330
[ 1112.665055] ? cap_capable+0x1d6/0x3e0
[ 1112.670065] ? threaded_store+0x132/0x220
[ 1112.675364] threaded_store+0x132/0x220
[ 1112.680465] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.685763] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.691064] ? sysfs_kf_write+0x65/0x160
[ 1112.696268] ? sysfs_file_ops+0x140/0x140
[ 1112.701564] kernfs_fop_write_iter+0x335/0x510
[ 1112.707352] ? kernfs_ops+0xf0/0xf0
[ 1112.712062] new_sync_write+0x333/0x750
[ 1112.717166] ? __lock_acquire+0x508/0xc10
[ 1112.722462] ? new_sync_read+0x740/0x740
[ 1112.727665] ? lock_acquire.part.0+0xbc/0x260
[ 1112.733353] ? ksys_write+0x116/0x250
[ 1112.738262] vfs_write+0x657/0x9b0
[ 1112.742878] ksys_write+0x116/0x250
[ 1112.747592] ? __ia32_sys_read+0xc0/0xc0
[ 1112.752792] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.758376] ? rcu_is_watching+0x15/0xd0
[ 1112.763576] do_syscall_64+0xf3/0x650
[ 1112.768476] ? trace_hardirqs_off+0xd/0x30
[ 1112.773872] ? exc_page_fault+0xda/0xf0
[ 1112.778976] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.785447] RIP: 0033:0x7fb03694c22e
[ 1112.790257] RSP: 002b:00007ffd04741f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.799547] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb03694c22e
[ 1112.808357] RDX: 0000000000000001 RSI: 000056033dd736b0 RDI: 0000000000000007
[ 1112.817168] RBP: 00007ffd04741f60 R08: 0000000000000000 R09: 0000000000000000
[ 1112.825978] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb0367c4390
[ 1112.834785] R13: 000056033dd736b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.843598]
[ 1112.846879] INFO: task python3:5880 is blocked on a mutex likely owned by task python3:3841.
[ 1112.857151] task:python3 state:D stack:25672 pid:3841 tgid:3841 ppid:3840 task_flags:0x400100 flags:0x00080802
[ 1112.870355] Call Trace:
[ 1112.873895]
[ 1112.877048] __schedule+0xcc3/0x19c0
[ 1112.881860] ? io_schedule_timeout+0x140/0x140
[ 1112.887645] ? find_held_lock+0x2b/0x80
[ 1112.892740] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.898917] schedule+0xd8/0x260
[ 1112.903334] schedule_timeout+0x13f/0x290
[ 1112.908635] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.915005] ? trace_contention_end+0xb3/0x1a0
[ 1112.920792] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.926483] ? ww_mutex_lock+0x160/0x160
[ 1112.931684] msleep+0x1b/0x30
[ 1112.935808] napi_set_threaded+0x3a5/0x440
[ 1112.941205] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.946699] netif_set_threaded+0x257/0x400
[ 1112.952191] threaded_store+0x1b8/0x220
[ 1112.957288] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.962585] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.967873] ? sysfs_kf_write+0x65/0x160
[ 1112.973072] ? sysfs_file_ops+0x140/0x140
[ 1112.978369] kernfs_fop_write_iter+0x335/0x510
[ 1112.984152] ? kernfs_ops+0xf0/0xf0
[ 1112.988862] new_sync_write+0x333/0x750
[ 1112.993966] ? __lock_acquire+0x508/0xc10
[ 1112.999264] ? new_sync_read+0x740/0x740
[ 1113.004465] ? lock_acquire.part.0+0xbc/0x260
[ 1113.010151] ? ksys_write+0x116/0x250
[ 1113.015061] vfs_write+0x657/0x9b0
[ 1113.019677] ksys_write+0x116/0x250
[ 1113.024390] ? __ia32_sys_read+0xc0/0xc0
[ 1113.029588] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.035178] ? rcu_is_watching+0x15/0xd0
[ 1113.040378] do_syscall_64+0xf3/0x650
[ 1113.045277] ? trace_hardirqs_off+0xd/0x30
[ 1113.050672] ? exc_page_fault+0xda/0xf0
[ 1113.055775] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.062245] RIP: 0033:0x7f83ed83f22e
[ 1113.067055] RSP: 002b:00007ffc63ac91f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.076354] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f83ed83f22e
[ 1113.085164] RDX: 0000000000000001 RSI: 0000557c30dba6b0 RDI: 0000000000000007
[ 1113.093970] RBP: 00007ffc63ac9200 R08: 0000000000000000 R09: 0000000000000000
[ 1113.102781] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83ed6b7390
[ 1113.111590] R13: 0000557c30dba6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.120406]
[ 1113.123669] \x0aShowing all locks held in the system:
[ 1113.132210] 1 lock held by khungtaskd/184:
[ 1113.137604] #0: ffffffff9b0fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.149086] 4 locks held by python3/3841:
[ 1113.154383] #0: ff1100012faac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.164275] #1: ff11000182514a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.175235] #2: ff110001233a8b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.186392] #3: ff110001233f1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.196489] 4 locks held by python3/5880:
[ 1113.201785] #0: ff1100012faac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.211675] #1: ff110001f252f480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.222639] #2: ff110001233a8b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.233798] #3: ff110001233f1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.243890]
[ 1113.246354] =============================================\x0a
[ 1235.447756] INFO: task python3:5880 blocked for more than 368 seconds.
[ 1235.455896] Not tainted 7.1.0-rc5-sswl-g3968d78bede8 #1
[ 1235.463136] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.472713] task:python3 state:D stack:25672 pid:5880 tgid:5880 ppid:5879 task_flags:0x400100 flags:0x00080002
[ 1235.485921] Call Trace:
[ 1235.489457]
[ 1235.492605] __schedule+0xcc3/0x19c0
[ 1235.497420] ? io_schedule_timeout+0x140/0x140
[ 1235.503206] ? find_held_lock+0x2b/0x80
[ 1235.508312] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.514196] schedule+0xd8/0x260
[ 1235.518614] schedule_preempt_disabled+0x18/0x30
[ 1235.524594] __mutex_lock+0x6af/0x2010
[ 1235.529590] ? threaded_store+0x132/0x220
[ 1235.534888] ? ww_mutex_lock+0x160/0x160
[ 1235.540085] ? selinux_inode_free_security+0x330/0x330
[ 1235.546654] ? cap_capable+0x1d6/0x3e0
[ 1235.551662] ? threaded_store+0x132/0x220
[ 1235.556961] threaded_store+0x132/0x220
[ 1235.562061] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.567356] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.572651] ? sysfs_kf_write+0x65/0x160
[ 1235.577848] ? sysfs_file_ops+0x140/0x140
[ 1235.583144] kernfs_fop_write_iter+0x335/0x510
[ 1235.588926] ? kernfs_ops+0xf0/0xf0
[ 1235.593634] new_sync_write+0x333/0x750
[ 1235.598738] ? __lock_acquire+0x508/0xc10
[ 1235.604024] ? new_sync_read+0x740/0x740
[ 1235.609225] ? lock_acquire.part.0+0xbc/0x260
[ 1235.614907] ? ksys_write+0x116/0x250
[ 1235.619817] vfs_write+0x657/0x9b0
[ 1235.624430] ksys_write+0x116/0x250
[ 1235.629139] ? __ia32_sys_read+0xc0/0xc0
[ 1235.634336] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.639922] ? rcu_is_watching+0x15/0xd0
[ 1235.645121] do_syscall_64+0xf3/0x650
[ 1235.650026] ? trace_hardirqs_off+0xd/0x30
[ 1235.655420] ? exc_page_fault+0xda/0xf0
[ 1235.660523] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.666989] RIP: 0033:0x7fb03694c22e
[ 1235.671796] RSP: 002b:00007ffd04741f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.681095] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb03694c22e
[ 1235.689902] RDX: 0000000000000001 RSI: 000056033dd736b0 RDI: 0000000000000007
[ 1235.698708] RBP: 00007ffd04741f60 R08: 0000000000000000 R09: 0000000000000000
[ 1235.707513] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb0367c4390
[ 1235.716320] R13: 000056033dd736b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.725131]
[ 1235.728432] INFO: task python3:5880 is blocked on a mutex likely owned by task python3:3841.
[ 1235.738703] task:python3 state:D stack:25672 pid:3841 tgid:3841 ppid:3840 task_flags:0x400100 flags:0x00080802
[ 1235.751907] Call Trace:
[ 1235.755443]
[ 1235.758590] __schedule+0xcc3/0x19c0
[ 1235.763400] ? io_schedule_timeout+0x140/0x140
[ 1235.769183] ? find_held_lock+0x2b/0x80
[ 1235.774283] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.780461] schedule+0xd8/0x260
[ 1235.784879] schedule_timeout+0x13f/0x290
[ 1235.790177] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.796546] ? trace_contention_end+0xb3/0x1a0
[ 1235.802323] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.808002] ? ww_mutex_lock+0x160/0x160
[ 1235.813198] msleep+0x1b/0x30
[ 1235.817325] napi_set_threaded+0x3a5/0x440
[ 1235.822720] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.828213] netif_set_threaded+0x257/0x400
[ 1235.833706] threaded_store+0x1b8/0x220
[ 1235.838807] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.844103] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.849398] ? sysfs_kf_write+0x65/0x160
[ 1235.854595] ? sysfs_file_ops+0x140/0x140
[ 1235.859891] kernfs_fop_write_iter+0x335/0x510
[ 1235.865674] ? kernfs_ops+0xf0/0xf0
[ 1235.870382] new_sync_write+0x333/0x750
[ 1235.875485] ? __lock_acquire+0x508/0xc10
[ 1235.880773] ? new_sync_read+0x740/0x740
[ 1235.885971] ? lock_acquire.part.0+0xbc/0x260
[ 1235.891655] ? ksys_write+0x116/0x250
[ 1235.896563] vfs_write+0x657/0x9b0
[ 1235.901176] ksys_write+0x116/0x250
[ 1235.905887] ? __ia32_sys_read+0xc0/0xc0
[ 1235.911085] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.916672] ? rcu_is_watching+0x15/0xd0
[ 1235.921872] do_syscall_64+0xf3/0x650
[ 1235.926769] ? trace_hardirqs_off+0xd/0x30
[ 1235.932161] ? exc_page_fault+0xda/0xf0
[ 1235.937261] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.943726] RIP: 0033:0x7f83ed83f22e
[ 1235.948533] RSP: 002b:00007ffc63ac91f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.957827] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f83ed83f22e
[ 1235.966633] RDX: 0000000000000001 RSI: 0000557c30dba6b0 RDI: 0000000000000007
[ 1235.975441] RBP: 00007ffc63ac9200 R08: 0000000000000000 R09: 0000000000000000
[ 1235.984238] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83ed6b7390
[ 1235.993044] R13: 0000557c30dba6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1236.001855]
[ 1236.005121] \x0aShowing all locks held in the system:
[ 1236.013654] 1 lock held by khungtaskd/184:
[ 1236.019044] #0: ffffffff9b0fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.030530] 4 locks held by python3/3841:
[ 1236.035827] #0: ff1100012faac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.045719] #1: ff11000182514a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.056678] #2: ff110001233a8b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.067834] #3: ff110001233f1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.077931] 4 locks held by python3/5880:
[ 1236.083225] #0: ff1100012faac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.093115] #1: ff110001f252f480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.104064] #2: ff110001233a8b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.115222] #3: ff110001233f1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.125315]
[ 1236.127783] =============================================\x0a
[ 1358.329349] INFO: task python3:5880 blocked for more than 491 seconds.
[ 1358.337495] Not tainted 7.1.0-rc5-sswl-g3968d78bede8 #1
[ 1358.344744] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.354331] task:python3 state:D stack:25672 pid:5880 tgid:5880 ppid:5879 task_flags:0x400100 flags:0x00080002
[ 1358.367535] Call Trace:
[ 1358.371074]
[ 1358.374223] __schedule+0xcc3/0x19c0
[ 1358.379040] ? io_schedule_timeout+0x140/0x140
[ 1358.384825] ? find_held_lock+0x2b/0x80
[ 1358.389932] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.395815] schedule+0xd8/0x260
[ 1358.400222] schedule_preempt_disabled+0x18/0x30
[ 1358.406200] __mutex_lock+0x6af/0x2010
[ 1358.411204] ? threaded_store+0x132/0x220
[ 1358.416503] ? ww_mutex_lock+0x160/0x160
[ 1358.421701] ? selinux_inode_free_security+0x330/0x330
[ 1358.428270] ? cap_capable+0x1d6/0x3e0
[ 1358.433278] ? threaded_store+0x132/0x220
[ 1358.438575] threaded_store+0x132/0x220
[ 1358.443679] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.448974] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.454275] ? sysfs_kf_write+0x65/0x160
[ 1358.459475] ? sysfs_file_ops+0x140/0x140
[ 1358.464770] kernfs_fop_write_iter+0x335/0x510
[ 1358.470552] ? kernfs_ops+0xf0/0xf0
[ 1358.475261] new_sync_write+0x333/0x750
[ 1358.480365] ? __lock_acquire+0x508/0xc10
[ 1358.485659] ? new_sync_read+0x740/0x740
[ 1358.490861] ? lock_acquire.part.0+0xbc/0x260
[ 1358.496545] ? ksys_write+0x116/0x250
[ 1358.501454] vfs_write+0x657/0x9b0
[ 1358.506070] ksys_write+0x116/0x250
[ 1358.510771] ? __ia32_sys_read+0xc0/0xc0
[ 1358.515967] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.521557] ? rcu_is_watching+0x15/0xd0
[ 1358.526755] do_syscall_64+0xf3/0x650
[ 1358.531658] ? trace_hardirqs_off+0xd/0x30
[ 1358.537052] ? exc_page_fault+0xda/0xf0
[ 1358.542155] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.548619] RIP: 0033:0x7fb03694c22e
[ 1358.553426] RSP: 002b:00007ffd04741f50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.562725] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb03694c22e
[ 1358.571529] RDX: 0000000000000001 RSI: 000056033dd736b0 RDI: 0000000000000007
[ 1358.580334] RBP: 00007ffd04741f60 R08: 0000000000000000 R09: 0000000000000000
[ 1358.589141] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb0367c4390
[ 1358.597946] R13: 000056033dd736b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.606759]
[ 1358.610047] INFO: task python3:5880 is blocked on a mutex likely owned by task python3:3841.
[ 1358.620318] task:python3 state:D stack:25672 pid:3841 tgid:3841 ppid:3840 task_flags:0x400100 flags:0x00080802
[ 1358.633523] Call Trace:
[ 1358.637063]
[ 1358.640210] __schedule+0xcc3/0x19c0
[ 1358.645021] ? io_schedule_timeout+0x140/0x140
[ 1358.650806] ? find_held_lock+0x2b/0x80
[ 1358.655908] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.662085] schedule+0xd8/0x260
[ 1358.666504] schedule_timeout+0x13f/0x290
[ 1358.671792] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.678161] ? trace_contention_end+0xb3/0x1a0
[ 1358.683943] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.689631] ? ww_mutex_lock+0x160/0x160
[ 1358.694830] msleep+0x1b/0x30
[ 1358.698952] napi_set_threaded+0x3a5/0x440
[ 1358.704346] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.709839] netif_set_threaded+0x257/0x400
[ 1358.715330] threaded_store+0x1b8/0x220
[ 1358.720431] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.725729] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.731024] ? sysfs_kf_write+0x65/0x160
[ 1358.736224] ? sysfs_file_ops+0x140/0x140
[ 1358.741517] kernfs_fop_write_iter+0x335/0x510
[ 1358.747300] ? kernfs_ops+0xf0/0xf0
[ 1358.752010] new_sync_write+0x333/0x750
[ 1358.757113] ? __lock_acquire+0x508/0xc10
[ 1358.762408] ? new_sync_read+0x740/0x740
[ 1358.767623] ? lock_acquire.part.0+0xbc/0x260
[ 1358.773312] ? ksys_write+0x116/0x250
[ 1358.778224] vfs_write+0x657/0x9b0
[ 1358.782840] ksys_write+0x116/0x250
[ 1358.787553] ? __ia32_sys_read+0xc0/0xc0
[ 1358.792742] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.798329] ? rcu_is_watching+0x15/0xd0
[ 1358.803530] do_syscall_64+0xf3/0x650
[ 1358.808437] ? trace_hardirqs_off+0xd/0x30
[ 1358.813827] ? exc_page_fault+0xda/0xf0
[ 1358.818929] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.825395] RIP: 0033:0x7f83ed83f22e
[ 1358.830203] RSP: 002b:00007ffc63ac91f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.839502] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f83ed83f22e
[ 1358.848310] RDX: 0000000000000001 RSI: 0000557c30dba6b0 RDI: 0000000000000007
[ 1358.857117] RBP: 00007ffc63ac9200 R08: 0000000000000000 R09: 0000000000000000
[ 1358.866015] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83ed6b7390
[ 1358.874823] R13: 0000557c30dba6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.883636]
[ 1358.886903] \x0aShowing all locks held in the system:
[ 1358.895447] 1 lock held by khungtaskd/184:
[ 1358.900841] #0: ffffffff9b0fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.912327] 4 locks held by python3/3841:
[ 1358.917624] #0: ff1100012faac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.927515] #1: ff11000182514a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.938475] #2: ff110001233a8b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.949630] #3: ff110001233f1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.959730] 4 locks held by python3/5880:
[ 1358.965023] #0: ff1100012faac3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.974913] #1: ff110001f252f480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.985873] #2: ff110001233a8b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.997028] #3: ff110001233f1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.007120]
[ 1359.009583] =============================================\x0a