[ 789.445150] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 789.447588] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 789.611951] kselftest: Running tests in drivers/net
[ 928.219167] kworker/u129:15 (308) used greatest stack depth: 21456 bytes left
[ 989.659700] INFO: task python3:5851 blocked for more than 122 seconds.
[ 989.667940] Not tainted 7.1.0-rc3-yitb-ga5808e471b85 #1
[ 989.675902] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.685492] task:python3 state:D stack:25672 pid:5851 tgid:5851 ppid:5850 task_flags:0x400100 flags:0x00080000
[ 989.698697] Call Trace:
[ 989.702238]
[ 989.705388] __schedule+0xcc3/0x19c0
[ 989.710209] ? io_schedule_timeout+0x140/0x140
[ 989.715996] ? find_held_lock+0x2b/0x80
[ 989.721098] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.726985] schedule+0xd4/0x260
[ 989.731403] schedule_preempt_disabled+0x18/0x30
[ 989.737384] __mutex_lock+0x6a3/0x2000
[ 989.742391] ? threaded_store+0x132/0x220
[ 989.747691] ? ww_mutex_lock+0x160/0x160
[ 989.752890] ? selinux_inode_free_security+0x330/0x330
[ 989.759461] ? cap_capable+0x1d6/0x3e0
[ 989.764470] ? threaded_store+0x132/0x220
[ 989.769767] threaded_store+0x132/0x220
[ 989.774863] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.780160] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.785458] ? sysfs_kf_write+0x65/0x160
[ 989.790661] ? sysfs_file_ops+0x140/0x140
[ 989.795958] kernfs_fop_write_iter+0x335/0x510
[ 989.801742] ? kernfs_ops+0xf0/0xf0
[ 989.806454] new_sync_write+0x333/0x750
[ 989.811559] ? __lock_acquire+0x508/0xc10
[ 989.816856] ? new_sync_read+0x740/0x740
[ 989.822050] ? lock_acquire.part.0+0xbc/0x260
[ 989.827737] ? ksys_write+0x116/0x250
[ 989.832648] vfs_write+0x657/0x9b0
[ 989.837266] ksys_write+0x116/0x250
[ 989.841979] ? __ia32_sys_read+0xc0/0xc0
[ 989.847177] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.852769] ? rcu_is_watching+0x15/0xd0
[ 989.857971] do_syscall_64+0xf3/0x650
[ 989.862877] ? trace_hardirqs_off+0xd/0x30
[ 989.868275] ? exc_page_fault+0xda/0xf0
[ 989.873378] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.879848] RIP: 0033:0x7f4290e5a22e
[ 989.884660] RSP: 002b:00007ffd412af070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.893959] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4290e5a22e
[ 989.902770] RDX: 0000000000000001 RSI: 000055c2abff5cd0 RDI: 0000000000000007
[ 989.911581] RBP: 00007ffd412af080 R08: 0000000000000000 R09: 0000000000000000
[ 989.920390] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4290cd2390
[ 989.929199] R13: 000055c2abff5cd0 R14: 0000000000000007 R15: 0000000000000003
[ 989.938020]
[ 989.941293] INFO: task python3:5851 is blocked on a mutex likely owned by task python3:3828.
[ 989.951569] task:python3 state:D stack:25672 pid:3828 tgid:3828 ppid:3827 task_flags:0x400100 flags:0x00080802
[ 989.964764] Call Trace:
[ 989.968303]
[ 989.971454] __schedule+0xcc3/0x19c0
[ 989.976257] ? io_schedule_timeout+0x140/0x140
[ 989.982041] ? find_held_lock+0x2b/0x80
[ 989.987145] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.993324] schedule+0xd4/0x260
[ 989.997743] schedule_timeout+0x13f/0x290
[ 990.003042] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.009413] ? trace_contention_end+0xb3/0x1a0
[ 990.015199] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.020891] ? ww_mutex_lock+0x160/0x160
[ 990.026091] msleep+0x1b/0x30
[ 990.030219] napi_set_threaded+0x3a5/0x440
[ 990.035608] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.041102] netif_set_threaded+0x257/0x400
[ 990.046596] threaded_store+0x1b8/0x220
[ 990.051698] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.056996] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.062282] ? sysfs_kf_write+0x65/0x160
[ 990.067482] ? sysfs_file_ops+0x140/0x140
[ 990.072779] kernfs_fop_write_iter+0x335/0x510
[ 990.078554] ? kernfs_ops+0xf0/0xf0
[ 990.083267] new_sync_write+0x333/0x750
[ 990.088360] ? __lock_acquire+0x508/0xc10
[ 990.093656] ? new_sync_read+0x740/0x740
[ 990.098859] ? lock_acquire.part.0+0xbc/0x260
[ 990.104547] ? ksys_write+0x116/0x250
[ 990.109456] vfs_write+0x657/0x9b0
[ 990.114073] ksys_write+0x116/0x250
[ 990.118787] ? __ia32_sys_read+0xc0/0xc0
[ 990.123987] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.129579] ? rcu_is_watching+0x15/0xd0
[ 990.134779] do_syscall_64+0xf3/0x650
[ 990.139675] ? irq_exit_rcu+0x1a/0x30
[ 990.144584] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.151051] RIP: 0033:0x7fdfc460722e
[ 990.155861] RSP: 002b:00007ffd89bce240 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.165159] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdfc460722e
[ 990.173965] RDX: 0000000000000001 RSI: 000055ec0f29fcd0 RDI: 0000000000000007
[ 990.182772] RBP: 00007ffd89bce250 R08: 0000000000000000 R09: 0000000000000000
[ 990.191580] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdfc447f390
[ 990.200386] R13: 000055ec0f29fcd0 R14: 0000000000000007 R15: 0000000000000003
[ 990.209201]
[ 990.212463] \x0aShowing all locks held in the system:
[ 990.221001] 1 lock held by khungtaskd/185:
[ 990.226397] #0: ffffffffaeefe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.237870] 4 locks held by python3/3828:
[ 990.243168] #0: ff1100012f3143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.253057] #1: ff1100013e3b9480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.264020] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.275176] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.285272] 4 locks held by python3/5851:
[ 990.290569] #0: ff1100012f3143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.300459] #1: ff110001db2dd680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.311420] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.322568] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.332649]
[ 990.335113] =============================================\x0a
[ 1112.540873] INFO: task python3:5851 blocked for more than 245 seconds.
[ 1112.549025] Not tainted 7.1.0-rc3-yitb-ga5808e471b85 #1
[ 1112.556279] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.565930] task:python3 state:D stack:25672 pid:5851 tgid:5851 ppid:5850 task_flags:0x400100 flags:0x00080000
[ 1112.579134] Call Trace:
[ 1112.582675]
[ 1112.585823] __schedule+0xcc3/0x19c0
[ 1112.590641] ? io_schedule_timeout+0x140/0x140
[ 1112.596424] ? find_held_lock+0x2b/0x80
[ 1112.601529] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.607411] schedule+0xd4/0x260
[ 1112.611820] schedule_preempt_disabled+0x18/0x30
[ 1112.617800] __mutex_lock+0x6a3/0x2000
[ 1112.622796] ? threaded_store+0x132/0x220
[ 1112.628096] ? ww_mutex_lock+0x160/0x160
[ 1112.633293] ? selinux_inode_free_security+0x330/0x330
[ 1112.639864] ? cap_capable+0x1d6/0x3e0
[ 1112.644875] ? threaded_store+0x132/0x220
[ 1112.650171] threaded_store+0x132/0x220
[ 1112.655273] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.660571] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.665868] ? sysfs_kf_write+0x65/0x160
[ 1112.671067] ? sysfs_file_ops+0x140/0x140
[ 1112.676362] kernfs_fop_write_iter+0x335/0x510
[ 1112.682146] ? kernfs_ops+0xf0/0xf0
[ 1112.686859] new_sync_write+0x333/0x750
[ 1112.691962] ? __lock_acquire+0x508/0xc10
[ 1112.697255] ? new_sync_read+0x740/0x740
[ 1112.702456] ? lock_acquire.part.0+0xbc/0x260
[ 1112.708140] ? ksys_write+0x116/0x250
[ 1112.713048] vfs_write+0x657/0x9b0
[ 1112.717664] ksys_write+0x116/0x250
[ 1112.722376] ? __ia32_sys_read+0xc0/0xc0
[ 1112.727573] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.733159] ? rcu_is_watching+0x15/0xd0
[ 1112.738383] do_syscall_64+0xf3/0x650
[ 1112.743323] ? trace_hardirqs_off+0xd/0x30
[ 1112.748721] ? exc_page_fault+0xda/0xf0
[ 1112.753824] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.760296] RIP: 0033:0x7f4290e5a22e
[ 1112.765107] RSP: 002b:00007ffd412af070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.774409] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4290e5a22e
[ 1112.783220] RDX: 0000000000000001 RSI: 000055c2abff5cd0 RDI: 0000000000000007
[ 1112.792031] RBP: 00007ffd412af080 R08: 0000000000000000 R09: 0000000000000000
[ 1112.800843] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4290cd2390
[ 1112.809651] R13: 000055c2abff5cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.818460]
[ 1112.821817] INFO: task python3:5851 is blocked on a mutex likely owned by task python3:3828.
[ 1112.832094] task:python3 state:D stack:25672 pid:3828 tgid:3828 ppid:3827 task_flags:0x400100 flags:0x00080802
[ 1112.845299] Call Trace:
[ 1112.848842]
[ 1112.851985] __schedule+0xcc3/0x19c0
[ 1112.856799] ? io_schedule_timeout+0x140/0x140
[ 1112.862586] ? find_held_lock+0x2b/0x80
[ 1112.867694] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.873877] schedule+0xd4/0x260
[ 1112.878296] schedule_timeout+0x13f/0x290
[ 1112.883597] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.889969] ? trace_contention_end+0xb3/0x1a0
[ 1112.895756] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.901448] ? ww_mutex_lock+0x160/0x160
[ 1112.906649] msleep+0x1b/0x30
[ 1112.910778] napi_set_threaded+0x3a5/0x440
[ 1112.916177] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.921671] netif_set_threaded+0x257/0x400
[ 1112.927167] threaded_store+0x1b8/0x220
[ 1112.932273] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.937573] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.942873] ? sysfs_kf_write+0x65/0x160
[ 1112.948064] ? sysfs_file_ops+0x140/0x140
[ 1112.953362] kernfs_fop_write_iter+0x335/0x510
[ 1112.959141] ? kernfs_ops+0xf0/0xf0
[ 1112.963855] new_sync_write+0x333/0x750
[ 1112.968962] ? __lock_acquire+0x508/0xc10
[ 1112.974259] ? new_sync_read+0x740/0x740
[ 1112.979532] ? lock_acquire.part.0+0xbc/0x260
[ 1112.985219] ? ksys_write+0x116/0x250
[ 1112.990131] vfs_write+0x657/0x9b0
[ 1112.994748] ksys_write+0x116/0x250
[ 1112.999464] ? __ia32_sys_read+0xc0/0xc0
[ 1113.004666] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.010257] ? rcu_is_watching+0x15/0xd0
[ 1113.015458] do_syscall_64+0xf3/0x650
[ 1113.020365] ? irq_exit_rcu+0x1a/0x30
[ 1113.025275] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.031746] RIP: 0033:0x7fdfc460722e
[ 1113.036558] RSP: 002b:00007ffd89bce240 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.045858] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdfc460722e
[ 1113.054669] RDX: 0000000000000001 RSI: 000055ec0f29fcd0 RDI: 0000000000000007
[ 1113.063482] RBP: 00007ffd89bce250 R08: 0000000000000000 R09: 0000000000000000
[ 1113.072293] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdfc447f390
[ 1113.081106] R13: 000055ec0f29fcd0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.089921]
[ 1113.093187] \x0aShowing all locks held in the system:
[ 1113.101734] 1 lock held by khungtaskd/185:
[ 1113.107132] #0: ffffffffaeefe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.118605] 2 locks held by systemd-journal/802:
[ 1113.124653] #0: ff1100180e6b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1113.134541] #1: ffffffffaf1033a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.147370] 4 locks held by python3/3828:
[ 1113.152666] #0: ff1100012f3143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.162560] #1: ff1100013e3b9480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.173525] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.184683] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.194793] 4 locks held by python3/5851:
[ 1113.200093] #0: ff1100012f3143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.209982] #1: ff110001db2dd680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.220943] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.232099] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.242187] 1 lock held by systemd/6900:
[ 1113.247391]
[ 1113.249860] =============================================\x0a
[ 1235.421023] INFO: task python3:5851 blocked for more than 368 seconds.
[ 1235.429171] Not tainted 7.1.0-rc3-yitb-ga5808e471b85 #1
[ 1235.436423] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.446016] task:python3 state:D stack:25672 pid:5851 tgid:5851 ppid:5850 task_flags:0x400100 flags:0x00080002
[ 1235.459226] Call Trace:
[ 1235.462768]
[ 1235.465922] __schedule+0xcc3/0x19c0
[ 1235.470741] ? io_schedule_timeout+0x140/0x140
[ 1235.476527] ? find_held_lock+0x2b/0x80
[ 1235.481635] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.487523] schedule+0xd4/0x260
[ 1235.491944] schedule_preempt_disabled+0x18/0x30
[ 1235.497924] __mutex_lock+0x6a3/0x2000
[ 1235.502930] ? threaded_store+0x132/0x220
[ 1235.508230] ? ww_mutex_lock+0x160/0x160
[ 1235.513430] ? selinux_inode_free_security+0x330/0x330
[ 1235.520000] ? cap_capable+0x1d6/0x3e0
[ 1235.525009] ? threaded_store+0x132/0x220
[ 1235.530308] threaded_store+0x132/0x220
[ 1235.535412] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.540710] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.546013] ? sysfs_kf_write+0x65/0x160
[ 1235.551215] ? sysfs_file_ops+0x140/0x140
[ 1235.556510] kernfs_fop_write_iter+0x335/0x510
[ 1235.562299] ? kernfs_ops+0xf0/0xf0
[ 1235.567010] new_sync_write+0x333/0x750
[ 1235.572115] ? __lock_acquire+0x508/0xc10
[ 1235.577414] ? new_sync_read+0x740/0x740
[ 1235.582617] ? lock_acquire.part.0+0xbc/0x260
[ 1235.588306] ? ksys_write+0x116/0x250
[ 1235.593219] vfs_write+0x657/0x9b0
[ 1235.597838] ksys_write+0x116/0x250
[ 1235.602553] ? __ia32_sys_read+0xc0/0xc0
[ 1235.607754] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.613343] ? rcu_is_watching+0x15/0xd0
[ 1235.618548] do_syscall_64+0xf3/0x650
[ 1235.623455] ? trace_hardirqs_off+0xd/0x30
[ 1235.628856] ? exc_page_fault+0xda/0xf0
[ 1235.633957] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.640416] RIP: 0033:0x7f4290e5a22e
[ 1235.645224] RSP: 002b:00007ffd412af070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.654523] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4290e5a22e
[ 1235.663335] RDX: 0000000000000001 RSI: 000055c2abff5cd0 RDI: 0000000000000007
[ 1235.672144] RBP: 00007ffd412af080 R08: 0000000000000000 R09: 0000000000000000
[ 1235.680955] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4290cd2390
[ 1235.689764] R13: 000055c2abff5cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.698577]
[ 1235.701844] INFO: task python3:5851 is blocked on a mutex likely owned by task python3:3828.
[ 1235.712121] task:python3 state:D stack:25672 pid:3828 tgid:3828 ppid:3827 task_flags:0x400100 flags:0x00080802
[ 1235.725329] Call Trace:
[ 1235.728868]
[ 1235.732018] __schedule+0xcc3/0x19c0
[ 1235.736830] ? io_schedule_timeout+0x140/0x140
[ 1235.742614] ? find_held_lock+0x2b/0x80
[ 1235.747708] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.753886] schedule+0xd4/0x260
[ 1235.758305] schedule_timeout+0x13f/0x290
[ 1235.763602] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.769972] ? trace_contention_end+0xb3/0x1a0
[ 1235.775760] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.781450] ? ww_mutex_lock+0x160/0x160
[ 1235.786649] msleep+0x1b/0x30
[ 1235.790771] napi_set_threaded+0x3a5/0x440
[ 1235.796167] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.801651] netif_set_threaded+0x257/0x400
[ 1235.807144] threaded_store+0x1b8/0x220
[ 1235.812251] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.817552] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.822859] ? sysfs_kf_write+0x65/0x160
[ 1235.828059] ? sysfs_file_ops+0x140/0x140
[ 1235.833346] kernfs_fop_write_iter+0x335/0x510
[ 1235.839132] ? kernfs_ops+0xf0/0xf0
[ 1235.843843] new_sync_write+0x333/0x750
[ 1235.848944] ? __lock_acquire+0x508/0xc10
[ 1235.854241] ? new_sync_read+0x740/0x740
[ 1235.859442] ? lock_acquire.part.0+0xbc/0x260
[ 1235.865120] ? ksys_write+0x116/0x250
[ 1235.870024] vfs_write+0x657/0x9b0
[ 1235.874640] ksys_write+0x116/0x250
[ 1235.879356] ? __ia32_sys_read+0xc0/0xc0
[ 1235.884557] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.890145] ? rcu_is_watching+0x15/0xd0
[ 1235.895346] do_syscall_64+0xf3/0x650
[ 1235.900254] ? irq_exit_rcu+0x1a/0x30
[ 1235.905161] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.911629] RIP: 0033:0x7fdfc460722e
[ 1235.916440] RSP: 002b:00007ffd89bce240 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.925741] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdfc460722e
[ 1235.934553] RDX: 0000000000000001 RSI: 000055ec0f29fcd0 RDI: 0000000000000007
[ 1235.943365] RBP: 00007ffd89bce250 R08: 0000000000000000 R09: 0000000000000000
[ 1235.952176] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdfc447f390
[ 1235.960984] R13: 000055ec0f29fcd0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.969799]
[ 1235.973066] \x0aShowing all locks held in the system:
[ 1235.981605] 1 lock held by khungtaskd/185:
[ 1235.987001] #0: ffffffffaeefe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1235.998484] 4 locks held by python3/3828:
[ 1236.003782] #0: ff1100012f3143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.013666] #1: ff1100013e3b9480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.024631] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.035788] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.045881] 4 locks held by python3/5851:
[ 1236.051176] #0: ff1100012f3143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.061067] #1: ff110001db2dd680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.072032] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.083189] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.093285]
[ 1236.095752] =============================================\x0a
[ 1358.302131] INFO: task python3:5851 blocked for more than 491 seconds.
[ 1358.310281] Not tainted 7.1.0-rc3-yitb-ga5808e471b85 #1
[ 1358.317534] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.327127] task:python3 state:D stack:25672 pid:5851 tgid:5851 ppid:5850 task_flags:0x400100 flags:0x00080002
[ 1358.340334] Call Trace:
[ 1358.343877]
[ 1358.347029] __schedule+0xcc3/0x19c0
[ 1358.351849] ? io_schedule_timeout+0x140/0x140
[ 1358.357637] ? find_held_lock+0x2b/0x80
[ 1358.362742] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.368642] schedule+0xd4/0x260
[ 1358.373292] schedule_preempt_disabled+0x18/0x30
[ 1358.379275] __mutex_lock+0x6a3/0x2000
[ 1358.384281] ? threaded_store+0x132/0x220
[ 1358.389581] ? ww_mutex_lock+0x160/0x160
[ 1358.394783] ? selinux_inode_free_security+0x330/0x330
[ 1358.401354] ? cap_capable+0x1d6/0x3e0
[ 1358.406363] ? threaded_store+0x132/0x220
[ 1358.411664] threaded_store+0x132/0x220
[ 1358.416771] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.422069] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.427367] ? sysfs_kf_write+0x65/0x160
[ 1358.432571] ? sysfs_file_ops+0x140/0x140
[ 1358.437870] kernfs_fop_write_iter+0x335/0x510
[ 1358.443659] ? kernfs_ops+0xf0/0xf0
[ 1358.448371] new_sync_write+0x333/0x750
[ 1358.453476] ? __lock_acquire+0x508/0xc10
[ 1358.458774] ? new_sync_read+0x740/0x740
[ 1358.463984] ? lock_acquire.part.0+0xbc/0x260
[ 1358.469669] ? ksys_write+0x116/0x250
[ 1358.474581] vfs_write+0x657/0x9b0
[ 1358.479196] ksys_write+0x116/0x250
[ 1358.483908] ? __ia32_sys_read+0xc0/0xc0
[ 1358.489107] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.494717] ? rcu_is_watching+0x15/0xd0
[ 1358.499919] do_syscall_64+0xf3/0x650
[ 1358.504826] ? trace_hardirqs_off+0xd/0x30
[ 1358.510217] ? exc_page_fault+0xda/0xf0
[ 1358.515320] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.521791] RIP: 0033:0x7f4290e5a22e
[ 1358.526603] RSP: 002b:00007ffd412af070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.535902] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4290e5a22e
[ 1358.544723] RDX: 0000000000000001 RSI: 000055c2abff5cd0 RDI: 0000000000000007
[ 1358.553535] RBP: 00007ffd412af080 R08: 0000000000000000 R09: 0000000000000000
[ 1358.562346] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4290cd2390
[ 1358.571241] R13: 000055c2abff5cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.580056]
[ 1358.583326] INFO: task python3:5851 is blocked on a mutex likely owned by task python3:3828.
[ 1358.593601] task:python3 state:D stack:25672 pid:3828 tgid:3828 ppid:3827 task_flags:0x400100 flags:0x00080802
[ 1358.606806] Call Trace:
[ 1358.610346]
[ 1358.613499] __schedule+0xcc3/0x19c0
[ 1358.618311] ? io_schedule_timeout+0x140/0x140
[ 1358.624095] ? find_held_lock+0x2b/0x80
[ 1358.629191] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.635374] schedule+0xd4/0x260
[ 1358.639796] schedule_timeout+0x13f/0x290
[ 1358.645160] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.651532] ? trace_contention_end+0xb3/0x1a0
[ 1358.657316] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.663010] ? ww_mutex_lock+0x160/0x160
[ 1358.668213] msleep+0x1b/0x30
[ 1358.672411] napi_set_threaded+0x3a5/0x440
[ 1358.677813] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.683306] netif_set_threaded+0x257/0x400
[ 1358.688802] threaded_store+0x1b8/0x220
[ 1358.693906] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.699203] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.704499] ? sysfs_kf_write+0x65/0x160
[ 1358.709701] ? sysfs_file_ops+0x140/0x140
[ 1358.714997] kernfs_fop_write_iter+0x335/0x510
[ 1358.720783] ? kernfs_ops+0xf0/0xf0
[ 1358.725487] new_sync_write+0x333/0x750
[ 1358.730591] ? __lock_acquire+0x508/0xc10
[ 1358.735887] ? new_sync_read+0x740/0x740
[ 1358.741088] ? lock_acquire.part.0+0xbc/0x260
[ 1358.746766] ? ksys_write+0x116/0x250
[ 1358.751668] vfs_write+0x657/0x9b0
[ 1358.756356] ksys_write+0x116/0x250
[ 1358.761072] ? __ia32_sys_read+0xc0/0xc0
[ 1358.766272] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.771863] ? rcu_is_watching+0x15/0xd0
[ 1358.777064] do_syscall_64+0xf3/0x650
[ 1358.781981] ? irq_exit_rcu+0x1a/0x30
[ 1358.786889] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.793357] RIP: 0033:0x7fdfc460722e
[ 1358.798166] RSP: 002b:00007ffd89bce240 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.807457] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdfc460722e
[ 1358.816266] RDX: 0000000000000001 RSI: 000055ec0f29fcd0 RDI: 0000000000000007
[ 1358.825075] RBP: 00007ffd89bce250 R08: 0000000000000000 R09: 0000000000000000
[ 1358.833887] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdfc447f390
[ 1358.842699] R13: 000055ec0f29fcd0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.851515]
[ 1358.854784] \x0aShowing all locks held in the system:
[ 1358.863323] 1 lock held by khungtaskd/185:
[ 1358.868723] #0: ffffffffaeefe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.880222] 4 locks held by python3/3828:
[ 1358.885520] #0: ff1100012f3143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.895413] #1: ff1100013e3b9480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.906379] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.917538] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.927633] 4 locks held by python3/5851:
[ 1358.932931] #0: ff1100012f3143e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.942822] #1: ff110001db2dd680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.953784] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.964943] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.975035]
[ 1358.977507] =============================================\x0a