[ 787.297942] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 787.300457] nipa-hw-worker: [5/45] Retrying drivers/net:napi_threaded.py
[ 787.496051] kselftest: Running tests in drivers/net
[ 989.663922] INFO: task python3:5828 blocked for more than 122 seconds.
[ 989.672128] Not tainted 7.1.0-rc2-kdkh-g8b2477a17466 #1
[ 989.679778] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.689369] task:python3 state:D stack:25512 pid:5828 tgid:5828 ppid:5827 task_flags:0x400100 flags:0x00080000
[ 989.702577] Call Trace:
[ 989.706119]
[ 989.709272] __schedule+0xcba/0x1940
[ 989.714090] ? io_schedule_timeout+0x140/0x140
[ 989.719875] ? find_held_lock+0x2b/0x80
[ 989.724979] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.730865] schedule+0xd4/0x260
[ 989.735283] schedule_preempt_disabled+0x18/0x30
[ 989.741262] __mutex_lock+0x6a3/0x2000
[ 989.746267] ? threaded_store+0x132/0x220
[ 989.751565] ? ww_mutex_lock+0x160/0x160
[ 989.756767] ? selinux_inode_free_security+0x330/0x330
[ 989.763338] ? cap_capable+0x1d6/0x3e0
[ 989.768347] ? threaded_store+0x132/0x220
[ 989.773642] threaded_store+0x132/0x220
[ 989.778743] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.784045] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.789344] ? sysfs_kf_write+0x65/0x160
[ 989.794537] ? sysfs_file_ops+0x140/0x140
[ 989.799834] kernfs_fop_write_iter+0x335/0x510
[ 989.805620] ? kernfs_ops+0xf0/0xf0
[ 989.810333] new_sync_write+0x333/0x750
[ 989.815436] ? __lock_acquire+0x508/0xc10
[ 989.820733] ? new_sync_read+0x740/0x740
[ 989.825936] ? lock_acquire.part.0+0xbc/0x260
[ 989.831621] ? ksys_write+0x116/0x250
[ 989.836534] vfs_write+0x657/0x9b0
[ 989.841150] ksys_write+0x116/0x250
[ 989.845862] ? __ia32_sys_read+0xc0/0xc0
[ 989.851051] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.856640] ? rcu_is_watching+0x15/0xd0
[ 989.861844] do_syscall_64+0xf3/0x650
[ 989.866753] ? trace_hardirqs_off+0xd/0x30
[ 989.872149] ? exc_page_fault+0xda/0xf0
[ 989.877250] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.883726] RIP: 0033:0x7f6199d4522e
[ 989.888535] RSP: 002b:00007ffd50957dc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.897834] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f6199d4522e
[ 989.906642] RDX: 0000000000000001 RSI: 000055d2dc9ee3d0 RDI: 0000000000000007
[ 989.915450] RBP: 00007ffd50957dd0 R08: 0000000000000000 R09: 0000000000000000
[ 989.924261] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f6199bbd390
[ 989.933069] R13: 000055d2dc9ee3d0 R14: 0000000000000007 R15: 0000000000000003
[ 989.941882]
[ 989.945172] INFO: task python3:5828 is blocked on a mutex likely owned by task python3:3826.
[ 989.955444] task:python3 state:D stack:25672 pid:3826 tgid:3826 ppid:3825 task_flags:0x400100 flags:0x00080802
[ 989.968647] Call Trace:
[ 989.972187]
[ 989.975337] __schedule+0xcba/0x1940
[ 989.980140] ? io_schedule_timeout+0x140/0x140
[ 989.985926] ? find_held_lock+0x2b/0x80
[ 989.991018] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.997199] schedule+0xd4/0x260
[ 990.001616] schedule_timeout+0x13f/0x290
[ 990.006913] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.013282] ? trace_contention_end+0xb3/0x1a0
[ 990.019068] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.024760] ? ww_mutex_lock+0x160/0x160
[ 990.029961] msleep+0x1b/0x30
[ 990.034086] napi_set_threaded+0x3a5/0x440
[ 990.039483] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.044978] netif_set_threaded+0x257/0x400
[ 990.050471] threaded_store+0x1b8/0x220
[ 990.055574] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.060863] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.066161] ? sysfs_kf_write+0x65/0x160
[ 990.071360] ? sysfs_file_ops+0x140/0x140
[ 990.076658] kernfs_fop_write_iter+0x335/0x510
[ 990.082445] ? kernfs_ops+0xf0/0xf0
[ 990.087158] new_sync_write+0x333/0x750
[ 990.092260] ? __lock_acquire+0x508/0xc10
[ 990.097558] ? new_sync_read+0x740/0x740
[ 990.102761] ? lock_acquire.part.0+0xbc/0x260
[ 990.108448] ? ksys_write+0x116/0x250
[ 990.113358] vfs_write+0x657/0x9b0
[ 990.117972] ksys_write+0x116/0x250
[ 990.122683] ? __ia32_sys_read+0xc0/0xc0
[ 990.127882] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.133471] ? rcu_is_watching+0x15/0xd0
[ 990.138672] do_syscall_64+0xf3/0x650
[ 990.143567] ? trace_hardirqs_off+0xd/0x30
[ 990.148962] ? exc_page_fault+0xda/0xf0
[ 990.154055] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.160522] RIP: 0033:0x7f461ffee22e
[ 990.165333] RSP: 002b:00007ffd4c949d10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.174631] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f461ffee22e
[ 990.183438] RDX: 0000000000000001 RSI: 000056098f8ae3d0 RDI: 0000000000000007
[ 990.192248] RBP: 00007ffd4c949d20 R08: 0000000000000000 R09: 0000000000000000
[ 990.201054] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f461fe66390
[ 990.209862] R13: 000056098f8ae3d0 R14: 0000000000000007 R15: 0000000000000003
[ 990.218676]
[ 990.221935] \x0aShowing all locks held in the system:
[ 990.230474] 1 lock held by khungtaskd/185:
[ 990.235871] #0: ffffffff994fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.247345] 2 locks held by systemd-journal/802:
[ 990.253318] #0: ff1100180da372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.263206] #1: ffffffff997032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.276023] 4 locks held by python3/3826:
[ 990.281319] #0: ff1100012f9a43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.291208] #1: ff1100017d206880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.302169] #2: ff11000122edcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.313330] #3: ff11000122f51d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.323429] 4 locks held by python3/5828:
[ 990.328728] #0: ff1100012f9a43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.338618] #1: ff1100019d178880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.349579] #2: ff11000122edcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.360739] #3: ff11000122f51d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.370826]
[ 990.373291] =============================================\x0a
[ 1110.554498] block nvme0n1: No UUID available providing old NGUID
SUBSYSTEM=block
DEVICE=b259:0
[ 1112.546084] INFO: task python3:5828 blocked for more than 245 seconds.
[ 1112.554234] Not tainted 7.1.0-rc2-kdkh-g8b2477a17466 #1
[ 1112.561484] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.571073] task:python3 state:D stack:25512 pid:5828 tgid:5828 ppid:5827 task_flags:0x400100 flags:0x00080000
[ 1112.584277] Call Trace:
[ 1112.587814]
[ 1112.590963] __schedule+0xcba/0x1940
[ 1112.595780] ? io_schedule_timeout+0x140/0x140
[ 1112.601565] ? find_held_lock+0x2b/0x80
[ 1112.606661] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.612547] schedule+0xd4/0x260
[ 1112.616966] schedule_preempt_disabled+0x18/0x30
[ 1112.622942] __mutex_lock+0x6a3/0x2000
[ 1112.627944] ? threaded_store+0x132/0x220
[ 1112.633245] ? ww_mutex_lock+0x160/0x160
[ 1112.638443] ? selinux_inode_free_security+0x330/0x330
[ 1112.645002] ? cap_capable+0x1d6/0x3e0
[ 1112.650010] ? threaded_store+0x132/0x220
[ 1112.655307] threaded_store+0x132/0x220
[ 1112.660408] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.665705] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.671007] ? sysfs_kf_write+0x65/0x160
[ 1112.676208] ? sysfs_file_ops+0x140/0x140
[ 1112.681573] kernfs_fop_write_iter+0x335/0x510
[ 1112.687422] ? kernfs_ops+0xf0/0xf0
[ 1112.692201] new_sync_write+0x333/0x750
[ 1112.697305] ? __lock_acquire+0x508/0xc10
[ 1112.702601] ? new_sync_read+0x740/0x740
[ 1112.707802] ? lock_acquire.part.0+0xbc/0x260
[ 1112.713480] ? ksys_write+0x116/0x250
[ 1112.718389] vfs_write+0x657/0x9b0
[ 1112.723005] ksys_write+0x116/0x250
[ 1112.727716] ? __ia32_sys_read+0xc0/0xc0
[ 1112.732913] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.738506] ? rcu_is_watching+0x15/0xd0
[ 1112.743708] do_syscall_64+0xf3/0x650
[ 1112.748615] ? trace_hardirqs_off+0xd/0x30
[ 1112.754009] ? exc_page_fault+0xda/0xf0
[ 1112.759261] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.765729] RIP: 0033:0x7f6199d4522e
[ 1112.770536] RSP: 002b:00007ffd50957dc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.779833] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f6199d4522e
[ 1112.788768] RDX: 0000000000000001 RSI: 000055d2dc9ee3d0 RDI: 0000000000000007
[ 1112.797576] RBP: 00007ffd50957dd0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.806376] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f6199bbd390
[ 1112.815183] R13: 000055d2dc9ee3d0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.824001]
[ 1112.827315] INFO: task python3:5828 is blocked on a mutex likely owned by task python3:3826.
[ 1112.837589] task:python3 state:D stack:25672 pid:3826 tgid:3826 ppid:3825 task_flags:0x400100 flags:0x00080802
[ 1112.850795] Call Trace:
[ 1112.854330]
[ 1112.857544] __schedule+0xcba/0x1940
[ 1112.862355] ? io_schedule_timeout+0x140/0x140
[ 1112.868137] ? find_held_lock+0x2b/0x80
[ 1112.873241] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.879417] schedule+0xd4/0x260
[ 1112.883824] schedule_timeout+0x13f/0x290
[ 1112.889120] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.895498] ? trace_contention_end+0xb3/0x1a0
[ 1112.901289] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.906981] ? ww_mutex_lock+0x160/0x160
[ 1112.912181] msleep+0x1b/0x30
[ 1112.916306] napi_set_threaded+0x3a5/0x440
[ 1112.921703] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.927200] netif_set_threaded+0x257/0x400
[ 1112.932693] threaded_store+0x1b8/0x220
[ 1112.937931] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.943228] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.948519] ? sysfs_kf_write+0x65/0x160
[ 1112.953718] ? sysfs_file_ops+0x140/0x140
[ 1112.959024] kernfs_fop_write_iter+0x335/0x510
[ 1112.964815] ? kernfs_ops+0xf0/0xf0
[ 1112.969530] new_sync_write+0x333/0x750
[ 1112.974637] ? __lock_acquire+0x508/0xc10
[ 1112.979935] ? new_sync_read+0x740/0x740
[ 1112.985136] ? lock_acquire.part.0+0xbc/0x260
[ 1112.990825] ? ksys_write+0x116/0x250
[ 1112.995754] vfs_write+0x657/0x9b0
[ 1113.000392] ksys_write+0x116/0x250
[ 1113.005123] ? __ia32_sys_read+0xc0/0xc0
[ 1113.010339] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.015945] ? rcu_is_watching+0x15/0xd0
[ 1113.021154] do_syscall_64+0xf3/0x650
[ 1113.026079] ? trace_hardirqs_off+0xd/0x30
[ 1113.031479] ? exc_page_fault+0xda/0xf0
[ 1113.036597] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.043084] RIP: 0033:0x7f461ffee22e
[ 1113.047913] RSP: 002b:00007ffd4c949d10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.057547] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f461ffee22e
[ 1113.066368] RDX: 0000000000000001 RSI: 000056098f8ae3d0 RDI: 0000000000000007
[ 1113.075181] RBP: 00007ffd4c949d20 R08: 0000000000000000 R09: 0000000000000000
[ 1113.083988] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f461fe66390
[ 1113.092801] R13: 000056098f8ae3d0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.101618]
[ 1113.104895] \x0aShowing all locks held in the system:
[ 1113.113456] 1 lock held by khungtaskd/185:
[ 1113.118853] #0: ffffffff994fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.130358] 3 locks held by systemd-journal/802:
[ 1113.136338] #0: ff1100180e2372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1113.146219] #1: ff110001a207e378 (&mm->mmap_lock){++++}-{4:4}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.156989] #2: ff110001a18d34c0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1113.168567] 4 locks held by python3/3826:
[ 1113.173861] #0: ff1100012f9a43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.183749] #1: ff1100017d206880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.194706] #2: ff11000122edcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.205867] #3: ff11000122f51d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.215979] 4 locks held by python3/5828:
[ 1113.221274] #0: ff1100012f9a43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.231163] #1: ff1100019d178880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.242117] #2: ff11000122edcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.253276] #3: ff11000122f51d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.263371]
[ 1113.265837] =============================================\x0a
[ 1235.427256] INFO: task python3:5828 blocked for more than 368 seconds.
[ 1235.435401] Not tainted 7.1.0-rc2-kdkh-g8b2477a17466 #1
[ 1235.442653] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.452241] task:python3 state:D stack:25512 pid:5828 tgid:5828 ppid:5827 task_flags:0x400100 flags:0x00080002
[ 1235.465437] Call Trace:
[ 1235.468978]
[ 1235.472128] __schedule+0xcba/0x1940
[ 1235.476944] ? io_schedule_timeout+0x140/0x140
[ 1235.482731] ? find_held_lock+0x2b/0x80
[ 1235.487834] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.493712] schedule+0xd4/0x260
[ 1235.498130] schedule_preempt_disabled+0x18/0x30
[ 1235.504108] __mutex_lock+0x6a3/0x2000
[ 1235.509113] ? threaded_store+0x132/0x220
[ 1235.514412] ? ww_mutex_lock+0x160/0x160
[ 1235.519604] ? selinux_inode_free_security+0x330/0x330
[ 1235.526174] ? cap_capable+0x1d6/0x3e0
[ 1235.531184] ? threaded_store+0x132/0x220
[ 1235.536482] threaded_store+0x132/0x220
[ 1235.541584] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.546880] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.552181] ? sysfs_kf_write+0x65/0x160
[ 1235.557381] ? sysfs_file_ops+0x140/0x140
[ 1235.562680] kernfs_fop_write_iter+0x335/0x510
[ 1235.568464] ? kernfs_ops+0xf0/0xf0
[ 1235.573177] new_sync_write+0x333/0x750
[ 1235.578284] ? __lock_acquire+0x508/0xc10
[ 1235.583581] ? new_sync_read+0x740/0x740
[ 1235.588777] ? lock_acquire.part.0+0xbc/0x260
[ 1235.594464] ? ksys_write+0x116/0x250
[ 1235.599375] vfs_write+0x657/0x9b0
[ 1235.603988] ksys_write+0x116/0x250
[ 1235.608701] ? __ia32_sys_read+0xc0/0xc0
[ 1235.613892] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.619479] ? rcu_is_watching+0x15/0xd0
[ 1235.624682] do_syscall_64+0xf3/0x650
[ 1235.629587] ? trace_hardirqs_off+0xd/0x30
[ 1235.634984] ? exc_page_fault+0xda/0xf0
[ 1235.640087] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.646557] RIP: 0033:0x7f6199d4522e
[ 1235.651368] RSP: 002b:00007ffd50957dc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.660667] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f6199d4522e
[ 1235.669477] RDX: 0000000000000001 RSI: 000055d2dc9ee3d0 RDI: 0000000000000007
[ 1235.678284] RBP: 00007ffd50957dd0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.687096] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f6199bbd390
[ 1235.695903] R13: 000055d2dc9ee3d0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.704710]
[ 1235.707995] INFO: task python3:5828 is blocked on a mutex likely owned by task python3:3826.
[ 1235.718267] task:python3 state:D stack:25672 pid:3826 tgid:3826 ppid:3825 task_flags:0x400100 flags:0x00080802
[ 1235.731472] Call Trace:
[ 1235.735011]
[ 1235.738164] __schedule+0xcba/0x1940
[ 1235.742978] ? io_schedule_timeout+0x140/0x140
[ 1235.748764] ? find_held_lock+0x2b/0x80
[ 1235.753870] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.760048] schedule+0xd4/0x260
[ 1235.764467] schedule_timeout+0x13f/0x290
[ 1235.769765] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.776134] ? trace_contention_end+0xb3/0x1a0
[ 1235.781917] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.787605] ? ww_mutex_lock+0x160/0x160
[ 1235.792807] msleep+0x1b/0x30
[ 1235.796934] napi_set_threaded+0x3a5/0x440
[ 1235.802333] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.807828] netif_set_threaded+0x257/0x400
[ 1235.813322] threaded_store+0x1b8/0x220
[ 1235.818424] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.823722] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.829017] ? sysfs_kf_write+0x65/0x160
[ 1235.834218] ? sysfs_file_ops+0x140/0x140
[ 1235.839516] kernfs_fop_write_iter+0x335/0x510
[ 1235.845291] ? kernfs_ops+0xf0/0xf0
[ 1235.850003] new_sync_write+0x333/0x750
[ 1235.855102] ? __lock_acquire+0x508/0xc10
[ 1235.860399] ? new_sync_read+0x740/0x740
[ 1235.865602] ? lock_acquire.part.0+0xbc/0x260
[ 1235.871289] ? ksys_write+0x116/0x250
[ 1235.876199] vfs_write+0x657/0x9b0
[ 1235.880811] ksys_write+0x116/0x250
[ 1235.885526] ? __ia32_sys_read+0xc0/0xc0
[ 1235.890727] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.896315] ? rcu_is_watching+0x15/0xd0
[ 1235.901515] do_syscall_64+0xf3/0x650
[ 1235.906424] ? trace_hardirqs_off+0xd/0x30
[ 1235.911819] ? exc_page_fault+0xda/0xf0
[ 1235.916921] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.923381] RIP: 0033:0x7f461ffee22e
[ 1235.928194] RSP: 002b:00007ffd4c949d10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.937493] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f461ffee22e
[ 1235.946315] RDX: 0000000000000001 RSI: 000056098f8ae3d0 RDI: 0000000000000007
[ 1235.955125] RBP: 00007ffd4c949d20 R08: 0000000000000000 R09: 0000000000000000
[ 1235.963936] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f461fe66390
[ 1235.972743] R13: 000056098f8ae3d0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.981559]
[ 1235.984823] \x0aShowing all locks held in the system:
[ 1235.993361] 1 lock held by khungtaskd/185:
[ 1235.998752] #0: ffffffff994fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.010235] 4 locks held by python3/3826:
[ 1236.015532] #0: ff1100012f9a43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.025424] #1: ff1100017d206880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.036385] #2: ff11000122edcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.047541] #3: ff11000122f51d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.057638] 4 locks held by python3/5828:
[ 1236.062934] #0: ff1100012f9a43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.072824] #1: ff1100019d178880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.083786] #2: ff11000122edcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.094943] #3: ff11000122f51d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.105036]
[ 1236.107503] =============================================\x0a
[ 1321.443100] kworker/u130:6 (849) used greatest stack depth: 21456 bytes left
[ 1358.307424] INFO: task python3:5828 blocked for more than 491 seconds.
[ 1358.315584] Not tainted 7.1.0-rc2-kdkh-g8b2477a17466 #1
[ 1358.322838] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.332430] task:python3 state:D stack:25512 pid:5828 tgid:5828 ppid:5827 task_flags:0x400100 flags:0x00080002
[ 1358.345638] Call Trace:
[ 1358.349180]
[ 1358.352324] __schedule+0xcba/0x1940
[ 1358.357140] ? io_schedule_timeout+0x140/0x140
[ 1358.362926] ? find_held_lock+0x2b/0x80
[ 1358.368033] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.373917] schedule+0xd4/0x260
[ 1358.378335] schedule_preempt_disabled+0x18/0x30
[ 1358.384317] __mutex_lock+0x6a3/0x2000
[ 1358.389322] ? threaded_store+0x132/0x220
[ 1358.394620] ? ww_mutex_lock+0x160/0x160
[ 1358.399812] ? selinux_inode_free_security+0x330/0x330
[ 1358.406381] ? cap_capable+0x1d6/0x3e0
[ 1358.411393] ? threaded_store+0x132/0x220
[ 1358.416691] threaded_store+0x132/0x220
[ 1358.421793] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.427083] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.432380] ? sysfs_kf_write+0x65/0x160
[ 1358.437581] ? sysfs_file_ops+0x140/0x140
[ 1358.442880] kernfs_fop_write_iter+0x335/0x510
[ 1358.448668] ? kernfs_ops+0xf0/0xf0
[ 1358.453382] new_sync_write+0x333/0x750
[ 1358.458488] ? __lock_acquire+0x508/0xc10
[ 1358.463784] ? new_sync_read+0x740/0x740
[ 1358.468987] ? lock_acquire.part.0+0xbc/0x260
[ 1358.474676] ? ksys_write+0x116/0x250
[ 1358.479586] vfs_write+0x657/0x9b0
[ 1358.484203] ksys_write+0x116/0x250
[ 1358.488917] ? __ia32_sys_read+0xc0/0xc0
[ 1358.494114] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.499701] ? rcu_is_watching+0x15/0xd0
[ 1358.504903] do_syscall_64+0xf3/0x650
[ 1358.509802] ? trace_hardirqs_off+0xd/0x30
[ 1358.515198] ? exc_page_fault+0xda/0xf0
[ 1358.520292] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.526750] RIP: 0033:0x7f6199d4522e
[ 1358.531562] RSP: 002b:00007ffd50957dc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.540862] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f6199d4522e
[ 1358.549672] RDX: 0000000000000001 RSI: 000055d2dc9ee3d0 RDI: 0000000000000007
[ 1358.558482] RBP: 00007ffd50957dd0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.567292] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f6199bbd390
[ 1358.576103] R13: 000055d2dc9ee3d0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.584918]
[ 1358.588193] INFO: task python3:5828 is blocked on a mutex likely owned by task python3:3826.
[ 1358.598455] task:python3 state:D stack:25672 pid:3826 tgid:3826 ppid:3825 task_flags:0x400100 flags:0x00080802
[ 1358.611658] Call Trace:
[ 1358.615196]
[ 1358.618348] __schedule+0xcba/0x1940
[ 1358.623161] ? io_schedule_timeout+0x140/0x140
[ 1358.628947] ? find_held_lock+0x2b/0x80
[ 1358.634050] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.640230] schedule+0xd4/0x260
[ 1358.644650] schedule_timeout+0x13f/0x290
[ 1358.649948] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.656309] ? trace_contention_end+0xb3/0x1a0
[ 1358.662094] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.667782] ? ww_mutex_lock+0x160/0x160
[ 1358.672984] msleep+0x1b/0x30
[ 1358.677110] napi_set_threaded+0x3a5/0x440
[ 1358.682501] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.687995] netif_set_threaded+0x257/0x400
[ 1358.693490] threaded_store+0x1b8/0x220
[ 1358.698590] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.703888] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.709184] ? sysfs_kf_write+0x65/0x160
[ 1358.714385] ? sysfs_file_ops+0x140/0x140
[ 1358.719680] kernfs_fop_write_iter+0x335/0x510
[ 1358.725464] ? kernfs_ops+0xf0/0xf0
[ 1358.730167] new_sync_write+0x333/0x750
[ 1358.735271] ? __lock_acquire+0x508/0xc10
[ 1358.740568] ? new_sync_read+0x740/0x740
[ 1358.745763] ? lock_acquire.part.0+0xbc/0x260
[ 1358.751451] ? ksys_write+0x116/0x250
[ 1358.756353] vfs_write+0x657/0x9b0
[ 1358.760968] ksys_write+0x116/0x250
[ 1358.765672] ? __ia32_sys_read+0xc0/0xc0
[ 1358.770871] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.776459] ? rcu_is_watching+0x15/0xd0
[ 1358.781660] do_syscall_64+0xf3/0x650
[ 1358.786556] ? trace_hardirqs_off+0xd/0x30
[ 1358.791951] ? exc_page_fault+0xda/0xf0
[ 1358.797055] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.803525] RIP: 0033:0x7f461ffee22e
[ 1358.808336] RSP: 002b:00007ffd4c949d10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.817634] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f461ffee22e
[ 1358.826442] RDX: 0000000000000001 RSI: 000056098f8ae3d0 RDI: 0000000000000007
[ 1358.835248] RBP: 00007ffd4c949d20 R08: 0000000000000000 R09: 0000000000000000
[ 1358.844055] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f461fe66390
[ 1358.852856] R13: 000056098f8ae3d0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.861672]
[ 1358.864941] \x0aShowing all locks held in the system:
[ 1358.873482] 1 lock held by khungtaskd/185:
[ 1358.878875] #0: ffffffff994fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.890357] 4 locks held by python3/3826:
[ 1358.895651] #0: ff1100012f9a43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.905541] #1: ff1100017d206880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.916503] #2: ff11000122edcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.927661] #3: ff11000122f51d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.937755] 4 locks held by python3/5828:
[ 1358.943052] #0: ff1100012f9a43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.952942] #1: ff1100019d178880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.963905] #2: ff11000122edcb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.975063] #3: ff11000122f51d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.985159]
[ 1358.987627] =============================================\x0a