[ 789.137255] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 789.139728] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 789.267598] kselftest: Running tests in drivers/net
[ 989.705805] INFO: task python3:5818 blocked for more than 122 seconds.
[ 989.714044] Not tainted 7.1.0-rc4-kfbn-gf7b942c30fc3 #1
[ 989.721976] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.731563] task:python3 state:D stack:25032 pid:5818 tgid:5818 ppid:5817 task_flags:0x400100 flags:0x00080000
[ 989.744771] Call Trace:
[ 989.748312]
[ 989.751460] __schedule+0xcc3/0x19c0
[ 989.756277] ? io_schedule_timeout+0x140/0x140
[ 989.762062] ? find_held_lock+0x2b/0x80
[ 989.767166] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.773048] schedule+0xd8/0x260
[ 989.777456] schedule_preempt_disabled+0x18/0x30
[ 989.783436] __mutex_lock+0x6af/0x2010
[ 989.788441] ? threaded_store+0x132/0x220
[ 989.793742] ? ww_mutex_lock+0x160/0x160
[ 989.798941] ? selinux_inode_free_security+0x330/0x330
[ 989.805511] ? cap_capable+0x1d6/0x3e0
[ 989.810518] ? threaded_store+0x132/0x220
[ 989.815815] threaded_store+0x132/0x220
[ 989.820916] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.826212] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.831503] ? sysfs_kf_write+0x65/0x160
[ 989.836702] ? sysfs_file_ops+0x140/0x140
[ 989.841998] kernfs_fop_write_iter+0x335/0x510
[ 989.847780] ? kernfs_ops+0xf0/0xf0
[ 989.852491] new_sync_write+0x333/0x750
[ 989.857595] ? __lock_acquire+0x508/0xc10
[ 989.862890] ? new_sync_read+0x740/0x740
[ 989.868088] ? lock_acquire.part.0+0xbc/0x260
[ 989.873774] ? ksys_write+0x116/0x250
[ 989.878683] vfs_write+0x657/0x9b0
[ 989.883296] ksys_write+0x116/0x250
[ 989.888008] ? __ia32_sys_read+0xc0/0xc0
[ 989.893204] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.898791] ? rcu_is_watching+0x15/0xd0
[ 989.903989] do_syscall_64+0xf3/0x650
[ 989.908897] ? trace_hardirqs_off+0xd/0x30
[ 989.914291] ? exc_page_fault+0xda/0xf0
[ 989.919394] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.925863] RIP: 0033:0x7fb05bfd322e
[ 989.930670] RSP: 002b:00007ffe95c415c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.939969] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb05bfd322e
[ 989.948775] RDX: 0000000000000001 RSI: 0000558eb21e96b0 RDI: 0000000000000007
[ 989.957580] RBP: 00007ffe95c415d0 R08: 0000000000000000 R09: 0000000000000000
[ 989.966387] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb05be4b390
[ 989.975192] R13: 0000558eb21e96b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.984012]
[ 989.987310] INFO: task python3:5818 is blocked on a mutex likely owned by task python3:3766.
[ 989.997580] task:python3 state:D stack:24696 pid:3766 tgid:3766 ppid:3765 task_flags:0x400100 flags:0x00080802
[ 990.010781] Call Trace:
[ 990.014318]
[ 990.017470] __schedule+0xcc3/0x19c0
[ 990.022278] ? io_schedule_timeout+0x140/0x140
[ 990.028062] ? find_held_lock+0x2b/0x80
[ 990.033163] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.039340] schedule+0xd8/0x260
[ 990.043758] schedule_timeout+0x13f/0x290
[ 990.049054] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.055423] ? trace_contention_end+0xb3/0x1a0
[ 990.061209] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.066900] ? ww_mutex_lock+0x160/0x160
[ 990.072100] msleep+0x1b/0x30
[ 990.076225] napi_set_threaded+0x3a5/0x440
[ 990.081618] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.087111] netif_set_threaded+0x257/0x400
[ 990.092604] threaded_store+0x1b8/0x220
[ 990.097697] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.102994] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.108288] ? sysfs_kf_write+0x65/0x160
[ 990.113486] ? sysfs_file_ops+0x140/0x140
[ 990.118782] kernfs_fop_write_iter+0x335/0x510
[ 990.124565] ? kernfs_ops+0xf0/0xf0
[ 990.129275] new_sync_write+0x333/0x750
[ 990.134378] ? __lock_acquire+0x508/0xc10
[ 990.139672] ? new_sync_read+0x740/0x740
[ 990.144870] ? lock_acquire.part.0+0xbc/0x260
[ 990.150557] ? ksys_write+0x116/0x250
[ 990.155465] vfs_write+0x657/0x9b0
[ 990.160080] ksys_write+0x116/0x250
[ 990.164783] ? __ia32_sys_read+0xc0/0xc0
[ 990.169972] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.175560] ? rcu_is_watching+0x15/0xd0
[ 990.180757] do_syscall_64+0xf3/0x650
[ 990.185662] ? trace_hardirqs_off+0xd/0x30
[ 990.191053] ? exc_page_fault+0xda/0xf0
[ 990.196156] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.202612] RIP: 0033:0x7fc6378a522e
[ 990.207417] RSP: 002b:00007ffd7ad8d310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.216722] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc6378a522e
[ 990.225530] RDX: 0000000000000001 RSI: 000056232fe9c6b0 RDI: 0000000000000007
[ 990.234337] RBP: 00007ffd7ad8d320 R08: 0000000000000000 R09: 0000000000000000
[ 990.243136] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc63771d390
[ 990.251933] R13: 000056232fe9c6b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.260744]
[ 990.264002] \x0aShowing all locks held in the system:
[ 990.272538] 1 lock held by khungtaskd/184:
[ 990.277930] #0: ffffffff918fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.289402] 3 locks held by systemd-journal/806:
[ 990.295379] #0: ff1100180e8372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.305267] #1: ffffffff91b029a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.318081] #2: ff110001a4fdf8e0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.329643] 4 locks held by python3/3766:
[ 990.334936] #0: ff1100012f57c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.344826] #1: ff11000172ca6e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.355785] #2: ff11000122692b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.366943] #3: ff11000122671d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.377042] 4 locks held by python3/5818:
[ 990.382333] #0: ff1100012f57c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.392221] #1: ff110001f1d91a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.403183] #2: ff11000122692b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.414336] #3: ff11000122671d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.424422]
[ 990.426888] =============================================\x0a
[ 1112.586890] INFO: task python3:5818 blocked for more than 245 seconds.
[ 1112.595037] Not tainted 7.1.0-rc4-kfbn-gf7b942c30fc3 #1
[ 1112.602287] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.611880] task:python3 state:D stack:25032 pid:5818 tgid:5818 ppid:5817 task_flags:0x400100 flags:0x00080000
[ 1112.625088] Call Trace:
[ 1112.628627]
[ 1112.631780] __schedule+0xcc3/0x19c0
[ 1112.636598] ? io_schedule_timeout+0x140/0x140
[ 1112.642385] ? find_held_lock+0x2b/0x80
[ 1112.647490] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.653375] schedule+0xd8/0x260
[ 1112.657795] schedule_preempt_disabled+0x18/0x30
[ 1112.663773] __mutex_lock+0x6af/0x2010
[ 1112.668776] ? threaded_store+0x132/0x220
[ 1112.674075] ? ww_mutex_lock+0x160/0x160
[ 1112.679275] ? selinux_inode_free_security+0x330/0x330
[ 1112.685845] ? cap_capable+0x1d6/0x3e0
[ 1112.690853] ? threaded_store+0x132/0x220
[ 1112.696150] threaded_store+0x132/0x220
[ 1112.701242] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.706539] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.711843] ? sysfs_kf_write+0x65/0x160
[ 1112.717046] ? sysfs_file_ops+0x140/0x140
[ 1112.722343] kernfs_fop_write_iter+0x335/0x510
[ 1112.728120] ? kernfs_ops+0xf0/0xf0
[ 1112.732832] new_sync_write+0x333/0x750
[ 1112.737937] ? __lock_acquire+0x508/0xc10
[ 1112.743236] ? new_sync_read+0x740/0x740
[ 1112.748439] ? lock_acquire.part.0+0xbc/0x260
[ 1112.754125] ? ksys_write+0x116/0x250
[ 1112.759026] vfs_write+0x657/0x9b0
[ 1112.763644] ksys_write+0x116/0x250
[ 1112.768358] ? __ia32_sys_read+0xc0/0xc0
[ 1112.773558] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.779147] ? rcu_is_watching+0x15/0xd0
[ 1112.784339] do_syscall_64+0xf3/0x650
[ 1112.789247] ? trace_hardirqs_off+0xd/0x30
[ 1112.794643] ? exc_page_fault+0xda/0xf0
[ 1112.799745] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.806215] RIP: 0033:0x7fb05bfd322e
[ 1112.811026] RSP: 002b:00007ffe95c415c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.820325] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb05bfd322e
[ 1112.829135] RDX: 0000000000000001 RSI: 0000558eb21e96b0 RDI: 0000000000000007
[ 1112.837945] RBP: 00007ffe95c415d0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.846756] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb05be4b390
[ 1112.855566] R13: 0000558eb21e96b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.864380]
[ 1112.867655] INFO: task python3:5818 is blocked on a mutex likely owned by task python3:3766.
[ 1112.877920] task:python3 state:D stack:24696 pid:3766 tgid:3766 ppid:3765 task_flags:0x400100 flags:0x00080802
[ 1112.891122] Call Trace:
[ 1112.894660]
[ 1112.897812] __schedule+0xcc3/0x19c0
[ 1112.902625] ? io_schedule_timeout+0x140/0x140
[ 1112.908409] ? find_held_lock+0x2b/0x80
[ 1112.913512] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.919689] schedule+0xd8/0x260
[ 1112.924097] schedule_timeout+0x13f/0x290
[ 1112.929394] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.935763] ? trace_contention_end+0xb3/0x1a0
[ 1112.941551] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.947243] ? ww_mutex_lock+0x160/0x160
[ 1112.952443] msleep+0x1b/0x30
[ 1112.956569] napi_set_threaded+0x3a5/0x440
[ 1112.961966] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.967460] netif_set_threaded+0x257/0x400
[ 1112.972953] threaded_store+0x1b8/0x220
[ 1112.978058] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.983357] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.988656] ? sysfs_kf_write+0x65/0x160
[ 1112.993855] ? sysfs_file_ops+0x140/0x140
[ 1112.999153] kernfs_fop_write_iter+0x335/0x510
[ 1113.004928] ? kernfs_ops+0xf0/0xf0
[ 1113.009641] new_sync_write+0x333/0x750
[ 1113.014744] ? __lock_acquire+0x508/0xc10
[ 1113.020030] ? new_sync_read+0x740/0x740
[ 1113.025232] ? lock_acquire.part.0+0xbc/0x260
[ 1113.030917] ? ksys_write+0x116/0x250
[ 1113.035832] vfs_write+0x657/0x9b0
[ 1113.040446] ksys_write+0x116/0x250
[ 1113.045159] ? __ia32_sys_read+0xc0/0xc0
[ 1113.050361] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.055951] ? rcu_is_watching+0x15/0xd0
[ 1113.061153] do_syscall_64+0xf3/0x650
[ 1113.066061] ? trace_hardirqs_off+0xd/0x30
[ 1113.071457] ? exc_page_fault+0xda/0xf0
[ 1113.076550] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.083020] RIP: 0033:0x7fc6378a522e
[ 1113.087829] RSP: 002b:00007ffd7ad8d310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.097120] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc6378a522e
[ 1113.105938] RDX: 0000000000000001 RSI: 000056232fe9c6b0 RDI: 0000000000000007
[ 1113.114745] RBP: 00007ffd7ad8d320 R08: 0000000000000000 R09: 0000000000000000
[ 1113.123554] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc63771d390
[ 1113.132363] R13: 000056232fe9c6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.141176]
[ 1113.144440] \x0aShowing all locks held in the system:
[ 1113.152976] 1 lock held by khungtaskd/184:
[ 1113.158372] #0: ffffffff918fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.169865] 4 locks held by python3/3766:
[ 1113.175163] #0: ff1100012f57c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.185055] #1: ff11000172ca6e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.196034] #2: ff11000122692b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.207202] #3: ff11000122671d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.217314] 4 locks held by python3/5818:
[ 1113.222614] #0: ff1100012f57c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.232510] #1: ff110001f1d91a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.243539] #2: ff11000122692b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.254697] #3: ff11000122671d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.264801]
[ 1113.267269] =============================================\x0a
[ 1174.027455] kworker/u130:1 (263) used greatest stack depth: 21936 bytes left
[ 1235.466993] INFO: task python3:5818 blocked for more than 368 seconds.
[ 1235.475133] Not tainted 7.1.0-rc4-kfbn-gf7b942c30fc3 #1
[ 1235.482380] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.491977] task:python3 state:D stack:25032 pid:5818 tgid:5818 ppid:5817 task_flags:0x400100 flags:0x00080002
[ 1235.505193] Call Trace:
[ 1235.508735]
[ 1235.511888] __schedule+0xcc3/0x19c0
[ 1235.516708] ? io_schedule_timeout+0x140/0x140
[ 1235.522498] ? find_held_lock+0x2b/0x80
[ 1235.527607] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.533499] schedule+0xd8/0x260
[ 1235.537922] schedule_preempt_disabled+0x18/0x30
[ 1235.543907] __mutex_lock+0x6af/0x2010
[ 1235.548914] ? threaded_store+0x132/0x220
[ 1235.554220] ? ww_mutex_lock+0x160/0x160
[ 1235.559422] ? selinux_inode_free_security+0x330/0x330
[ 1235.565999] ? cap_capable+0x1d6/0x3e0
[ 1235.571012] ? threaded_store+0x132/0x220
[ 1235.576313] threaded_store+0x132/0x220
[ 1235.581420] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.586723] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.592018] ? sysfs_kf_write+0x65/0x160
[ 1235.597224] ? sysfs_file_ops+0x140/0x140
[ 1235.602522] kernfs_fop_write_iter+0x335/0x510
[ 1235.608312] ? kernfs_ops+0xf0/0xf0
[ 1235.613028] new_sync_write+0x333/0x750
[ 1235.618139] ? __lock_acquire+0x508/0xc10
[ 1235.623440] ? new_sync_read+0x740/0x740
[ 1235.628650] ? lock_acquire.part.0+0xbc/0x260
[ 1235.634341] ? ksys_write+0x116/0x250
[ 1235.639260] vfs_write+0x657/0x9b0
[ 1235.643880] ksys_write+0x116/0x250
[ 1235.648595] ? __ia32_sys_read+0xc0/0xc0
[ 1235.653799] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.659395] ? rcu_is_watching+0x15/0xd0
[ 1235.664591] do_syscall_64+0xf3/0x650
[ 1235.669499] ? trace_hardirqs_off+0xd/0x30
[ 1235.674897] ? exc_page_fault+0xda/0xf0
[ 1235.679995] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.686468] RIP: 0033:0x7fb05bfd322e
[ 1235.691283] RSP: 002b:00007ffe95c415c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.700587] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb05bfd322e
[ 1235.709403] RDX: 0000000000000001 RSI: 0000558eb21e96b0 RDI: 0000000000000007
[ 1235.718215] RBP: 00007ffe95c415d0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.727033] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb05be4b390
[ 1235.735848] R13: 0000558eb21e96b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.744672]
[ 1235.747949] INFO: task python3:5818 is blocked on a mutex likely owned by task python3:3766.
[ 1235.758227] task:python3 state:D stack:24696 pid:3766 tgid:3766 ppid:3765 task_flags:0x400100 flags:0x00080802
[ 1235.771434] Call Trace:
[ 1235.774975]
[ 1235.778126] __schedule+0xcc3/0x19c0
[ 1235.782944] ? io_schedule_timeout+0x140/0x140
[ 1235.788733] ? find_held_lock+0x2b/0x80
[ 1235.793844] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.800025] schedule+0xd8/0x260
[ 1235.804446] schedule_timeout+0x13f/0x290
[ 1235.809745] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.816109] ? trace_contention_end+0xb3/0x1a0
[ 1235.821897] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.827595] ? ww_mutex_lock+0x160/0x160
[ 1235.832796] msleep+0x1b/0x30
[ 1235.836918] napi_set_threaded+0x3a5/0x440
[ 1235.842319] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.847823] netif_set_threaded+0x257/0x400
[ 1235.853319] threaded_store+0x1b8/0x220
[ 1235.858428] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.863730] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.869031] ? sysfs_kf_write+0x65/0x160
[ 1235.874236] ? sysfs_file_ops+0x140/0x140
[ 1235.879535] kernfs_fop_write_iter+0x335/0x510
[ 1235.885325] ? kernfs_ops+0xf0/0xf0
[ 1235.890042] new_sync_write+0x333/0x750
[ 1235.895149] ? __lock_acquire+0x508/0xc10
[ 1235.900451] ? new_sync_read+0x740/0x740
[ 1235.905656] ? lock_acquire.part.0+0xbc/0x260
[ 1235.911346] ? ksys_write+0x116/0x250
[ 1235.916260] vfs_write+0x657/0x9b0
[ 1235.920882] ksys_write+0x116/0x250
[ 1235.925595] ? __ia32_sys_read+0xc0/0xc0
[ 1235.930789] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.936380] ? rcu_is_watching+0x15/0xd0
[ 1235.941587] do_syscall_64+0xf3/0x650
[ 1235.946495] ? trace_hardirqs_off+0xd/0x30
[ 1235.951886] ? exc_page_fault+0xda/0xf0
[ 1235.956993] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.963464] RIP: 0033:0x7fc6378a522e
[ 1235.968277] RSP: 002b:00007ffd7ad8d310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.977579] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc6378a522e
[ 1235.986388] RDX: 0000000000000001 RSI: 000056232fe9c6b0 RDI: 0000000000000007
[ 1235.995201] RBP: 00007ffd7ad8d320 R08: 0000000000000000 R09: 0000000000000000
[ 1236.004013] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc63771d390
[ 1236.012825] R13: 000056232fe9c6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1236.021640]
[ 1236.024909] \x0aShowing all locks held in the system:
[ 1236.033450] 1 lock held by khungtaskd/184:
[ 1236.038846] #0: ffffffff918fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.050339] 4 locks held by python3/3766:
[ 1236.055640] #0: ff1100012f57c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.065537] #1: ff11000172ca6e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.076498] #2: ff11000122692b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.087661] #3: ff11000122671d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.097754] 4 locks held by python3/5818:
[ 1236.103054] #0: ff1100012f57c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.112954] #1: ff110001f1d91a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.123924] #2: ff11000122692b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.135088] #3: ff11000122671d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.145190]
[ 1236.147661] =============================================\x0a
[ 1309.196689] kworker/u129:15 (310) used greatest stack depth: 21456 bytes left
[ 1358.349113] INFO: task python3:5818 blocked for more than 491 seconds.
[ 1358.357260] Not tainted 7.1.0-rc4-kfbn-gf7b942c30fc3 #1
[ 1358.364510] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.374100] task:python3 state:D stack:25032 pid:5818 tgid:5818 ppid:5817 task_flags:0x400100 flags:0x00080002
[ 1358.387305] Call Trace:
[ 1358.390843]
[ 1358.393994] __schedule+0xcc3/0x19c0
[ 1358.398811] ? io_schedule_timeout+0x140/0x140
[ 1358.404595] ? find_held_lock+0x2b/0x80
[ 1358.409701] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.415598] schedule+0xd8/0x260
[ 1358.420021] schedule_preempt_disabled+0x18/0x30
[ 1358.426001] __mutex_lock+0x6af/0x2010
[ 1358.431002] ? threaded_store+0x132/0x220
[ 1358.436301] ? ww_mutex_lock+0x160/0x160
[ 1358.441501] ? selinux_inode_free_security+0x330/0x330
[ 1358.448071] ? cap_capable+0x1d6/0x3e0
[ 1358.453078] ? threaded_store+0x132/0x220
[ 1358.458374] threaded_store+0x132/0x220
[ 1358.463474] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.468770] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.474069] ? sysfs_kf_write+0x65/0x160
[ 1358.479267] ? sysfs_file_ops+0x140/0x140
[ 1358.484635] kernfs_fop_write_iter+0x335/0x510
[ 1358.490417] ? kernfs_ops+0xf0/0xf0
[ 1358.495128] new_sync_write+0x333/0x750
[ 1358.500224] ? __lock_acquire+0x508/0xc10
[ 1358.505511] ? new_sync_read+0x740/0x740
[ 1358.510708] ? lock_acquire.part.0+0xbc/0x260
[ 1358.516391] ? ksys_write+0x116/0x250
[ 1358.521302] vfs_write+0x657/0x9b0
[ 1358.525986] ksys_write+0x116/0x250
[ 1358.530697] ? __ia32_sys_read+0xc0/0xc0
[ 1358.535964] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.541553] ? rcu_is_watching+0x15/0xd0
[ 1358.546744] do_syscall_64+0xf3/0x650
[ 1358.551649] ? trace_hardirqs_off+0xd/0x30
[ 1358.557042] ? exc_page_fault+0xda/0xf0
[ 1358.562143] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.568608] RIP: 0033:0x7fb05bfd322e
[ 1358.573419] RSP: 002b:00007ffe95c415c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.582716] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb05bfd322e
[ 1358.591517] RDX: 0000000000000001 RSI: 0000558eb21e96b0 RDI: 0000000000000007
[ 1358.600327] RBP: 00007ffe95c415d0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.609134] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb05be4b390
[ 1358.617943] R13: 0000558eb21e96b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.626754]
[ 1358.630061] INFO: task python3:5818 is blocked on a mutex likely owned by task python3:3766.
[ 1358.640332] task:python3 state:D stack:24696 pid:3766 tgid:3766 ppid:3765 task_flags:0x400100 flags:0x00080802
[ 1358.653533] Call Trace:
[ 1358.657072]
[ 1358.660220] __schedule+0xcc3/0x19c0
[ 1358.665029] ? io_schedule_timeout+0x140/0x140
[ 1358.670813] ? find_held_lock+0x2b/0x80
[ 1358.675909] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.682084] schedule+0xd8/0x260
[ 1358.686501] schedule_timeout+0x13f/0x290
[ 1358.691868] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.698235] ? trace_contention_end+0xb3/0x1a0
[ 1358.704028] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.709720] ? ww_mutex_lock+0x160/0x160
[ 1358.714920] msleep+0x1b/0x30
[ 1358.719044] napi_set_threaded+0x3a5/0x440
[ 1358.724437] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.729930] netif_set_threaded+0x257/0x400
[ 1358.735423] threaded_store+0x1b8/0x220
[ 1358.740516] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.745813] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.751108] ? sysfs_kf_write+0x65/0x160
[ 1358.756308] ? sysfs_file_ops+0x140/0x140
[ 1358.761603] kernfs_fop_write_iter+0x335/0x510
[ 1358.767385] ? kernfs_ops+0xf0/0xf0
[ 1358.772096] new_sync_write+0x333/0x750
[ 1358.777195] ? __lock_acquire+0x508/0xc10
[ 1358.782491] ? new_sync_read+0x740/0x740
[ 1358.787693] ? lock_acquire.part.0+0xbc/0x260
[ 1358.793376] ? ksys_write+0x116/0x250
[ 1358.798284] vfs_write+0x657/0x9b0
[ 1358.802898] ksys_write+0x116/0x250
[ 1358.807612] ? __ia32_sys_read+0xc0/0xc0
[ 1358.812810] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.818399] ? rcu_is_watching+0x15/0xd0
[ 1358.823599] do_syscall_64+0xf3/0x650
[ 1358.828502] ? trace_hardirqs_off+0xd/0x30
[ 1358.833893] ? exc_page_fault+0xda/0xf0
[ 1358.838993] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.845460] RIP: 0033:0x7fc6378a522e
[ 1358.850267] RSP: 002b:00007ffd7ad8d310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.859562] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc6378a522e
[ 1358.868436] RDX: 0000000000000001 RSI: 000056232fe9c6b0 RDI: 0000000000000007
[ 1358.877243] RBP: 00007ffd7ad8d320 R08: 0000000000000000 R09: 0000000000000000
[ 1358.886049] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc63771d390
[ 1358.894856] R13: 000056232fe9c6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.903662]
[ 1358.906926] \x0aShowing all locks held in the system:
[ 1358.915466] 1 lock held by khungtaskd/184:
[ 1358.920860] #0: ffffffff918fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.932338] 3 locks held by systemd-journal/806:
[ 1358.938315] #0: ff1100180e0b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.948201] #1: ffffffff91b029a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: nd_jump_root+0x353/0x550
[ 1358.960527] #2: ff110001a4fdf8e0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1358.972087] 4 locks held by python3/3766:
[ 1358.977382] #0: ff1100012f57c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.987272] #1: ff11000172ca6e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.998224] #2: ff11000122692b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.009370] #3: ff11000122671d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.019469] 4 locks held by python3/5818:
[ 1359.024764] #0: ff1100012f57c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.034654] #1: ff110001f1d91a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.045614] #2: ff11000122692b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.056769] #3: ff11000122671d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.066859]
[ 1359.069324] =============================================\x0a