[ 793.759269] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 793.761660] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 793.889752] kselftest: Running tests in drivers/net
[ 989.658062] INFO: task python3:5857 blocked for more than 122 seconds.
[ 989.666281] Not tainted 7.1.0-rc3-onyy-g4194a54e9394 #1
[ 989.674142] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.683731] task:python3 state:D stack:25672 pid:5857 tgid:5857 ppid:5856 task_flags:0x400100 flags:0x00080000
[ 989.696936] Call Trace:
[ 989.700475]
[ 989.703627] __schedule+0xcc3/0x19c0
[ 989.708444] ? io_schedule_timeout+0x140/0x140
[ 989.714228] ? find_held_lock+0x2b/0x80
[ 989.719332] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.725220] schedule+0xd4/0x260
[ 989.729639] schedule_preempt_disabled+0x18/0x30
[ 989.735618] __mutex_lock+0x6a3/0x2000
[ 989.740622] ? threaded_store+0x132/0x220
[ 989.745922] ? ww_mutex_lock+0x160/0x160
[ 989.751119] ? selinux_inode_free_security+0x330/0x330
[ 989.757689] ? cap_capable+0x1d6/0x3e0
[ 989.762697] ? threaded_store+0x132/0x220
[ 989.767995] threaded_store+0x132/0x220
[ 989.773099] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.778398] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.783697] ? sysfs_kf_write+0x65/0x160
[ 989.788896] ? sysfs_file_ops+0x140/0x140
[ 989.794191] kernfs_fop_write_iter+0x335/0x510
[ 989.799976] ? kernfs_ops+0xf0/0xf0
[ 989.804680] new_sync_write+0x333/0x750
[ 989.809787] ? __lock_acquire+0x508/0xc10
[ 989.815084] ? new_sync_read+0x740/0x740
[ 989.820285] ? lock_acquire.part.0+0xbc/0x260
[ 989.825974] ? ksys_write+0x116/0x250
[ 989.830885] vfs_write+0x657/0x9b0
[ 989.835501] ksys_write+0x116/0x250
[ 989.840212] ? __ia32_sys_read+0xc0/0xc0
[ 989.845412] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.850994] ? rcu_is_watching+0x15/0xd0
[ 989.856197] do_syscall_64+0xf3/0x650
[ 989.861105] ? trace_hardirqs_off+0xd/0x30
[ 989.866500] ? exc_page_fault+0xda/0xf0
[ 989.871604] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.878071] RIP: 0033:0x7f2e1ea4322e
[ 989.882880] RSP: 002b:00007ffe1830ca30 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.892180] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2e1ea4322e
[ 989.900988] RDX: 0000000000000001 RSI: 000055b7572ebcd0 RDI: 0000000000000007
[ 989.909786] RBP: 00007ffe1830ca40 R08: 0000000000000000 R09: 0000000000000000
[ 989.918595] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2e1e8bb390
[ 989.927404] R13: 000055b7572ebcd0 R14: 0000000000000007 R15: 0000000000000003
[ 989.936224]
[ 989.939499] INFO: task python3:5857 is blocked on a mutex likely owned by task python3:3873.
[ 989.949762] task:python3 state:D stack:25672 pid:3873 tgid:3873 ppid:3872 task_flags:0x400100 flags:0x00080802
[ 989.962967] Call Trace:
[ 989.966504]
[ 989.969654] __schedule+0xcc3/0x19c0
[ 989.974464] ? io_schedule_timeout+0x140/0x140
[ 989.980246] ? find_held_lock+0x2b/0x80
[ 989.985349] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.991528] schedule+0xd4/0x260
[ 989.995947] schedule_timeout+0x13f/0x290
[ 990.001246] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.007614] ? trace_contention_end+0xb3/0x1a0
[ 990.013399] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.019089] ? ww_mutex_lock+0x160/0x160
[ 990.024289] msleep+0x1b/0x30
[ 990.028404] napi_set_threaded+0x3a5/0x440
[ 990.033800] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.039296] netif_set_threaded+0x257/0x400
[ 990.044788] threaded_store+0x1b8/0x220
[ 990.049882] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.055170] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.060469] ? sysfs_kf_write+0x65/0x160
[ 990.065667] ? sysfs_file_ops+0x140/0x140
[ 990.070963] kernfs_fop_write_iter+0x335/0x510
[ 990.076749] ? kernfs_ops+0xf0/0xf0
[ 990.081459] new_sync_write+0x333/0x750
[ 990.086561] ? __lock_acquire+0x508/0xc10
[ 990.091858] ? new_sync_read+0x740/0x740
[ 990.097059] ? lock_acquire.part.0+0xbc/0x260
[ 990.102735] ? ksys_write+0x116/0x250
[ 990.107646] vfs_write+0x657/0x9b0
[ 990.112263] ksys_write+0x116/0x250
[ 990.116974] ? __ia32_sys_read+0xc0/0xc0
[ 990.122175] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.127757] ? rcu_is_watching+0x15/0xd0
[ 990.132959] do_syscall_64+0xf3/0x650
[ 990.137866] ? irq_exit_rcu+0x1a/0x30
[ 990.142773] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.149240] RIP: 0033:0x7f77f680e22e
[ 990.154047] RSP: 002b:00007fffd9b77f00 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.163346] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f77f680e22e
[ 990.172154] RDX: 0000000000000001 RSI: 000056342a05ccd0 RDI: 0000000000000007
[ 990.180963] RBP: 00007fffd9b77f10 R08: 0000000000000000 R09: 0000000000000000
[ 990.189770] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f77f6686390
[ 990.198567] R13: 000056342a05ccd0 R14: 0000000000000007 R15: 0000000000000003
[ 990.207379]
[ 990.210638] \x0aShowing all locks held in the system:
[ 990.219173] 1 lock held by khungtaskd/185:
[ 990.224568] #0: ffffffff8eefe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.236048] 4 locks held by python3/3873:
[ 990.241344] #0: ff1100012fa513e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.251233] #1: ff1100017c1bf480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.262193] #2: ff11000122402b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.273352] #3: ff110001223e9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.283444] 4 locks held by python3/5857:
[ 990.288741] #0: ff1100012fa513e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.298628] #1: ff110001f25ad680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.309591] #2: ff11000122402b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.320751] #3: ff110001223e9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.330839]
[ 990.333305] =============================================\x0a
[ 1112.539327] INFO: task python3:5857 blocked for more than 245 seconds.
[ 1112.547474] Not tainted 7.1.0-rc3-onyy-g4194a54e9394 #1
[ 1112.554724] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.564314] task:python3 state:D stack:25672 pid:5857 tgid:5857 ppid:5856 task_flags:0x400100 flags:0x00080000
[ 1112.577518] Call Trace:
[ 1112.581058]
[ 1112.584211] __schedule+0xcc3/0x19c0
[ 1112.589030] ? io_schedule_timeout+0x140/0x140
[ 1112.594817] ? find_held_lock+0x2b/0x80
[ 1112.599924] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.605809] schedule+0xd4/0x260
[ 1112.610230] schedule_preempt_disabled+0x18/0x30
[ 1112.616210] __mutex_lock+0x6a3/0x2000
[ 1112.621208] ? threaded_store+0x132/0x220
[ 1112.626510] ? ww_mutex_lock+0x160/0x160
[ 1112.631709] ? selinux_inode_free_security+0x330/0x330
[ 1112.638277] ? cap_capable+0x1d6/0x3e0
[ 1112.643286] ? threaded_store+0x132/0x220
[ 1112.648585] threaded_store+0x132/0x220
[ 1112.653690] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.658988] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.664287] ? sysfs_kf_write+0x65/0x160
[ 1112.669490] ? sysfs_file_ops+0x140/0x140
[ 1112.674787] kernfs_fop_write_iter+0x335/0x510
[ 1112.680573] ? kernfs_ops+0xf0/0xf0
[ 1112.685284] new_sync_write+0x333/0x750
[ 1112.690387] ? __lock_acquire+0x508/0xc10
[ 1112.695683] ? new_sync_read+0x740/0x740
[ 1112.700884] ? lock_acquire.part.0+0xbc/0x260
[ 1112.706570] ? ksys_write+0x116/0x250
[ 1112.711483] vfs_write+0x657/0x9b0
[ 1112.716099] ksys_write+0x116/0x250
[ 1112.720811] ? __ia32_sys_read+0xc0/0xc0
[ 1112.726012] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.731603] ? rcu_is_watching+0x15/0xd0
[ 1112.736807] do_syscall_64+0xf3/0x650
[ 1112.741716] ? trace_hardirqs_off+0xd/0x30
[ 1112.747111] ? exc_page_fault+0xda/0xf0
[ 1112.752215] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.758684] RIP: 0033:0x7f2e1ea4322e
[ 1112.763493] RSP: 002b:00007ffe1830ca30 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.772790] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2e1ea4322e
[ 1112.781590] RDX: 0000000000000001 RSI: 000055b7572ebcd0 RDI: 0000000000000007
[ 1112.790398] RBP: 00007ffe1830ca40 R08: 0000000000000000 R09: 0000000000000000
[ 1112.799207] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2e1e8bb390
[ 1112.808016] R13: 000055b7572ebcd0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.816829]
[ 1112.820098] INFO: task python3:5857 is blocked on a mutex likely owned by task python3:3873.
[ 1112.830371] task:python3 state:D stack:25672 pid:3873 tgid:3873 ppid:3872 task_flags:0x400100 flags:0x00080802
[ 1112.843571] Call Trace:
[ 1112.847109]
[ 1112.850261] __schedule+0xcc3/0x19c0
[ 1112.855072] ? io_schedule_timeout+0x140/0x140
[ 1112.860857] ? find_held_lock+0x2b/0x80
[ 1112.865952] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.872130] schedule+0xd4/0x260
[ 1112.876548] schedule_timeout+0x13f/0x290
[ 1112.881844] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.888213] ? trace_contention_end+0xb3/0x1a0
[ 1112.894000] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.899692] ? ww_mutex_lock+0x160/0x160
[ 1112.904891] msleep+0x1b/0x30
[ 1112.909008] napi_set_threaded+0x3a5/0x440
[ 1112.914407] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.919903] netif_set_threaded+0x257/0x400
[ 1112.925397] threaded_store+0x1b8/0x220
[ 1112.930501] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.935799] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.941088] ? sysfs_kf_write+0x65/0x160
[ 1112.946288] ? sysfs_file_ops+0x140/0x140
[ 1112.951584] kernfs_fop_write_iter+0x335/0x510
[ 1112.957368] ? kernfs_ops+0xf0/0xf0
[ 1112.962079] new_sync_write+0x333/0x750
[ 1112.967183] ? __lock_acquire+0x508/0xc10
[ 1112.972479] ? new_sync_read+0x740/0x740
[ 1112.977680] ? lock_acquire.part.0+0xbc/0x260
[ 1112.983365] ? ksys_write+0x116/0x250
[ 1112.988274] vfs_write+0x657/0x9b0
[ 1112.992891] ksys_write+0x116/0x250
[ 1112.997604] ? __ia32_sys_read+0xc0/0xc0
[ 1113.002805] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.008396] ? rcu_is_watching+0x15/0xd0
[ 1113.013594] do_syscall_64+0xf3/0x650
[ 1113.018499] ? irq_exit_rcu+0x1a/0x30
[ 1113.023407] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.029876] RIP: 0033:0x7f77f680e22e
[ 1113.034684] RSP: 002b:00007fffd9b77f00 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.043979] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f77f680e22e
[ 1113.052786] RDX: 0000000000000001 RSI: 000056342a05ccd0 RDI: 0000000000000007
[ 1113.061596] RBP: 00007fffd9b77f10 R08: 0000000000000000 R09: 0000000000000000
[ 1113.070404] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f77f6686390
[ 1113.079212] R13: 000056342a05ccd0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.088025]
[ 1113.091287] \x0aShowing all locks held in the system:
[ 1113.099822] 1 lock held by khungtaskd/185:
[ 1113.105218] #0: ffffffff8eefe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.116679] 2 locks held by systemd-journal/801:
[ 1113.122659] #0: ff1100180dc372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1113.132546] #1: ffffffff8f1033a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.145362] 4 locks held by python3/3873:
[ 1113.150656] #0: ff1100012fa513e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.160545] #1: ff1100017c1bf480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.171507] #2: ff11000122402b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.182666] #3: ff110001223e9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.192756] 4 locks held by python3/5857:
[ 1113.198044] #0: ff1100012fa513e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.207931] #1: ff110001f25ad680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.218893] #2: ff11000122402b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.230050] #3: ff110001223e9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.240137]
[ 1113.242603] =============================================\x0a
[ 1235.421626] INFO: task python3:5857 blocked for more than 368 seconds.
[ 1235.429770] Not tainted 7.1.0-rc3-onyy-g4194a54e9394 #1
[ 1235.437020] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.446610] task:python3 state:D stack:25672 pid:5857 tgid:5857 ppid:5856 task_flags:0x400100 flags:0x00080002
[ 1235.459818] Call Trace:
[ 1235.463358]
[ 1235.466512] __schedule+0xcc3/0x19c0
[ 1235.471331] ? io_schedule_timeout+0x140/0x140
[ 1235.477117] ? find_held_lock+0x2b/0x80
[ 1235.482224] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.488112] schedule+0xd4/0x260
[ 1235.492532] schedule_preempt_disabled+0x18/0x30
[ 1235.498503] __mutex_lock+0x6a3/0x2000
[ 1235.503502] ? threaded_store+0x132/0x220
[ 1235.508804] ? ww_mutex_lock+0x160/0x160
[ 1235.514003] ? selinux_inode_free_security+0x330/0x330
[ 1235.520571] ? cap_capable+0x1d6/0x3e0
[ 1235.525594] ? threaded_store+0x132/0x220
[ 1235.530886] threaded_store+0x132/0x220
[ 1235.535987] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.541285] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.546586] ? sysfs_kf_write+0x65/0x160
[ 1235.551787] ? sysfs_file_ops+0x140/0x140
[ 1235.557084] kernfs_fop_write_iter+0x335/0x510
[ 1235.562869] ? kernfs_ops+0xf0/0xf0
[ 1235.567579] new_sync_write+0x333/0x750
[ 1235.572683] ? __lock_acquire+0x508/0xc10
[ 1235.577978] ? new_sync_read+0x740/0x740
[ 1235.583179] ? lock_acquire.part.0+0xbc/0x260
[ 1235.588864] ? ksys_write+0x116/0x250
[ 1235.593773] vfs_write+0x657/0x9b0
[ 1235.598389] ksys_write+0x116/0x250
[ 1235.603101] ? __ia32_sys_read+0xc0/0xc0
[ 1235.608302] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.613892] ? rcu_is_watching+0x15/0xd0
[ 1235.619097] do_syscall_64+0xf3/0x650
[ 1235.624005] ? trace_hardirqs_off+0xd/0x30
[ 1235.629399] ? exc_page_fault+0xda/0xf0
[ 1235.634502] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.640959] RIP: 0033:0x7f2e1ea4322e
[ 1235.645760] RSP: 002b:00007ffe1830ca30 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.655057] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2e1ea4322e
[ 1235.663857] RDX: 0000000000000001 RSI: 000055b7572ebcd0 RDI: 0000000000000007
[ 1235.672666] RBP: 00007ffe1830ca40 R08: 0000000000000000 R09: 0000000000000000
[ 1235.681477] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2e1e8bb390
[ 1235.690286] R13: 000055b7572ebcd0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.699098]
[ 1235.702361] INFO: task python3:5857 is blocked on a mutex likely owned by task python3:3873.
[ 1235.712632] task:python3 state:D stack:25672 pid:3873 tgid:3873 ppid:3872 task_flags:0x400100 flags:0x00080802
[ 1235.725834] Call Trace:
[ 1235.729372]
[ 1235.732525] __schedule+0xcc3/0x19c0
[ 1235.737337] ? io_schedule_timeout+0x140/0x140
[ 1235.743122] ? find_held_lock+0x2b/0x80
[ 1235.748227] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.754404] schedule+0xd4/0x260
[ 1235.758822] schedule_timeout+0x13f/0x290
[ 1235.764120] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.770481] ? trace_contention_end+0xb3/0x1a0
[ 1235.776268] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.781959] ? ww_mutex_lock+0x160/0x160
[ 1235.787160] msleep+0x1b/0x30
[ 1235.791286] napi_set_threaded+0x3a5/0x440
[ 1235.796685] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.802179] netif_set_threaded+0x257/0x400
[ 1235.807673] threaded_store+0x1b8/0x220
[ 1235.812774] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.818072] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.823371] ? sysfs_kf_write+0x65/0x160
[ 1235.828570] ? sysfs_file_ops+0x140/0x140
[ 1235.833867] kernfs_fop_write_iter+0x335/0x510
[ 1235.839650] ? kernfs_ops+0xf0/0xf0
[ 1235.844360] new_sync_write+0x333/0x750
[ 1235.849468] ? __lock_acquire+0x508/0xc10
[ 1235.854767] ? new_sync_read+0x740/0x740
[ 1235.859968] ? lock_acquire.part.0+0xbc/0x260
[ 1235.865646] ? ksys_write+0x116/0x250
[ 1235.870555] vfs_write+0x657/0x9b0
[ 1235.875173] ksys_write+0x116/0x250
[ 1235.879887] ? __ia32_sys_read+0xc0/0xc0
[ 1235.885088] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.890678] ? rcu_is_watching+0x15/0xd0
[ 1235.895877] do_syscall_64+0xf3/0x650
[ 1235.900787] ? irq_exit_rcu+0x1a/0x30
[ 1235.905696] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.912165] RIP: 0033:0x7f77f680e22e
[ 1235.916973] RSP: 002b:00007fffd9b77f00 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.926271] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f77f680e22e
[ 1235.935082] RDX: 0000000000000001 RSI: 000056342a05ccd0 RDI: 0000000000000007
[ 1235.943892] RBP: 00007fffd9b77f10 R08: 0000000000000000 R09: 0000000000000000
[ 1235.952700] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f77f6686390
[ 1235.961499] R13: 000056342a05ccd0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.970312]
[ 1235.973576] \x0aShowing all locks held in the system:
[ 1235.982113] 1 lock held by khungtaskd/185:
[ 1235.987505] #0: ffffffff8eefe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1235.998979] 3 locks held by systemd-journal/801:
[ 1236.004950] #0: ff1100180e2b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.014837] #1: ffffffff8f1033a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.027644] #2: ff110001a7a23200 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1236.039204] 4 locks held by python3/3873:
[ 1236.044499] #0: ff1100012fa513e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.054388] #1: ff1100017c1bf480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.065352] #2: ff11000122402b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.076509] #3: ff110001223e9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.086595] 4 locks held by python3/5857:
[ 1236.091891] #0: ff1100012fa513e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.101779] #1: ff110001f25ad680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.112738] #2: ff11000122402b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.123898] #3: ff110001223e9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.133986]
[ 1236.136452] =============================================\x0a
[ 1358.301842] INFO: task python3:5857 blocked for more than 491 seconds.
[ 1358.309990] Not tainted 7.1.0-rc3-onyy-g4194a54e9394 #1
[ 1358.317241] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.326833] task:python3 state:D stack:25672 pid:5857 tgid:5857 ppid:5856 task_flags:0x400100 flags:0x00080002
[ 1358.340040] Call Trace:
[ 1358.343581]
[ 1358.346731] __schedule+0xcc3/0x19c0
[ 1358.351549] ? io_schedule_timeout+0x140/0x140
[ 1358.357336] ? find_held_lock+0x2b/0x80
[ 1358.362444] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.368332] schedule+0xd4/0x260
[ 1358.372753] schedule_preempt_disabled+0x18/0x30
[ 1358.378735] __mutex_lock+0x6a3/0x2000
[ 1358.383742] ? threaded_store+0x132/0x220
[ 1358.389044] ? ww_mutex_lock+0x160/0x160
[ 1358.394242] ? selinux_inode_free_security+0x330/0x330
[ 1358.400811] ? cap_capable+0x1d6/0x3e0
[ 1358.405818] ? threaded_store+0x132/0x220
[ 1358.411116] threaded_store+0x132/0x220
[ 1358.416221] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.421522] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.426825] ? sysfs_kf_write+0x65/0x160
[ 1358.432024] ? sysfs_file_ops+0x140/0x140
[ 1358.437321] kernfs_fop_write_iter+0x335/0x510
[ 1358.443106] ? kernfs_ops+0xf0/0xf0
[ 1358.447807] new_sync_write+0x333/0x750
[ 1358.452911] ? __lock_acquire+0x508/0xc10
[ 1358.458205] ? new_sync_read+0x740/0x740
[ 1358.463407] ? lock_acquire.part.0+0xbc/0x260
[ 1358.469093] ? ksys_write+0x116/0x250
[ 1358.474002] vfs_write+0x657/0x9b0
[ 1358.478619] ksys_write+0x116/0x250
[ 1358.483332] ? __ia32_sys_read+0xc0/0xc0
[ 1358.488524] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.494115] ? rcu_is_watching+0x15/0xd0
[ 1358.499319] do_syscall_64+0xf3/0x650
[ 1358.504227] ? trace_hardirqs_off+0xd/0x30
[ 1358.509621] ? exc_page_fault+0xda/0xf0
[ 1358.514724] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.521184] RIP: 0033:0x7f2e1ea4322e
[ 1358.525994] RSP: 002b:00007ffe1830ca30 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.535291] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2e1ea4322e
[ 1358.544099] RDX: 0000000000000001 RSI: 000055b7572ebcd0 RDI: 0000000000000007
[ 1358.552907] RBP: 00007ffe1830ca40 R08: 0000000000000000 R09: 0000000000000000
[ 1358.561716] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2e1e8bb390
[ 1358.570525] R13: 000055b7572ebcd0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.579338]
[ 1358.582605] INFO: task python3:5857 is blocked on a mutex likely owned by task python3:3873.
[ 1358.592880] task:python3 state:D stack:25672 pid:3873 tgid:3873 ppid:3872 task_flags:0x400100 flags:0x00080802
[ 1358.606083] Call Trace:
[ 1358.609621]
[ 1358.612772] __schedule+0xcc3/0x19c0
[ 1358.617576] ? io_schedule_timeout+0x140/0x140
[ 1358.623361] ? find_held_lock+0x2b/0x80
[ 1358.628457] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.634633] schedule+0xd4/0x260
[ 1358.639052] schedule_timeout+0x13f/0x290
[ 1358.644349] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.650709] ? trace_contention_end+0xb3/0x1a0
[ 1358.656493] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.662185] ? ww_mutex_lock+0x160/0x160
[ 1358.667387] msleep+0x1b/0x30
[ 1358.671513] napi_set_threaded+0x3a5/0x440
[ 1358.676912] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.682408] netif_set_threaded+0x257/0x400
[ 1358.687902] threaded_store+0x1b8/0x220
[ 1358.693004] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.698302] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.703601] ? sysfs_kf_write+0x65/0x160
[ 1358.708801] ? sysfs_file_ops+0x140/0x140
[ 1358.714090] kernfs_fop_write_iter+0x335/0x510
[ 1358.719872] ? kernfs_ops+0xf0/0xf0
[ 1358.724584] new_sync_write+0x333/0x750
[ 1358.729691] ? __lock_acquire+0x508/0xc10
[ 1358.734986] ? new_sync_read+0x740/0x740
[ 1358.740188] ? lock_acquire.part.0+0xbc/0x260
[ 1358.745873] ? ksys_write+0x116/0x250
[ 1358.750783] vfs_write+0x657/0x9b0
[ 1358.755401] ksys_write+0x116/0x250
[ 1358.760115] ? __ia32_sys_read+0xc0/0xc0
[ 1358.765312] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.770903] ? rcu_is_watching+0x15/0xd0
[ 1358.776101] do_syscall_64+0xf3/0x650
[ 1358.781006] ? irq_exit_rcu+0x1a/0x30
[ 1358.785914] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.792382] RIP: 0033:0x7f77f680e22e
[ 1358.797190] RSP: 002b:00007fffd9b77f00 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.806485] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f77f680e22e
[ 1358.815294] RDX: 0000000000000001 RSI: 000056342a05ccd0 RDI: 0000000000000007
[ 1358.824104] RBP: 00007fffd9b77f10 R08: 0000000000000000 R09: 0000000000000000
[ 1358.832912] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f77f6686390
[ 1358.841710] R13: 000056342a05ccd0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.850515]
[ 1358.853784] \x0aShowing all locks held in the system:
[ 1358.862322] 1 lock held by khungtaskd/185:
[ 1358.867718] #0: ffffffff8eefe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.879190] 4 locks held by systemd-journal/801:
[ 1358.885172] #0: ff1100180da372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.895060] #1: ffffffff8f1033a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: link_path_walk+0x9a7/0x1830
[ 1358.907670] #2: ff110001a4ec74c0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1358.919225] #3: ff1100019cf04f58 (&xa->xa_lock#5){-.-.}-{3:3}, at: __folio_mark_dirty+0x9d/0x2c0
[ 1358.930004] 4 locks held by python3/3873:
[ 1358.935301] #0: ff1100012fa513e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.945195] #1: ff1100017c1bf480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.956157] #2: ff11000122402b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.967318] #3: ff110001223e9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.977410] 4 locks held by python3/5857:
[ 1358.982704] #0: ff1100012fa513e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.992594] #1: ff110001f25ad680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.003557] #2: ff11000122402b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.014713] #3: ff110001223e9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.024803]
[ 1359.027270] =============================================\x0a