[ 788.321813] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 788.324492] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 788.509229] kselftest: Running tests in drivers/net
[ 989.728515] INFO: task python3:5776 blocked for more than 122 seconds.
[ 989.736736] Not tainted 7.1.0-rc4-qdow-gee3fc64eae7f #1
[ 989.744474] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.754063] task:python3 state:D stack:25672 pid:5776 tgid:5776 ppid:5775 task_flags:0x400100 flags:0x00080000
[ 989.767266] Call Trace:
[ 989.770806]
[ 989.773955] __schedule+0xcc3/0x19c0
[ 989.778771] ? io_schedule_timeout+0x140/0x140
[ 989.784553] ? find_held_lock+0x2b/0x80
[ 989.789657] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.795544] schedule+0xd8/0x260
[ 989.799962] schedule_preempt_disabled+0x18/0x30
[ 989.805938] __mutex_lock+0x6af/0x2010
[ 989.810941] ? threaded_store+0x132/0x220
[ 989.816231] ? ww_mutex_lock+0x160/0x160
[ 989.821427] ? selinux_inode_free_security+0x330/0x330
[ 989.827994] ? cap_capable+0x1d6/0x3e0
[ 989.833000] ? threaded_store+0x132/0x220
[ 989.838287] threaded_store+0x132/0x220
[ 989.843391] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.848685] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.853983] ? sysfs_kf_write+0x65/0x160
[ 989.859180] ? sysfs_file_ops+0x140/0x140
[ 989.864473] kernfs_fop_write_iter+0x335/0x510
[ 989.870257] ? kernfs_ops+0xf0/0xf0
[ 989.874969] new_sync_write+0x333/0x750
[ 989.880070] ? __lock_acquire+0x508/0xc10
[ 989.885367] ? new_sync_read+0x740/0x740
[ 989.890558] ? lock_acquire.part.0+0xbc/0x260
[ 989.896241] ? ksys_write+0x116/0x250
[ 989.901152] vfs_write+0x657/0x9b0
[ 989.905765] ksys_write+0x116/0x250
[ 989.910475] ? __ia32_sys_read+0xc0/0xc0
[ 989.915674] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.921263] ? rcu_is_watching+0x15/0xd0
[ 989.926464] do_syscall_64+0xf3/0x650
[ 989.931371] ? trace_hardirqs_off+0xd/0x30
[ 989.936756] ? exc_page_fault+0xda/0xf0
[ 989.941856] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.948324] RIP: 0033:0x7feaa5af322e
[ 989.953133] RSP: 002b:00007ffd24b44760 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.962429] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007feaa5af322e
[ 989.971237] RDX: 0000000000000001 RSI: 00005605dd5776b0 RDI: 0000000000000007
[ 989.980033] RBP: 00007ffd24b44770 R08: 0000000000000000 R09: 0000000000000000
[ 989.988840] R10: 0000000000000000 R11: 0000000000000202 R12: 00007feaa596b390
[ 989.997649] R13: 00005605dd5776b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.006467]
[ 990.009767] INFO: task python3:5776 is blocked on a mutex likely owned by task python3:3715.
[ 990.020037] task:python3 state:D stack:25672 pid:3715 tgid:3715 ppid:3714 task_flags:0x400100 flags:0x00080802
[ 990.033240] Call Trace:
[ 990.036780]
[ 990.039930] __schedule+0xcc3/0x19c0
[ 990.044731] ? io_schedule_timeout+0x140/0x140
[ 990.050512] ? find_held_lock+0x2b/0x80
[ 990.055614] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.061783] schedule+0xd8/0x260
[ 990.066199] schedule_timeout+0x13f/0x290
[ 990.071493] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.077861] ? trace_contention_end+0xb3/0x1a0
[ 990.083646] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.089328] ? ww_mutex_lock+0x160/0x160
[ 990.094528] msleep+0x1b/0x30
[ 990.098653] napi_set_threaded+0x3a5/0x440
[ 990.104038] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.109530] netif_set_threaded+0x257/0x400
[ 990.115015] threaded_store+0x1b8/0x220
[ 990.120117] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.125405] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.130700] ? sysfs_kf_write+0x65/0x160
[ 990.135900] ? sysfs_file_ops+0x140/0x140
[ 990.141186] kernfs_fop_write_iter+0x335/0x510
[ 990.146971] ? kernfs_ops+0xf0/0xf0
[ 990.151681] new_sync_write+0x333/0x750
[ 990.156782] ? __lock_acquire+0x508/0xc10
[ 990.162077] ? new_sync_read+0x740/0x740
[ 990.167277] ? lock_acquire.part.0+0xbc/0x260
[ 990.172953] ? ksys_write+0x116/0x250
[ 990.177861] vfs_write+0x657/0x9b0
[ 990.182477] ksys_write+0x116/0x250
[ 990.187186] ? __ia32_sys_read+0xc0/0xc0
[ 990.192383] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.197971] ? rcu_is_watching+0x15/0xd0
[ 990.203169] do_syscall_64+0xf3/0x650
[ 990.208074] ? irq_exit_rcu+0x1a/0x30
[ 990.212981] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.219441] RIP: 0033:0x7ff80b54b22e
[ 990.224239] RSP: 002b:00007ffc40e83190 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.233535] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff80b54b22e
[ 990.242345] RDX: 0000000000000001 RSI: 0000557634b396b0 RDI: 0000000000000007
[ 990.251151] RBP: 00007ffc40e831a0 R08: 0000000000000000 R09: 0000000000000000
[ 990.259958] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff80b3c3390
[ 990.268762] R13: 0000557634b396b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.277573]
[ 990.280829] \x0aShowing all locks held in the system:
[ 990.289376] 1 lock held by khungtaskd/185:
[ 990.294768] #0: ffffffff9b8fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.306254] 4 locks held by python3/3715:
[ 990.311549] #0: ff1100012ef943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.321436] #1: ff1100016c62be80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.332398] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.343555] #3: ff11000122271d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.353653] 4 locks held by python3/5776:
[ 990.358945] #0: ff1100012ef943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.368830] #1: ff110001efbe6280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.379791] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.390940] #3: ff11000122271d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.401026]
[ 990.403490] =============================================\x0a
[ 1100.321583] kworker/u130:1 (224) used greatest stack depth: 21936 bytes left
[ 1112.609698] INFO: task python3:5776 blocked for more than 245 seconds.
[ 1112.617849] Not tainted 7.1.0-rc4-qdow-gee3fc64eae7f #1
[ 1112.625101] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.634691] task:python3 state:D stack:25672 pid:5776 tgid:5776 ppid:5775 task_flags:0x400100 flags:0x00080000
[ 1112.647899] Call Trace:
[ 1112.651441]
[ 1112.654591] __schedule+0xcc3/0x19c0
[ 1112.659407] ? io_schedule_timeout+0x140/0x140
[ 1112.665192] ? find_held_lock+0x2b/0x80
[ 1112.670296] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.676181] schedule+0xd8/0x260
[ 1112.680599] schedule_preempt_disabled+0x18/0x30
[ 1112.686577] __mutex_lock+0x6af/0x2010
[ 1112.691583] ? threaded_store+0x132/0x220
[ 1112.696883] ? ww_mutex_lock+0x160/0x160
[ 1112.702084] ? selinux_inode_free_security+0x330/0x330
[ 1112.708656] ? cap_capable+0x1d6/0x3e0
[ 1112.713666] ? threaded_store+0x132/0x220
[ 1112.718962] threaded_store+0x132/0x220
[ 1112.724064] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.729366] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.734665] ? sysfs_kf_write+0x65/0x160
[ 1112.739869] ? sysfs_file_ops+0x140/0x140
[ 1112.745166] kernfs_fop_write_iter+0x335/0x510
[ 1112.750950] ? kernfs_ops+0xf0/0xf0
[ 1112.755663] new_sync_write+0x333/0x750
[ 1112.760764] ? __lock_acquire+0x508/0xc10
[ 1112.766061] ? new_sync_read+0x740/0x740
[ 1112.771265] ? lock_acquire.part.0+0xbc/0x260
[ 1112.776952] ? ksys_write+0x116/0x250
[ 1112.781853] vfs_write+0x657/0x9b0
[ 1112.786467] ksys_write+0x116/0x250
[ 1112.791180] ? __ia32_sys_read+0xc0/0xc0
[ 1112.796373] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.801965] ? rcu_is_watching+0x15/0xd0
[ 1112.807166] do_syscall_64+0xf3/0x650
[ 1112.812072] ? trace_hardirqs_off+0xd/0x30
[ 1112.817468] ? exc_page_fault+0xda/0xf0
[ 1112.822563] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.829030] RIP: 0033:0x7feaa5af322e
[ 1112.833832] RSP: 002b:00007ffd24b44760 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.843133] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007feaa5af322e
[ 1112.851944] RDX: 0000000000000001 RSI: 00005605dd5776b0 RDI: 0000000000000007
[ 1112.860754] RBP: 00007ffd24b44770 R08: 0000000000000000 R09: 0000000000000000
[ 1112.869560] R10: 0000000000000000 R11: 0000000000000202 R12: 00007feaa596b390
[ 1112.878367] R13: 00005605dd5776b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.887183]
[ 1112.890461] INFO: task python3:5776 is blocked on a mutex likely owned by task python3:3715.
[ 1112.900732] task:python3 state:D stack:25672 pid:3715 tgid:3715 ppid:3714 task_flags:0x400100 flags:0x00080802
[ 1112.913938] Call Trace:
[ 1112.917478]
[ 1112.920630] __schedule+0xcc3/0x19c0
[ 1112.925439] ? io_schedule_timeout+0x140/0x140
[ 1112.931225] ? find_held_lock+0x2b/0x80
[ 1112.936331] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.942510] schedule+0xd8/0x260
[ 1112.946928] schedule_timeout+0x13f/0x290
[ 1112.952228] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.958598] ? trace_contention_end+0xb3/0x1a0
[ 1112.964382] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.970074] ? ww_mutex_lock+0x160/0x160
[ 1112.975276] msleep+0x1b/0x30
[ 1112.979401] napi_set_threaded+0x3a5/0x440
[ 1112.984798] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.990285] netif_set_threaded+0x257/0x400
[ 1112.995780] threaded_store+0x1b8/0x220
[ 1113.000882] ? xps_rxqs_store+0x2e0/0x2e0
[ 1113.006182] ? sysfs_file_kobj+0xbd/0x1e0
[ 1113.011477] ? sysfs_kf_write+0x65/0x160
[ 1113.016679] ? sysfs_file_ops+0x140/0x140
[ 1113.021977] kernfs_fop_write_iter+0x335/0x510
[ 1113.027752] ? kernfs_ops+0xf0/0xf0
[ 1113.032463] new_sync_write+0x333/0x750
[ 1113.037568] ? __lock_acquire+0x508/0xc10
[ 1113.042865] ? new_sync_read+0x740/0x740
[ 1113.048067] ? lock_acquire.part.0+0xbc/0x260
[ 1113.053753] ? ksys_write+0x116/0x250
[ 1113.058664] vfs_write+0x657/0x9b0
[ 1113.063282] ksys_write+0x116/0x250
[ 1113.067995] ? __ia32_sys_read+0xc0/0xc0
[ 1113.073193] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.078780] ? rcu_is_watching+0x15/0xd0
[ 1113.083980] do_syscall_64+0xf3/0x650
[ 1113.088885] ? irq_exit_rcu+0x1a/0x30
[ 1113.093795] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.100260] RIP: 0033:0x7ff80b54b22e
[ 1113.105070] RSP: 002b:00007ffc40e83190 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.114368] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff80b54b22e
[ 1113.123177] RDX: 0000000000000001 RSI: 0000557634b396b0 RDI: 0000000000000007
[ 1113.131988] RBP: 00007ffc40e831a0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.140799] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff80b3c3390
[ 1113.149609] R13: 0000557634b396b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.158421]
[ 1113.161684] \x0aShowing all locks held in the system:
[ 1113.170224] 1 lock held by khungtaskd/185:
[ 1113.175616] #0: ffffffff9b8fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.187099] 4 locks held by python3/3715:
[ 1113.192387] #0: ff1100012ef943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.202280] #1: ff1100016c62be80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.213242] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.224400] #3: ff11000122271d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.234496] 4 locks held by python3/5776:
[ 1113.239793] #0: ff1100012ef943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.249684] #1: ff110001efbe6280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.260647] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.271804] #3: ff11000122271d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.281886]
[ 1113.284355] =============================================\x0a
[ 1235.490881] INFO: task python3:5776 blocked for more than 368 seconds.
[ 1235.499032] Not tainted 7.1.0-rc4-qdow-gee3fc64eae7f #1
[ 1235.506284] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.515872] task:python3 state:D stack:25672 pid:5776 tgid:5776 ppid:5775 task_flags:0x400100 flags:0x00080002
[ 1235.529078] Call Trace:
[ 1235.532618]
[ 1235.535767] __schedule+0xcc3/0x19c0
[ 1235.540584] ? io_schedule_timeout+0x140/0x140
[ 1235.546370] ? find_held_lock+0x2b/0x80
[ 1235.551473] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.557356] schedule+0xd8/0x260
[ 1235.561764] schedule_preempt_disabled+0x18/0x30
[ 1235.567740] __mutex_lock+0x6af/0x2010
[ 1235.572742] ? threaded_store+0x132/0x220
[ 1235.578041] ? ww_mutex_lock+0x160/0x160
[ 1235.583241] ? selinux_inode_free_security+0x330/0x330
[ 1235.589811] ? cap_capable+0x1d6/0x3e0
[ 1235.594822] ? threaded_store+0x132/0x220
[ 1235.600119] threaded_store+0x132/0x220
[ 1235.605220] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.610517] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.615815] ? sysfs_kf_write+0x65/0x160
[ 1235.621012] ? sysfs_file_ops+0x140/0x140
[ 1235.626308] kernfs_fop_write_iter+0x335/0x510
[ 1235.632091] ? kernfs_ops+0xf0/0xf0
[ 1235.636802] new_sync_write+0x333/0x750
[ 1235.641907] ? __lock_acquire+0x508/0xc10
[ 1235.647193] ? new_sync_read+0x740/0x740
[ 1235.652391] ? lock_acquire.part.0+0xbc/0x260
[ 1235.658077] ? ksys_write+0x116/0x250
[ 1235.662987] vfs_write+0x657/0x9b0
[ 1235.667600] ksys_write+0x116/0x250
[ 1235.672315] ? __ia32_sys_read+0xc0/0xc0
[ 1235.677513] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.683100] ? rcu_is_watching+0x15/0xd0
[ 1235.688300] do_syscall_64+0xf3/0x650
[ 1235.693205] ? trace_hardirqs_off+0xd/0x30
[ 1235.698600] ? exc_page_fault+0xda/0xf0
[ 1235.703700] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.710166] RIP: 0033:0x7feaa5af322e
[ 1235.714976] RSP: 002b:00007ffd24b44760 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.724272] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007feaa5af322e
[ 1235.733077] RDX: 0000000000000001 RSI: 00005605dd5776b0 RDI: 0000000000000007
[ 1235.741883] RBP: 00007ffd24b44770 R08: 0000000000000000 R09: 0000000000000000
[ 1235.750689] R10: 0000000000000000 R11: 0000000000000202 R12: 00007feaa596b390
[ 1235.759495] R13: 00005605dd5776b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.768306]
[ 1235.771582] INFO: task python3:5776 is blocked on a mutex likely owned by task python3:3715.
[ 1235.781854] task:python3 state:D stack:25672 pid:3715 tgid:3715 ppid:3714 task_flags:0x400100 flags:0x00080802
[ 1235.795056] Call Trace:
[ 1235.798595]
[ 1235.801743] __schedule+0xcc3/0x19c0
[ 1235.806551] ? io_schedule_timeout+0x140/0x140
[ 1235.812337] ? find_held_lock+0x2b/0x80
[ 1235.817437] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.823615] schedule+0xd8/0x260
[ 1235.828033] schedule_timeout+0x13f/0x290
[ 1235.833331] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.839689] ? trace_contention_end+0xb3/0x1a0
[ 1235.845474] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.851163] ? ww_mutex_lock+0x160/0x160
[ 1235.856361] msleep+0x1b/0x30
[ 1235.860488] napi_set_threaded+0x3a5/0x440
[ 1235.865883] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.871378] netif_set_threaded+0x257/0x400
[ 1235.876871] threaded_store+0x1b8/0x220
[ 1235.881963] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.887258] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.892555] ? sysfs_kf_write+0x65/0x160
[ 1235.897751] ? sysfs_file_ops+0x140/0x140
[ 1235.903045] kernfs_fop_write_iter+0x335/0x510
[ 1235.908828] ? kernfs_ops+0xf0/0xf0
[ 1235.913537] new_sync_write+0x333/0x750
[ 1235.918637] ? __lock_acquire+0x508/0xc10
[ 1235.923934] ? new_sync_read+0x740/0x740
[ 1235.929123] ? lock_acquire.part.0+0xbc/0x260
[ 1235.934807] ? ksys_write+0x116/0x250
[ 1235.939715] vfs_write+0x657/0x9b0
[ 1235.944335] ksys_write+0x116/0x250
[ 1235.949046] ? __ia32_sys_read+0xc0/0xc0
[ 1235.954245] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.959833] ? rcu_is_watching+0x15/0xd0
[ 1235.965033] do_syscall_64+0xf3/0x650
[ 1235.969940] ? irq_exit_rcu+0x1a/0x30
[ 1235.974838] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.981305] RIP: 0033:0x7ff80b54b22e
[ 1235.986103] RSP: 002b:00007ffc40e83190 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.995397] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff80b54b22e
[ 1236.004205] RDX: 0000000000000001 RSI: 0000557634b396b0 RDI: 0000000000000007
[ 1236.013003] RBP: 00007ffc40e831a0 R08: 0000000000000000 R09: 0000000000000000
[ 1236.021811] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff80b3c3390
[ 1236.030619] R13: 0000557634b396b0 R14: 0000000000000007 R15: 0000000000000003
[ 1236.039422]
[ 1236.042687] \x0aShowing all locks held in the system:
[ 1236.051226] 1 lock held by khungtaskd/185:
[ 1236.056621] #0: ffffffff9b8fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.068101] 4 locks held by python3/3715:
[ 1236.073395] #0: ff1100012ef943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.083285] #1: ff1100016c62be80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.094237] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.105391] #3: ff11000122271d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.115484] 4 locks held by python3/5776:
[ 1236.120778] #0: ff1100012ef943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.130667] #1: ff110001efbe6280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.141622] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.152776] #3: ff11000122271d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.162865]
[ 1236.165332] =============================================\x0a
[ 1358.372075] INFO: task python3:5776 blocked for more than 491 seconds.
[ 1358.380223] Not tainted 7.1.0-rc4-qdow-gee3fc64eae7f #1
[ 1358.387476] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.397066] task:python3 state:D stack:25672 pid:5776 tgid:5776 ppid:5775 task_flags:0x400100 flags:0x00080002
[ 1358.410276] Call Trace:
[ 1358.410280]
[ 1358.410283] __schedule+0xcc3/0x19c0
[ 1358.410295] ? io_schedule_timeout+0x140/0x140
[ 1358.427616] ? find_held_lock+0x2b/0x80
[ 1358.432722] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.438626] schedule+0xd8/0x260
[ 1358.443046] schedule_preempt_disabled+0x18/0x30
[ 1358.449019] __mutex_lock+0x6af/0x2010
[ 1358.454026] ? threaded_store+0x132/0x220
[ 1358.459325] ? ww_mutex_lock+0x160/0x160
[ 1358.464523] ? selinux_inode_free_security+0x330/0x330
[ 1358.471093] ? cap_capable+0x1d6/0x3e0
[ 1358.476101] ? threaded_store+0x132/0x220
[ 1358.481400] threaded_store+0x132/0x220
[ 1358.486501] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.491798] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.497094] ? sysfs_kf_write+0x65/0x160
[ 1358.502296] ? sysfs_file_ops+0x140/0x140
[ 1358.507592] kernfs_fop_write_iter+0x335/0x510
[ 1358.513379] ? kernfs_ops+0xf0/0xf0
[ 1358.518089] new_sync_write+0x333/0x750
[ 1358.523194] ? __lock_acquire+0x508/0xc10
[ 1358.528493] ? new_sync_read+0x740/0x740
[ 1358.533695] ? lock_acquire.part.0+0xbc/0x260
[ 1358.539381] ? ksys_write+0x116/0x250
[ 1358.544291] vfs_write+0x657/0x9b0
[ 1358.548908] ksys_write+0x116/0x250
[ 1358.553623] ? __ia32_sys_read+0xc0/0xc0
[ 1358.558820] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.564410] ? rcu_is_watching+0x15/0xd0
[ 1358.569612] do_syscall_64+0xf3/0x650
[ 1358.574520] ? trace_hardirqs_off+0xd/0x30
[ 1358.579916] ? exc_page_fault+0xda/0xf0
[ 1358.585023] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.591483] RIP: 0033:0x7feaa5af322e
[ 1358.596293] RSP: 002b:00007ffd24b44760 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.605592] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007feaa5af322e
[ 1358.614402] RDX: 0000000000000001 RSI: 00005605dd5776b0 RDI: 0000000000000007
[ 1358.623211] RBP: 00007ffd24b44770 R08: 0000000000000000 R09: 0000000000000000
[ 1358.632022] R10: 0000000000000000 R11: 0000000000000202 R12: 00007feaa596b390
[ 1358.640830] R13: 00005605dd5776b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.649643]
[ 1358.652931] INFO: task python3:5776 is blocked on a mutex likely owned by task python3:3715.
[ 1358.663204] task:python3 state:D stack:25672 pid:3715 tgid:3715 ppid:3714 task_flags:0x400100 flags:0x00080802
[ 1358.676407] Call Trace:
[ 1358.679946]
[ 1358.683097] __schedule+0xcc3/0x19c0
[ 1358.687909] ? io_schedule_timeout+0x140/0x140
[ 1358.693693] ? find_held_lock+0x2b/0x80
[ 1358.698799] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.704975] schedule+0xd8/0x260
[ 1358.709384] schedule_timeout+0x13f/0x290
[ 1358.714680] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.721050] ? trace_contention_end+0xb3/0x1a0
[ 1358.726827] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.732518] ? ww_mutex_lock+0x160/0x160
[ 1358.737718] msleep+0x1b/0x30
[ 1358.741843] napi_set_threaded+0x3a5/0x440
[ 1358.747242] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.752737] netif_set_threaded+0x257/0x400
[ 1358.758229] threaded_store+0x1b8/0x220
[ 1358.763326] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.768623] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.773926] ? sysfs_kf_write+0x65/0x160
[ 1358.779127] ? sysfs_file_ops+0x140/0x140
[ 1358.784423] kernfs_fop_write_iter+0x335/0x510
[ 1358.790206] ? kernfs_ops+0xf0/0xf0
[ 1358.794916] new_sync_write+0x333/0x750
[ 1358.800025] ? __lock_acquire+0x508/0xc10
[ 1358.805323] ? new_sync_read+0x740/0x740
[ 1358.810523] ? lock_acquire.part.0+0xbc/0x260
[ 1358.816200] ? ksys_write+0x116/0x250
[ 1358.821110] vfs_write+0x657/0x9b0
[ 1358.825727] ksys_write+0x116/0x250
[ 1358.830441] ? __ia32_sys_read+0xc0/0xc0
[ 1358.835642] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.841232] ? rcu_is_watching+0x15/0xd0
[ 1358.846434] do_syscall_64+0xf3/0x650
[ 1358.851342] ? irq_exit_rcu+0x1a/0x30
[ 1358.856249] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.862718] RIP: 0033:0x7ff80b54b22e
[ 1358.867525] RSP: 002b:00007ffc40e83190 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.876822] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff80b54b22e
[ 1358.885621] RDX: 0000000000000001 RSI: 0000557634b396b0 RDI: 0000000000000007
[ 1358.894422] RBP: 00007ffc40e831a0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.903231] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff80b3c3390
[ 1358.912038] R13: 0000557634b396b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.920852]
[ 1358.924119] \x0aShowing all locks held in the system:
[ 1358.932659] 1 lock held by khungtaskd/185:
[ 1358.938054] #0: ffffffff9b8fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.949517] 5 locks held by systemd-journal/802:
[ 1358.955498] #0: ff1100180e4372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.965385] #1: ffffffff9bb02b20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.978193] #2: ff1100018b35a2e0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1358.989741] #3: ff1100019d794f58 (&xa->xa_lock#5){-.-.}-{3:3}, at: __folio_mark_dirty+0x9d/0x2c0
[ 1359.000511] #4: ffffffff9b8fdde0 (rcu_read_lock){....}-{1:3}, at: mem_cgroup_track_foreign_dirty+0x59/0x3a0
[ 1359.012363] 4 locks held by python3/3715:
[ 1359.017659] #0: ff1100012ef943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.027548] #1: ff1100016c62be80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.038514] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.049674] #3: ff11000122271d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.059768] 4 locks held by python3/5776:
[ 1359.065062] #0: ff1100012ef943e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.074952] #1: ff110001efbe6280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.085906] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.097060] #3: ff11000122271d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.107150] 5 locks held by (systemd-user-)/7611:
[ 1359.113227] #0: ff1100012f0843e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.123117] #1: ff11000151b96e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.134078] #2: ffffffff9b969b60 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1359.144747] #3: ffffffff9b7686f0 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650
[ 1359.156392] #4: ffffffff9b9698d0 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650
[ 1359.168819]
[ 1359.171289] =============================================\x0a