[ 788.567385] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 788.569835] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 788.723047] kselftest: Running tests in drivers/net
[ 989.676245] INFO: task python3:5822 blocked for more than 122 seconds.
[ 989.684473] Not tainted 7.1.0-rc2-ycxg-g3651961d41e1 #1
[ 989.692375] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.701968] task:python3 state:D stack:25032 pid:5822 tgid:5822 ppid:5821 task_flags:0x400100 flags:0x00080000
[ 989.715176] Call Trace:
[ 989.718714]
[ 989.721864] __schedule+0xcba/0x1940
[ 989.726684] ? io_schedule_timeout+0x140/0x140
[ 989.732469] ? find_held_lock+0x2b/0x80
[ 989.737576] schedule+0xd4/0x260
[ 989.741997] schedule_preempt_disabled+0x18/0x30
[ 989.747975] __mutex_lock+0x6a3/0x2000
[ 989.752980] ? threaded_store+0x132/0x220
[ 989.758279] ? ww_mutex_lock+0x160/0x160
[ 989.763476] ? selinux_inode_free_security+0x330/0x330
[ 989.770040] ? cap_capable+0x1d6/0x3e0
[ 989.775047] ? threaded_store+0x132/0x220
[ 989.780344] threaded_store+0x132/0x220
[ 989.785446] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.790733] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.796033] ? sysfs_kf_write+0x65/0x160
[ 989.801237] ? sysfs_file_ops+0x140/0x140
[ 989.806538] kernfs_fop_write_iter+0x335/0x510
[ 989.812323] ? kernfs_ops+0xf0/0xf0
[ 989.817029] new_sync_write+0x333/0x750
[ 989.822132] ? __lock_acquire+0x508/0xc10
[ 989.827429] ? new_sync_read+0x740/0x740
[ 989.832633] ? lock_acquire.part.0+0xbc/0x260
[ 989.838318] ? ksys_write+0x116/0x250
[ 989.843230] vfs_write+0x657/0x9b0
[ 989.847849] ksys_write+0x116/0x250
[ 989.852560] ? __ia32_sys_read+0xc0/0xc0
[ 989.857759] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.863347] ? rcu_is_watching+0x15/0xd0
[ 989.868549] do_syscall_64+0xf3/0x650
[ 989.873458] ? irq_exit_rcu+0x1a/0x30
[ 989.878364] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.884833] RIP: 0033:0x7feea9c3a22e
[ 989.889641] RSP: 002b:00007ffe672dc7f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.898942] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007feea9c3a22e
[ 989.907760] RDX: 0000000000000001 RSI: 000055bd02c7bfe0 RDI: 0000000000000007
[ 989.916567] RBP: 00007ffe672dc800 R08: 0000000000000000 R09: 0000000000000000
[ 989.925373] R10: 0000000000000000 R11: 0000000000000202 R12: 00007feea9ab2390
[ 989.934179] R13: 000055bd02c7bfe0 R14: 0000000000000007 R15: 0000000000000003
[ 989.942993]
[ 989.946302] INFO: task python3:5822 is blocked on a mutex likely owned by task python3:3768.
[ 989.956574] task:python3 state:D stack:25672 pid:3768 tgid:3768 ppid:3767 task_flags:0x400100 flags:0x00080802
[ 989.969776] Call Trace:
[ 989.973314]
[ 989.976465] __schedule+0xcba/0x1940
[ 989.981278] ? io_schedule_timeout+0x140/0x140
[ 989.987063] ? find_held_lock+0x2b/0x80
[ 989.992169] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.998350] schedule+0xd4/0x260
[ 990.002770] schedule_timeout+0x13f/0x290
[ 990.008075] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.014446] ? trace_contention_end+0xb3/0x1a0
[ 990.020230] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.025923] ? ww_mutex_lock+0x160/0x160
[ 990.031124] msleep+0x1b/0x30
[ 990.035248] napi_set_threaded+0x3a5/0x440
[ 990.040645] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.046133] netif_set_threaded+0x257/0x400
[ 990.051630] threaded_store+0x1b8/0x220
[ 990.056732] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.062020] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.067320] ? sysfs_kf_write+0x65/0x160
[ 990.072520] ? sysfs_file_ops+0x140/0x140
[ 990.077817] kernfs_fop_write_iter+0x335/0x510
[ 990.083601] ? kernfs_ops+0xf0/0xf0
[ 990.088313] new_sync_write+0x333/0x750
[ 990.093416] ? __lock_acquire+0x508/0xc10
[ 990.098704] ? new_sync_read+0x740/0x740
[ 990.103905] ? lock_acquire.part.0+0xbc/0x260
[ 990.109593] ? ksys_write+0x116/0x250
[ 990.114503] vfs_write+0x657/0x9b0
[ 990.119117] ksys_write+0x116/0x250
[ 990.123819] ? __ia32_sys_read+0xc0/0xc0
[ 990.129017] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.134608] ? rcu_is_watching+0x15/0xd0
[ 990.139808] do_syscall_64+0xf3/0x650
[ 990.144707] ? trace_hardirqs_off+0xd/0x30
[ 990.150100] ? exc_page_fault+0xda/0xf0
[ 990.155204] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.161661] RIP: 0033:0x7f89a811922e
[ 990.166471] RSP: 002b:00007ffc73518440 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.175769] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f89a811922e
[ 990.184579] RDX: 0000000000000001 RSI: 00005612f18a0fe0 RDI: 0000000000000007
[ 990.193391] RBP: 00007ffc73518450 R08: 0000000000000000 R09: 0000000000000000
[ 990.202198] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f89a7f91390
[ 990.211005] R13: 00005612f18a0fe0 R14: 0000000000000007 R15: 0000000000000003
[ 990.219819]
[ 990.223086] \x0aShowing all locks held in the system:
[ 990.231625] 1 lock held by khungtaskd/186:
[ 990.237017] #0: ffffffffb42fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.248499] 4 locks held by python3/3768:
[ 990.253794] #0: ff110001307d13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.263685] #1: ff1100017c8cfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.274647] #2: ff11000111eaab50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.285805] #3: ff11000111f21d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.295906] 4 locks held by python3/5822:
[ 990.301203] #0: ff110001307d13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.311094] #1: ff110001dd660880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.322056] #2: ff11000111eaab50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.333214] #3: ff11000111f21d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.343304]
[ 990.345770] =============================================\x0a
[ 1112.558519] INFO: task python3:5822 blocked for more than 245 seconds.
[ 1112.566670] Not tainted 7.1.0-rc2-ycxg-g3651961d41e1 #1
[ 1112.573921] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.583513] task:python3 state:D stack:25032 pid:5822 tgid:5822 ppid:5821 task_flags:0x400100 flags:0x00080000
[ 1112.596720] Call Trace:
[ 1112.600260]
[ 1112.603410] __schedule+0xcba/0x1940
[ 1112.608227] ? io_schedule_timeout+0x140/0x140
[ 1112.614010] ? find_held_lock+0x2b/0x80
[ 1112.619112] schedule+0xd4/0x260
[ 1112.623534] schedule_preempt_disabled+0x18/0x30
[ 1112.629513] __mutex_lock+0x6a3/0x2000
[ 1112.634517] ? threaded_store+0x132/0x220
[ 1112.639816] ? ww_mutex_lock+0x160/0x160
[ 1112.645016] ? selinux_inode_free_security+0x330/0x330
[ 1112.651587] ? cap_capable+0x1d6/0x3e0
[ 1112.656597] ? threaded_store+0x132/0x220
[ 1112.661911] threaded_store+0x132/0x220
[ 1112.667019] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.672319] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.677617] ? sysfs_kf_write+0x65/0x160
[ 1112.682818] ? sysfs_file_ops+0x140/0x140
[ 1112.688114] kernfs_fop_write_iter+0x335/0x510
[ 1112.693898] ? kernfs_ops+0xf0/0xf0
[ 1112.698609] new_sync_write+0x333/0x750
[ 1112.703713] ? __lock_acquire+0x508/0xc10
[ 1112.709000] ? new_sync_read+0x740/0x740
[ 1112.714203] ? lock_acquire.part.0+0xbc/0x260
[ 1112.719888] ? ksys_write+0x116/0x250
[ 1112.724799] vfs_write+0x657/0x9b0
[ 1112.729417] ksys_write+0x116/0x250
[ 1112.734130] ? __ia32_sys_read+0xc0/0xc0
[ 1112.739329] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.744919] ? rcu_is_watching+0x15/0xd0
[ 1112.750123] do_syscall_64+0xf3/0x650
[ 1112.755031] ? irq_exit_rcu+0x1a/0x30
[ 1112.759939] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.766400] RIP: 0033:0x7feea9c3a22e
[ 1112.771209] RSP: 002b:00007ffe672dc7f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.780508] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007feea9c3a22e
[ 1112.789315] RDX: 0000000000000001 RSI: 000055bd02c7bfe0 RDI: 0000000000000007
[ 1112.798126] RBP: 00007ffe672dc800 R08: 0000000000000000 R09: 0000000000000000
[ 1112.806936] R10: 0000000000000000 R11: 0000000000000202 R12: 00007feea9ab2390
[ 1112.815746] R13: 000055bd02c7bfe0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.824560]
[ 1112.827846] INFO: task python3:5822 is blocked on a mutex likely owned by task python3:3768.
[ 1112.838119] task:python3 state:D stack:25672 pid:3768 tgid:3768 ppid:3767 task_flags:0x400100 flags:0x00080802
[ 1112.851321] Call Trace:
[ 1112.854858]
[ 1112.858007] __schedule+0xcba/0x1940
[ 1112.862819] ? io_schedule_timeout+0x140/0x140
[ 1112.868603] ? find_held_lock+0x2b/0x80
[ 1112.873706] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.879885] schedule+0xd4/0x260
[ 1112.884302] schedule_timeout+0x13f/0x290
[ 1112.889602] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.895972] ? trace_contention_end+0xb3/0x1a0
[ 1112.901759] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.907449] ? ww_mutex_lock+0x160/0x160
[ 1112.912650] msleep+0x1b/0x30
[ 1112.916776] napi_set_threaded+0x3a5/0x440
[ 1112.922173] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.927667] netif_set_threaded+0x257/0x400
[ 1112.933162] threaded_store+0x1b8/0x220
[ 1112.938264] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.943564] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.948863] ? sysfs_kf_write+0x65/0x160
[ 1112.954061] ? sysfs_file_ops+0x140/0x140
[ 1112.959359] kernfs_fop_write_iter+0x335/0x510
[ 1112.965145] ? kernfs_ops+0xf0/0xf0
[ 1112.969849] new_sync_write+0x333/0x750
[ 1112.974952] ? __lock_acquire+0x508/0xc10
[ 1112.980242] ? new_sync_read+0x740/0x740
[ 1112.985443] ? lock_acquire.part.0+0xbc/0x260
[ 1112.991129] ? ksys_write+0x116/0x250
[ 1112.996042] vfs_write+0x657/0x9b0
[ 1113.000658] ksys_write+0x116/0x250
[ 1113.005372] ? __ia32_sys_read+0xc0/0xc0
[ 1113.010571] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.016158] ? rcu_is_watching+0x15/0xd0
[ 1113.021362] do_syscall_64+0xf3/0x650
[ 1113.026269] ? trace_hardirqs_off+0xd/0x30
[ 1113.031663] ? exc_page_fault+0xda/0xf0
[ 1113.036765] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.043233] RIP: 0033:0x7f89a811922e
[ 1113.048041] RSP: 002b:00007ffc73518440 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.057338] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f89a811922e
[ 1113.066148] RDX: 0000000000000001 RSI: 00005612f18a0fe0 RDI: 0000000000000007
[ 1113.074958] RBP: 00007ffc73518450 R08: 0000000000000000 R09: 0000000000000000
[ 1113.083769] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f89a7f91390
[ 1113.092576] R13: 00005612f18a0fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.101384]
[ 1113.104648] \x0aShowing all locks held in the system:
[ 1113.113187] 1 lock held by khungtaskd/186:
[ 1113.118582] #0: ffffffffb42fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.130061] 4 locks held by python3/3768:
[ 1113.135359] #0: ff110001307d13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.145251] #1: ff1100017c8cfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.156213] #2: ff11000111eaab50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.167371] #3: ff11000111f21d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.177467] 4 locks held by python3/5822:
[ 1113.182761] #0: ff110001307d13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.192652] #1: ff110001dd660880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.203613] #2: ff11000111eaab50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.214772] #3: ff11000111f21d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.224865]
[ 1113.227333] =============================================\x0a
[ 1235.439769] INFO: task python3:5822 blocked for more than 368 seconds.
[ 1235.447916] Not tainted 7.1.0-rc2-ycxg-g3651961d41e1 #1
[ 1235.455160] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.464749] task:python3 state:D stack:25032 pid:5822 tgid:5822 ppid:5821 task_flags:0x400100 flags:0x00080002
[ 1235.477953] Call Trace:
[ 1235.481489]
[ 1235.484638] __schedule+0xcba/0x1940
[ 1235.489453] ? io_schedule_timeout+0x140/0x140
[ 1235.495229] ? find_held_lock+0x2b/0x80
[ 1235.500337] schedule+0xd4/0x260
[ 1235.504757] schedule_preempt_disabled+0x18/0x30
[ 1235.510725] __mutex_lock+0x6a3/0x2000
[ 1235.515726] ? threaded_store+0x132/0x220
[ 1235.521025] ? ww_mutex_lock+0x160/0x160
[ 1235.526221] ? selinux_inode_free_security+0x330/0x330
[ 1235.532791] ? cap_capable+0x1d6/0x3e0
[ 1235.537795] ? threaded_store+0x132/0x220
[ 1235.543089] threaded_store+0x132/0x220
[ 1235.548193] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.553488] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.558785] ? sysfs_kf_write+0x65/0x160
[ 1235.563985] ? sysfs_file_ops+0x140/0x140
[ 1235.569271] kernfs_fop_write_iter+0x335/0x510
[ 1235.575054] ? kernfs_ops+0xf0/0xf0
[ 1235.579762] new_sync_write+0x333/0x750
[ 1235.584862] ? __lock_acquire+0x508/0xc10
[ 1235.590157] ? new_sync_read+0x740/0x740
[ 1235.595359] ? lock_acquire.part.0+0xbc/0x260
[ 1235.601043] ? ksys_write+0x116/0x250
[ 1235.605952] vfs_write+0x657/0x9b0
[ 1235.610566] ksys_write+0x116/0x250
[ 1235.615276] ? __ia32_sys_read+0xc0/0xc0
[ 1235.620475] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.626063] ? rcu_is_watching+0x15/0xd0
[ 1235.631264] do_syscall_64+0xf3/0x650
[ 1235.636171] ? irq_exit_rcu+0x1a/0x30
[ 1235.641079] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.647545] RIP: 0033:0x7feea9c3a22e
[ 1235.652353] RSP: 002b:00007ffe672dc7f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.661648] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007feea9c3a22e
[ 1235.670456] RDX: 0000000000000001 RSI: 000055bd02c7bfe0 RDI: 0000000000000007
[ 1235.679253] RBP: 00007ffe672dc800 R08: 0000000000000000 R09: 0000000000000000
[ 1235.688059] R10: 0000000000000000 R11: 0000000000000202 R12: 00007feea9ab2390
[ 1235.696864] R13: 000055bd02c7bfe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.705677]
[ 1235.708977] INFO: task python3:5822 is blocked on a mutex likely owned by task python3:3768.
[ 1235.719249] task:python3 state:D stack:25672 pid:3768 tgid:3768 ppid:3767 task_flags:0x400100 flags:0x00080802
[ 1235.732453] Call Trace:
[ 1235.735992]
[ 1235.739138] __schedule+0xcba/0x1940
[ 1235.743949] ? io_schedule_timeout+0x140/0x140
[ 1235.749731] ? find_held_lock+0x2b/0x80
[ 1235.754832] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.761012] schedule+0xd4/0x260
[ 1235.765430] schedule_timeout+0x13f/0x290
[ 1235.770726] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.777092] ? trace_contention_end+0xb3/0x1a0
[ 1235.782874] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.788563] ? ww_mutex_lock+0x160/0x160
[ 1235.793761] msleep+0x1b/0x30
[ 1235.797888] napi_set_threaded+0x3a5/0x440
[ 1235.803283] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.808778] netif_set_threaded+0x257/0x400
[ 1235.814271] threaded_store+0x1b8/0x220
[ 1235.819363] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.824661] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.829958] ? sysfs_kf_write+0x65/0x160
[ 1235.835156] ? sysfs_file_ops+0x140/0x140
[ 1235.840450] kernfs_fop_write_iter+0x335/0x510
[ 1235.846233] ? kernfs_ops+0xf0/0xf0
[ 1235.850945] new_sync_write+0x333/0x750
[ 1235.856037] ? __lock_acquire+0x508/0xc10
[ 1235.861334] ? new_sync_read+0x740/0x740
[ 1235.866532] ? lock_acquire.part.0+0xbc/0x260
[ 1235.872215] ? ksys_write+0x116/0x250
[ 1235.877124] vfs_write+0x657/0x9b0
[ 1235.881737] ksys_write+0x116/0x250
[ 1235.886446] ? __ia32_sys_read+0xc0/0xc0
[ 1235.891645] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.897234] ? rcu_is_watching+0x15/0xd0
[ 1235.902428] do_syscall_64+0xf3/0x650
[ 1235.907333] ? trace_hardirqs_off+0xd/0x30
[ 1235.912717] ? exc_page_fault+0xda/0xf0
[ 1235.917819] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.924287] RIP: 0033:0x7f89a811922e
[ 1235.929092] RSP: 002b:00007ffc73518440 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.938385] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f89a811922e
[ 1235.947192] RDX: 0000000000000001 RSI: 00005612f18a0fe0 RDI: 0000000000000007
[ 1235.955998] RBP: 00007ffc73518450 R08: 0000000000000000 R09: 0000000000000000
[ 1235.964804] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f89a7f91390
[ 1235.973617] R13: 00005612f18a0fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.982430]
[ 1235.985696] \x0aShowing all locks held in the system:
[ 1235.994228] 1 lock held by khungtaskd/186:
[ 1235.999622] #0: ffffffffb42fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.011103] 4 locks held by python3/3768:
[ 1236.016398] #0: ff110001307d13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.026288] #1: ff1100017c8cfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.037247] #2: ff11000111eaab50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.048401] #3: ff11000111f21d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.058496] 4 locks held by python3/5822:
[ 1236.063789] #0: ff110001307d13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.073675] #1: ff110001dd660880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.084638] #2: ff11000111eaab50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.095795] #3: ff11000111f21d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.105884]
[ 1236.108348] =============================================\x0a
[ 1358.321045] INFO: task python3:5822 blocked for more than 491 seconds.
[ 1358.329193] Not tainted 7.1.0-rc2-ycxg-g3651961d41e1 #1
[ 1358.336442] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.346031] task:python3 state:D stack:25032 pid:5822 tgid:5822 ppid:5821 task_flags:0x400100 flags:0x00080002
[ 1358.359238] Call Trace:
[ 1358.362775]
[ 1358.365929] __schedule+0xcba/0x1940
[ 1358.370746] ? io_schedule_timeout+0x140/0x140
[ 1358.376531] ? find_held_lock+0x2b/0x80
[ 1358.381639] schedule+0xd4/0x260
[ 1358.386059] schedule_preempt_disabled+0x18/0x30
[ 1358.392037] __mutex_lock+0x6a3/0x2000
[ 1358.397040] ? threaded_store+0x132/0x220
[ 1358.402342] ? ww_mutex_lock+0x160/0x160
[ 1358.407541] ? selinux_inode_free_security+0x330/0x330
[ 1358.414112] ? cap_capable+0x1d6/0x3e0
[ 1358.419121] ? threaded_store+0x132/0x220
[ 1358.424420] threaded_store+0x132/0x220
[ 1358.429522] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.434813] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.440112] ? sysfs_kf_write+0x65/0x160
[ 1358.445315] ? sysfs_file_ops+0x140/0x140
[ 1358.450615] kernfs_fop_write_iter+0x335/0x510
[ 1358.456403] ? kernfs_ops+0xf0/0xf0
[ 1358.461115] new_sync_write+0x333/0x750
[ 1358.466218] ? __lock_acquire+0x508/0xc10
[ 1358.471514] ? new_sync_read+0x740/0x740
[ 1358.476717] ? lock_acquire.part.0+0xbc/0x260
[ 1358.482406] ? ksys_write+0x116/0x250
[ 1358.487316] vfs_write+0x657/0x9b0
[ 1358.491930] ksys_write+0x116/0x250
[ 1358.496644] ? __ia32_sys_read+0xc0/0xc0
[ 1358.501846] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.507434] ? rcu_is_watching+0x15/0xd0
[ 1358.512635] do_syscall_64+0xf3/0x650
[ 1358.517543] ? irq_exit_rcu+0x1a/0x30
[ 1358.522440] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.528911] RIP: 0033:0x7feea9c3a22e
[ 1358.533722] RSP: 002b:00007ffe672dc7f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.543021] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007feea9c3a22e
[ 1358.551828] RDX: 0000000000000001 RSI: 000055bd02c7bfe0 RDI: 0000000000000007
[ 1358.560635] RBP: 00007ffe672dc800 R08: 0000000000000000 R09: 0000000000000000
[ 1358.569441] R10: 0000000000000000 R11: 0000000000000202 R12: 00007feea9ab2390
[ 1358.578251] R13: 000055bd02c7bfe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.587068]
[ 1358.590359] INFO: task python3:5822 is blocked on a mutex likely owned by task python3:3768.
[ 1358.600630] task:python3 state:D stack:25672 pid:3768 tgid:3768 ppid:3767 task_flags:0x400100 flags:0x00080802
[ 1358.613832] Call Trace:
[ 1358.617373]
[ 1358.620526] __schedule+0xcba/0x1940
[ 1358.625337] ? io_schedule_timeout+0x140/0x140
[ 1358.631122] ? find_held_lock+0x2b/0x80
[ 1358.636227] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.642405] schedule+0xd4/0x260
[ 1358.646823] schedule_timeout+0x13f/0x290
[ 1358.652120] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.658491] ? trace_contention_end+0xb3/0x1a0
[ 1358.664279] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.669970] ? ww_mutex_lock+0x160/0x160
[ 1358.675171] msleep+0x1b/0x30
[ 1358.679298] napi_set_threaded+0x3a5/0x440
[ 1358.684696] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.690192] netif_set_threaded+0x257/0x400
[ 1358.695688] threaded_store+0x1b8/0x220
[ 1358.700792] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.706089] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.711385] ? sysfs_kf_write+0x65/0x160
[ 1358.716585] ? sysfs_file_ops+0x140/0x140
[ 1358.721872] kernfs_fop_write_iter+0x335/0x510
[ 1358.727655] ? kernfs_ops+0xf0/0xf0
[ 1358.732366] new_sync_write+0x333/0x750
[ 1358.737469] ? __lock_acquire+0x508/0xc10
[ 1358.742763] ? new_sync_read+0x740/0x740
[ 1358.747966] ? lock_acquire.part.0+0xbc/0x260
[ 1358.753652] ? ksys_write+0x116/0x250
[ 1358.758556] vfs_write+0x657/0x9b0
[ 1358.763169] ksys_write+0x116/0x250
[ 1358.767886] ? __ia32_sys_read+0xc0/0xc0
[ 1358.773088] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.778678] ? rcu_is_watching+0x15/0xd0
[ 1358.783886] do_syscall_64+0xf3/0x650
[ 1358.788791] ? trace_hardirqs_off+0xd/0x30
[ 1358.794185] ? exc_page_fault+0xda/0xf0
[ 1358.799288] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.805755] RIP: 0033:0x7f89a811922e
[ 1358.810553] RSP: 002b:00007ffc73518440 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.819852] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f89a811922e
[ 1358.828662] RDX: 0000000000000001 RSI: 00005612f18a0fe0 RDI: 0000000000000007
[ 1358.837471] RBP: 00007ffc73518450 R08: 0000000000000000 R09: 0000000000000000
[ 1358.846283] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f89a7f91390
[ 1358.855093] R13: 00005612f18a0fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.863908]
[ 1358.867179] \x0aShowing all locks held in the system:
[ 1358.875719] 1 lock held by khungtaskd/186:
[ 1358.881114] #0: ffffffffb42fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.892589] 4 locks held by python3/3768:
[ 1358.897887] #0: ff110001307d13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.907779] #1: ff1100017c8cfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.918742] #2: ff11000111eaab50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.929902] #3: ff11000111f21d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.939994] 4 locks held by python3/5822:
[ 1358.945289] #0: ff110001307d13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.955181] #1: ff110001dd660880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.966141] #2: ff11000111eaab50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.977297] #3: ff11000111f21d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.987393]
[ 1358.989861] =============================================\x0a