[ 790.296840] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 790.299309] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 790.428518] kselftest: Running tests in drivers/net
[ 854.515075] kworker/u130:1 (222) used greatest stack depth: 21456 bytes left
[ 989.683379] INFO: task python3:5837 blocked for more than 122 seconds.
[ 989.691617] Not tainted 7.1.0-rc5-kiyo-g9104697d8848 #1
[ 989.699571] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.709161] task:python3 state:D stack:25672 pid:5837 tgid:5837 ppid:5836 task_flags:0x400100 flags:0x00080000
[ 989.722360] Call Trace:
[ 989.725902]
[ 989.729052] __schedule+0xcc3/0x19c0
[ 989.733872] ? io_schedule_timeout+0x140/0x140
[ 989.739659] ? find_held_lock+0x2b/0x80
[ 989.744763] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.750651] schedule+0xd8/0x260
[ 989.755068] schedule_preempt_disabled+0x18/0x30
[ 989.761046] __mutex_lock+0x6af/0x2010
[ 989.766054] ? threaded_store+0x132/0x220
[ 989.771353] ? ww_mutex_lock+0x160/0x160
[ 989.776545] ? selinux_inode_free_security+0x330/0x330
[ 989.783118] ? cap_capable+0x1d6/0x3e0
[ 989.788127] ? threaded_store+0x132/0x220
[ 989.793426] threaded_store+0x132/0x220
[ 989.798528] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.803826] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.809127] ? sysfs_kf_write+0x65/0x160
[ 989.814328] ? sysfs_file_ops+0x140/0x140
[ 989.819622] kernfs_fop_write_iter+0x335/0x510
[ 989.825407] ? kernfs_ops+0xf0/0xf0
[ 989.830119] new_sync_write+0x333/0x750
[ 989.835226] ? __lock_acquire+0x508/0xc10
[ 989.840522] ? new_sync_read+0x740/0x740
[ 989.845725] ? lock_acquire.part.0+0xbc/0x260
[ 989.851413] ? ksys_write+0x116/0x250
[ 989.856324] vfs_write+0x657/0x9b0
[ 989.860938] ksys_write+0x116/0x250
[ 989.865651] ? __ia32_sys_read+0xc0/0xc0
[ 989.870849] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.876441] ? rcu_is_watching+0x15/0xd0
[ 989.881641] do_syscall_64+0xf3/0x650
[ 989.886538] ? trace_hardirqs_off+0xd/0x30
[ 989.891932] ? exc_page_fault+0xda/0xf0
[ 989.897036] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.903506] RIP: 0033:0x7f4b9462b22e
[ 989.908319] RSP: 002b:00007ffe0edac3d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.917618] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4b9462b22e
[ 989.926425] RDX: 0000000000000001 RSI: 0000564be28966b0 RDI: 0000000000000007
[ 989.935236] RBP: 00007ffe0edac3e0 R08: 0000000000000000 R09: 0000000000000000
[ 989.944046] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4b944a3390
[ 989.952857] R13: 0000564be28966b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.961679]
[ 989.964984] INFO: task python3:5837 is blocked on a mutex likely owned by task python3:3807.
[ 989.975256] task:python3 state:D stack:25672 pid:3807 tgid:3807 ppid:3806 task_flags:0x400100 flags:0x00080802
[ 989.988458] Call Trace:
[ 989.991996]
[ 989.995147] __schedule+0xcc3/0x19c0
[ 989.999960] ? io_schedule_timeout+0x140/0x140
[ 990.005743] ? find_held_lock+0x2b/0x80
[ 990.010848] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.017027] schedule+0xd8/0x260
[ 990.021445] schedule_timeout+0x13f/0x290
[ 990.026742] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.033112] ? trace_contention_end+0xb3/0x1a0
[ 990.038898] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.044590] ? ww_mutex_lock+0x160/0x160
[ 990.049791] msleep+0x1b/0x30
[ 990.053918] napi_set_threaded+0x3a5/0x440
[ 990.059316] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.064812] netif_set_threaded+0x257/0x400
[ 990.070307] threaded_store+0x1b8/0x220
[ 990.075412] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.080709] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.086003] ? sysfs_kf_write+0x65/0x160
[ 990.091202] ? sysfs_file_ops+0x140/0x140
[ 990.096499] kernfs_fop_write_iter+0x335/0x510
[ 990.102285] ? kernfs_ops+0xf0/0xf0
[ 990.106996] new_sync_write+0x333/0x750
[ 990.112099] ? __lock_acquire+0x508/0xc10
[ 990.117395] ? new_sync_read+0x740/0x740
[ 990.122596] ? lock_acquire.part.0+0xbc/0x260
[ 990.128282] ? ksys_write+0x116/0x250
[ 990.133192] vfs_write+0x657/0x9b0
[ 990.137809] ksys_write+0x116/0x250
[ 990.142523] ? __ia32_sys_read+0xc0/0xc0
[ 990.147725] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.153315] ? rcu_is_watching+0x15/0xd0
[ 990.158509] do_syscall_64+0xf3/0x650
[ 990.163418] ? irq_exit_rcu+0x1a/0x30
[ 990.168326] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.174786] RIP: 0033:0x7f84d56df22e
[ 990.179595] RSP: 002b:00007fffee7602e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.188892] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f84d56df22e
[ 990.197707] RDX: 0000000000000001 RSI: 000055dbcae7c6b0 RDI: 0000000000000007
[ 990.206517] RBP: 00007fffee7602f0 R08: 0000000000000000 R09: 0000000000000000
[ 990.215326] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f84d5557390
[ 990.224134] R13: 000055dbcae7c6b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.232940]
[ 990.236203] \x0aShowing all locks held in the system:
[ 990.244742] 1 lock held by khungtaskd/184:
[ 990.250134] #0: ffffffffb78fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.261619] 4 locks held by python3/3807:
[ 990.266915] #0: ff1100012f2e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.276807] #1: ff1100013fcd8280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.287769] #2: ff11000121d40b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.298923] #3: ff11000121dc9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.309023] 4 locks held by python3/5837:
[ 990.314310] #0: ff1100012f2e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.324206] #1: ff11000167562680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.335187] #2: ff11000121d40b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.346348] #3: ff11000121dc9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.356437]
[ 990.358904] =============================================\x0a
[ 1112.565629] INFO: task python3:5837 blocked for more than 245 seconds.
[ 1112.574302] Not tainted 7.1.0-rc5-kiyo-g9104697d8848 #1
[ 1112.581554] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.591143] task:python3 state:D stack:25672 pid:5837 tgid:5837 ppid:5836 task_flags:0x400100 flags:0x00080000
[ 1112.604341] Call Trace:
[ 1112.607877]
[ 1112.611027] __schedule+0xcc3/0x19c0
[ 1112.615843] ? io_schedule_timeout+0x140/0x140
[ 1112.621626] ? find_held_lock+0x2b/0x80
[ 1112.626723] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.632607] schedule+0xd8/0x260
[ 1112.637025] schedule_preempt_disabled+0x18/0x30
[ 1112.643003] __mutex_lock+0x6af/0x2010
[ 1112.648006] ? threaded_store+0x132/0x220
[ 1112.653306] ? ww_mutex_lock+0x160/0x160
[ 1112.658505] ? selinux_inode_free_security+0x330/0x330
[ 1112.665076] ? cap_capable+0x1d6/0x3e0
[ 1112.670178] ? threaded_store+0x132/0x220
[ 1112.675477] threaded_store+0x132/0x220
[ 1112.680578] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.685875] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.691172] ? sysfs_kf_write+0x65/0x160
[ 1112.696370] ? sysfs_file_ops+0x140/0x140
[ 1112.701665] kernfs_fop_write_iter+0x335/0x510
[ 1112.707447] ? kernfs_ops+0xf0/0xf0
[ 1112.712158] new_sync_write+0x333/0x750
[ 1112.717262] ? __lock_acquire+0x508/0xc10
[ 1112.722557] ? new_sync_read+0x740/0x740
[ 1112.727757] ? lock_acquire.part.0+0xbc/0x260
[ 1112.733433] ? ksys_write+0x116/0x250
[ 1112.738342] vfs_write+0x657/0x9b0
[ 1112.742955] ksys_write+0x116/0x250
[ 1112.747668] ? __ia32_sys_read+0xc0/0xc0
[ 1112.752856] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.758447] ? rcu_is_watching+0x15/0xd0
[ 1112.763647] do_syscall_64+0xf3/0x650
[ 1112.768552] ? trace_hardirqs_off+0xd/0x30
[ 1112.773944] ? exc_page_fault+0xda/0xf0
[ 1112.779047] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.785512] RIP: 0033:0x7f4b9462b22e
[ 1112.790319] RSP: 002b:00007ffe0edac3d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.799616] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4b9462b22e
[ 1112.808416] RDX: 0000000000000001 RSI: 0000564be28966b0 RDI: 0000000000000007
[ 1112.817222] RBP: 00007ffe0edac3e0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.826032] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4b944a3390
[ 1112.834840] R13: 0000564be28966b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.843654]
[ 1112.846956] INFO: task python3:5837 is blocked on a mutex likely owned by task python3:3807.
[ 1112.857227] task:python3 state:D stack:25672 pid:3807 tgid:3807 ppid:3806 task_flags:0x400100 flags:0x00080802
[ 1112.870430] Call Trace:
[ 1112.873969]
[ 1112.877118] __schedule+0xcc3/0x19c0
[ 1112.881930] ? io_schedule_timeout+0x140/0x140
[ 1112.887714] ? find_held_lock+0x2b/0x80
[ 1112.892814] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.898991] schedule+0xd8/0x260
[ 1112.903409] schedule_timeout+0x13f/0x290
[ 1112.908704] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.915075] ? trace_contention_end+0xb3/0x1a0
[ 1112.920847] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.926534] ? ww_mutex_lock+0x160/0x160
[ 1112.931732] msleep+0x1b/0x30
[ 1112.935857] napi_set_threaded+0x3a5/0x440
[ 1112.941252] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.946745] netif_set_threaded+0x257/0x400
[ 1112.952240] threaded_store+0x1b8/0x220
[ 1112.957340] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.962637] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.967932] ? sysfs_kf_write+0x65/0x160
[ 1112.973132] ? sysfs_file_ops+0x140/0x140
[ 1112.978428] kernfs_fop_write_iter+0x335/0x510
[ 1112.984210] ? kernfs_ops+0xf0/0xf0
[ 1112.988922] new_sync_write+0x333/0x750
[ 1112.994024] ? __lock_acquire+0x508/0xc10
[ 1112.999318] ? new_sync_read+0x740/0x740
[ 1113.004519] ? lock_acquire.part.0+0xbc/0x260
[ 1113.010206] ? ksys_write+0x116/0x250
[ 1113.015106] vfs_write+0x657/0x9b0
[ 1113.019720] ksys_write+0x116/0x250
[ 1113.024428] ? __ia32_sys_read+0xc0/0xc0
[ 1113.029626] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.035215] ? rcu_is_watching+0x15/0xd0
[ 1113.040413] do_syscall_64+0xf3/0x650
[ 1113.045317] ? irq_exit_rcu+0x1a/0x30
[ 1113.050223] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.056688] RIP: 0033:0x7f84d56df22e
[ 1113.061493] RSP: 002b:00007fffee7602e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.070791] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f84d56df22e
[ 1113.079596] RDX: 0000000000000001 RSI: 000055dbcae7c6b0 RDI: 0000000000000007
[ 1113.088403] RBP: 00007fffee7602f0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.097209] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f84d5557390
[ 1113.106014] R13: 000055dbcae7c6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.114824]
[ 1113.118087] \x0aShowing all locks held in the system:
[ 1113.126623] 1 lock held by khungtaskd/184:
[ 1113.132016] #0: ffffffffb78fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.143490] 2 locks held by systemd-journal/801:
[ 1113.149482] 4 locks held by python3/3807:
[ 1113.154777] #0: ff1100012f2e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.164665] #1: ff1100013fcd8280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.175624] #2: ff11000121d40b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.186780] #3: ff11000121dc9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.196879] 4 locks held by python3/5837:
[ 1113.202170] #0: ff1100012f2e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.212056] #1: ff11000167562680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.223019] #2: ff11000121d40b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.234176] #3: ff11000121dc9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.244254]
[ 1113.246746] =============================================\x0a
[ 1235.446925] INFO: task python3:5837 blocked for more than 368 seconds.
[ 1235.455077] Not tainted 7.1.0-rc5-kiyo-g9104697d8848 #1
[ 1235.462328] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.471916] task:python3 state:D stack:25672 pid:5837 tgid:5837 ppid:5836 task_flags:0x400100 flags:0x00080002
[ 1235.485124] Call Trace:
[ 1235.488665]
[ 1235.491818] __schedule+0xcc3/0x19c0
[ 1235.496636] ? io_schedule_timeout+0x140/0x140
[ 1235.502422] ? find_held_lock+0x2b/0x80
[ 1235.507530] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.513415] schedule+0xd8/0x260
[ 1235.517833] schedule_preempt_disabled+0x18/0x30
[ 1235.523811] __mutex_lock+0x6af/0x2010
[ 1235.528816] ? threaded_store+0x132/0x220
[ 1235.534114] ? ww_mutex_lock+0x160/0x160
[ 1235.539314] ? selinux_inode_free_security+0x330/0x330
[ 1235.545884] ? cap_capable+0x1d6/0x3e0
[ 1235.550893] ? threaded_store+0x132/0x220
[ 1235.556194] threaded_store+0x132/0x220
[ 1235.561296] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.566594] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.571892] ? sysfs_kf_write+0x65/0x160
[ 1235.577094] ? sysfs_file_ops+0x140/0x140
[ 1235.582391] kernfs_fop_write_iter+0x335/0x510
[ 1235.588178] ? kernfs_ops+0xf0/0xf0
[ 1235.592889] new_sync_write+0x333/0x750
[ 1235.597985] ? __lock_acquire+0x508/0xc10
[ 1235.603282] ? new_sync_read+0x740/0x740
[ 1235.608483] ? lock_acquire.part.0+0xbc/0x260
[ 1235.614170] ? ksys_write+0x116/0x250
[ 1235.619079] vfs_write+0x657/0x9b0
[ 1235.623696] ksys_write+0x116/0x250
[ 1235.628409] ? __ia32_sys_read+0xc0/0xc0
[ 1235.633610] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.639200] ? rcu_is_watching+0x15/0xd0
[ 1235.644401] do_syscall_64+0xf3/0x650
[ 1235.649309] ? trace_hardirqs_off+0xd/0x30
[ 1235.654705] ? exc_page_fault+0xda/0xf0
[ 1235.659809] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.666279] RIP: 0033:0x7f4b9462b22e
[ 1235.671089] RSP: 002b:00007ffe0edac3d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.680378] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4b9462b22e
[ 1235.689187] RDX: 0000000000000001 RSI: 0000564be28966b0 RDI: 0000000000000007
[ 1235.697996] RBP: 00007ffe0edac3e0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.706807] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4b944a3390
[ 1235.715618] R13: 0000564be28966b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.724433]
[ 1235.727720] INFO: task python3:5837 is blocked on a mutex likely owned by task python3:3807.
[ 1235.737991] task:python3 state:D stack:25672 pid:3807 tgid:3807 ppid:3806 task_flags:0x400100 flags:0x00080802
[ 1235.751194] Call Trace:
[ 1235.754732]
[ 1235.757885] __schedule+0xcc3/0x19c0
[ 1235.762696] ? io_schedule_timeout+0x140/0x140
[ 1235.768481] ? find_held_lock+0x2b/0x80
[ 1235.773586] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.779763] schedule+0xd8/0x260
[ 1235.784181] schedule_timeout+0x13f/0x290
[ 1235.789478] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.795848] ? trace_contention_end+0xb3/0x1a0
[ 1235.801625] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.807316] ? ww_mutex_lock+0x160/0x160
[ 1235.812516] msleep+0x1b/0x30
[ 1235.816642] napi_set_threaded+0x3a5/0x440
[ 1235.822040] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.827537] netif_set_threaded+0x257/0x400
[ 1235.833031] threaded_store+0x1b8/0x220
[ 1235.838137] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.843434] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.848733] ? sysfs_kf_write+0x65/0x160
[ 1235.853934] ? sysfs_file_ops+0x140/0x140
[ 1235.859229] kernfs_fop_write_iter+0x335/0x510
[ 1235.865015] ? kernfs_ops+0xf0/0xf0
[ 1235.869725] new_sync_write+0x333/0x750
[ 1235.874830] ? __lock_acquire+0x508/0xc10
[ 1235.880125] ? new_sync_read+0x740/0x740
[ 1235.885325] ? lock_acquire.part.0+0xbc/0x260
[ 1235.891010] ? ksys_write+0x116/0x250
[ 1235.895920] vfs_write+0x657/0x9b0
[ 1235.900537] ksys_write+0x116/0x250
[ 1235.905251] ? __ia32_sys_read+0xc0/0xc0
[ 1235.910452] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.916042] ? rcu_is_watching+0x15/0xd0
[ 1235.921235] do_syscall_64+0xf3/0x650
[ 1235.926144] ? irq_exit_rcu+0x1a/0x30
[ 1235.931055] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.937523] RIP: 0033:0x7f84d56df22e
[ 1235.942330] RSP: 002b:00007fffee7602e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.951627] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f84d56df22e
[ 1235.960435] RDX: 0000000000000001 RSI: 000055dbcae7c6b0 RDI: 0000000000000007
[ 1235.969244] RBP: 00007fffee7602f0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.978053] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f84d5557390
[ 1235.986862] R13: 000055dbcae7c6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.995675]
[ 1235.998942] \x0aShowing all locks held in the system:
[ 1236.007479] 1 lock held by khungtaskd/184:
[ 1236.012874] #0: ffffffffb78fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.024347] 3 locks held by systemd-journal/801:
[ 1236.030326] #0: ff1100180dbb72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.040213] #1: ffffffffb7b02c20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.053029] #2: ff110001a6808a70 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1236.064591] 4 locks held by python3/3807:
[ 1236.069885] #0: ff1100012f2e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.079774] #1: ff1100013fcd8280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.090739] #2: ff11000121d40b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.101904] #3: ff11000121dc9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.112003] 4 locks held by python3/5837:
[ 1236.117298] #0: ff1100012f2e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.127185] #1: ff11000167562680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.138147] #2: ff11000121d40b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.149296] #3: ff11000121dc9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.159387]
[ 1236.161852] =============================================\x0a
[ 1358.328206] INFO: task python3:5837 blocked for more than 491 seconds.
[ 1358.336354] Not tainted 7.1.0-rc5-kiyo-g9104697d8848 #1
[ 1358.343604] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.353191] task:python3 state:D stack:25672 pid:5837 tgid:5837 ppid:5836 task_flags:0x400100 flags:0x00080002
[ 1358.366395] Call Trace:
[ 1358.369934]
[ 1358.373086] __schedule+0xcc3/0x19c0
[ 1358.377903] ? io_schedule_timeout+0x140/0x140
[ 1358.383688] ? find_held_lock+0x2b/0x80
[ 1358.388794] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.394679] schedule+0xd8/0x260
[ 1358.399094] schedule_preempt_disabled+0x18/0x30
[ 1358.405071] __mutex_lock+0x6af/0x2010
[ 1358.410074] ? threaded_store+0x132/0x220
[ 1358.415364] ? ww_mutex_lock+0x160/0x160
[ 1358.420562] ? selinux_inode_free_security+0x330/0x330
[ 1358.427131] ? cap_capable+0x1d6/0x3e0
[ 1358.432135] ? threaded_store+0x132/0x220
[ 1358.437433] threaded_store+0x132/0x220
[ 1358.442525] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.447822] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.453120] ? sysfs_kf_write+0x65/0x160
[ 1358.458319] ? sysfs_file_ops+0x140/0x140
[ 1358.463611] kernfs_fop_write_iter+0x335/0x510
[ 1358.469395] ? kernfs_ops+0xf0/0xf0
[ 1358.474105] new_sync_write+0x333/0x750
[ 1358.479201] ? __lock_acquire+0x508/0xc10
[ 1358.484496] ? new_sync_read+0x740/0x740
[ 1358.489695] ? lock_acquire.part.0+0xbc/0x260
[ 1358.495381] ? ksys_write+0x116/0x250
[ 1358.500281] vfs_write+0x657/0x9b0
[ 1358.504893] ksys_write+0x116/0x250
[ 1358.509602] ? __ia32_sys_read+0xc0/0xc0
[ 1358.514799] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.520386] ? rcu_is_watching+0x15/0xd0
[ 1358.525588] do_syscall_64+0xf3/0x650
[ 1358.530493] ? trace_hardirqs_off+0xd/0x30
[ 1358.535885] ? exc_page_fault+0xda/0xf0
[ 1358.540988] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.547454] RIP: 0033:0x7f4b9462b22e
[ 1358.552261] RSP: 002b:00007ffe0edac3d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.561560] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4b9462b22e
[ 1358.570366] RDX: 0000000000000001 RSI: 0000564be28966b0 RDI: 0000000000000007
[ 1358.579172] RBP: 00007ffe0edac3e0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.587977] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4b944a3390
[ 1358.596784] R13: 0000564be28966b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.605594]
[ 1358.608879] INFO: task python3:5837 is blocked on a mutex likely owned by task python3:3807.
[ 1358.619152] task:python3 state:D stack:25672 pid:3807 tgid:3807 ppid:3806 task_flags:0x400100 flags:0x00080802
[ 1358.632353] Call Trace:
[ 1358.635893]
[ 1358.639042] __schedule+0xcc3/0x19c0
[ 1358.643851] ? io_schedule_timeout+0x140/0x140
[ 1358.649632] ? find_held_lock+0x2b/0x80
[ 1358.654732] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.660911] schedule+0xd8/0x260
[ 1358.665331] schedule_timeout+0x13f/0x290
[ 1358.670620] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.676981] ? trace_contention_end+0xb3/0x1a0
[ 1358.682756] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.688445] ? ww_mutex_lock+0x160/0x160
[ 1358.693643] msleep+0x1b/0x30
[ 1358.697766] napi_set_threaded+0x3a5/0x440
[ 1358.703162] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.708658] netif_set_threaded+0x257/0x400
[ 1358.714150] threaded_store+0x1b8/0x220
[ 1358.719252] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.724548] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.729844] ? sysfs_kf_write+0x65/0x160
[ 1358.735043] ? sysfs_file_ops+0x140/0x140
[ 1358.740337] kernfs_fop_write_iter+0x335/0x510
[ 1358.746122] ? kernfs_ops+0xf0/0xf0
[ 1358.750831] new_sync_write+0x333/0x750
[ 1358.755931] ? __lock_acquire+0x508/0xc10
[ 1358.761223] ? new_sync_read+0x740/0x740
[ 1358.766422] ? lock_acquire.part.0+0xbc/0x260
[ 1358.772107] ? ksys_write+0x116/0x250
[ 1358.777018] vfs_write+0x657/0x9b0
[ 1358.781632] ksys_write+0x116/0x250
[ 1358.786342] ? __ia32_sys_read+0xc0/0xc0
[ 1358.791542] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.797130] ? rcu_is_watching+0x15/0xd0
[ 1358.802330] do_syscall_64+0xf3/0x650
[ 1358.807229] ? irq_exit_rcu+0x1a/0x30
[ 1358.812136] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.818603] RIP: 0033:0x7f84d56df22e
[ 1358.823409] RSP: 002b:00007fffee7602e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.832704] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f84d56df22e
[ 1358.841510] RDX: 0000000000000001 RSI: 000055dbcae7c6b0 RDI: 0000000000000007
[ 1358.850316] RBP: 00007fffee7602f0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.859123] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f84d5557390
[ 1358.867931] R13: 000055dbcae7c6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.876743]
[ 1358.880012] \x0aShowing all locks held in the system:
[ 1358.888549] 1 lock held by khungtaskd/184:
[ 1358.893939] #0: ffffffffb78fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.905408] 2 locks held by systemd-journal/801:
[ 1358.911385] #0: ff1100180de372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.921270] #1: ffffffffb7b02c20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.934099] 4 locks held by python3/3807:
[ 1358.939392] #0: ff1100012f2e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.949280] #1: ff1100013fcd8280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.960241] #2: ff11000121d40b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.971397] #3: ff11000121dc9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.981480] 4 locks held by python3/5837:
[ 1358.986778] #0: ff1100012f2e43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.996664] #1: ff11000167562680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.007624] #2: ff11000121d40b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.018772] #3: ff11000121dc9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.028861]
[ 1359.031326] =============================================\x0a