[ 794.681020] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 794.684150] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py
[ 794.811925] kselftest: Running tests in drivers/net
[ 989.662486] INFO: task python3:5885 blocked for more than 122 seconds.
[ 989.670721] Not tainted 7.1.0-rc3-mcrq-gd43ac5d8eace #1
[ 989.678607] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.688196] task:python3 state:D stack:25672 pid:5885 tgid:5885 ppid:5884 task_flags:0x400100 flags:0x00080000
[ 989.701400] Call Trace:
[ 989.704937]
[ 989.708085] __schedule+0xcc3/0x19c0
[ 989.712901] ? io_schedule_timeout+0x140/0x140
[ 989.718683] ? find_held_lock+0x2b/0x80
[ 989.723786] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.729673] schedule+0xd4/0x260
[ 989.734090] schedule_preempt_disabled+0x18/0x30
[ 989.740067] __mutex_lock+0x6a3/0x2000
[ 989.745069] ? threaded_store+0x132/0x220
[ 989.750368] ? ww_mutex_lock+0x160/0x160
[ 989.755563] ? selinux_inode_free_security+0x330/0x330
[ 989.762134] ? cap_capable+0x1d6/0x3e0
[ 989.767139] ? threaded_store+0x132/0x220
[ 989.772434] threaded_store+0x132/0x220
[ 989.777539] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.782835] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.788124] ? sysfs_kf_write+0x65/0x160
[ 989.793322] ? sysfs_file_ops+0x140/0x140
[ 989.798617] kernfs_fop_write_iter+0x335/0x510
[ 989.804402] ? kernfs_ops+0xf0/0xf0
[ 989.809102] new_sync_write+0x333/0x750
[ 989.814203] ? __lock_acquire+0x508/0xc10
[ 989.819501] ? new_sync_read+0x740/0x740
[ 989.824701] ? lock_acquire.part.0+0xbc/0x260
[ 989.830384] ? ksys_write+0x116/0x250
[ 989.835292] vfs_write+0x657/0x9b0
[ 989.839907] ksys_write+0x116/0x250
[ 989.844608] ? __ia32_sys_read+0xc0/0xc0
[ 989.849804] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.855393] ? rcu_is_watching+0x15/0xd0
[ 989.860592] do_syscall_64+0xf3/0x650
[ 989.865499] ? trace_hardirqs_off+0xd/0x30
[ 989.870885] ? exc_page_fault+0xda/0xf0
[ 989.875986] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.882454] RIP: 0033:0x7fa65b9ef22e
[ 989.887263] RSP: 002b:00007fff9f3adf90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.896560] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa65b9ef22e
[ 989.905360] RDX: 0000000000000001 RSI: 000055627ee07cd0 RDI: 0000000000000007
[ 989.914158] RBP: 00007fff9f3adfa0 R08: 0000000000000000 R09: 0000000000000000
[ 989.922965] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa65b867390
[ 989.931773] R13: 000055627ee07cd0 R14: 0000000000000007 R15: 0000000000000003
[ 989.940585]
[ 989.943903] INFO: task python3:5885 is blocked on a mutex likely owned by task python3:3844.
[ 989.954172] task:python3 state:D stack:25672 pid:3844 tgid:3844 ppid:3843 task_flags:0x400100 flags:0x00080802
[ 989.967373] Call Trace:
[ 989.970910]
[ 989.974059] __schedule+0xcc3/0x19c0
[ 989.978870] ? io_schedule_timeout+0x140/0x140
[ 989.984644] ? find_held_lock+0x2b/0x80
[ 989.989746] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.995914] schedule+0xd4/0x260
[ 990.000331] schedule_timeout+0x13f/0x290
[ 990.005627] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.011996] ? trace_contention_end+0xb3/0x1a0
[ 990.017781] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.023463] ? ww_mutex_lock+0x160/0x160
[ 990.028663] msleep+0x1b/0x30
[ 990.032780] napi_set_threaded+0x3a5/0x440
[ 990.038176] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.043667] netif_set_threaded+0x257/0x400
[ 990.049162] threaded_store+0x1b8/0x220
[ 990.054264] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.059562] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.064856] ? sysfs_kf_write+0x65/0x160
[ 990.070055] ? sysfs_file_ops+0x140/0x140
[ 990.075350] kernfs_fop_write_iter+0x335/0x510
[ 990.081133] ? kernfs_ops+0xf0/0xf0
[ 990.085842] new_sync_write+0x333/0x750
[ 990.090944] ? __lock_acquire+0x508/0xc10
[ 990.096238] ? new_sync_read+0x740/0x740
[ 990.101438] ? lock_acquire.part.0+0xbc/0x260
[ 990.107123] ? ksys_write+0x116/0x250
[ 990.112031] vfs_write+0x657/0x9b0
[ 990.116637] ksys_write+0x116/0x250
[ 990.121337] ? __ia32_sys_read+0xc0/0xc0
[ 990.126535] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.132121] ? rcu_is_watching+0x15/0xd0
[ 990.137321] do_syscall_64+0xf3/0x650
[ 990.142216] ? irq_exit_rcu+0x1a/0x30
[ 990.147123] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.153586] RIP: 0033:0x7f4ab98df22e
[ 990.158395] RSP: 002b:00007ffc248eef50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.167692] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ab98df22e
[ 990.176498] RDX: 0000000000000001 RSI: 0000558decd07cd0 RDI: 0000000000000007
[ 990.185304] RBP: 00007ffc248eef60 R08: 0000000000000000 R09: 0000000000000000
[ 990.194109] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4ab9757390
[ 990.202915] R13: 0000558decd07cd0 R14: 0000000000000007 R15: 0000000000000003
[ 990.211725]
[ 990.214981] \x0aShowing all locks held in the system:
[ 990.223519] 1 lock held by khungtaskd/185:
[ 990.228910] #0: ffffffffad2fe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.240383] 2 locks held by systemd-journal/802:
[ 990.246359] #0: ff1100180e8372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.256247] #1: ffffffffad5033a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.269072] 4 locks held by python3/3844:
[ 990.274367] #0: ff1100012ee3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.284257] #1: ff11000178cafa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.295217] #2: ff11000121766b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.306374] #3: ff110001217b9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.316474] 4 locks held by python3/5885:
[ 990.321770] #0: ff1100012ee3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.331660] #1: ff110001e968ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.342619] #2: ff11000121766b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.353772] #3: ff110001217b9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.363859]
[ 990.366324] =============================================\x0a
[ 1112.542536] INFO: task python3:5885 blocked for more than 245 seconds.
[ 1112.550673] Not tainted 7.1.0-rc3-mcrq-gd43ac5d8eace #1
[ 1112.557921] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.567509] task:python3 state:D stack:25672 pid:5885 tgid:5885 ppid:5884 task_flags:0x400100 flags:0x00080000
[ 1112.580712] Call Trace:
[ 1112.584253]
[ 1112.587401] __schedule+0xcc3/0x19c0
[ 1112.592216] ? io_schedule_timeout+0x140/0x140
[ 1112.597993] ? find_held_lock+0x2b/0x80
[ 1112.603097] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.608981] schedule+0xd4/0x260
[ 1112.613397] schedule_preempt_disabled+0x18/0x30
[ 1112.619377] __mutex_lock+0x6a3/0x2000
[ 1112.624381] ? threaded_store+0x132/0x220
[ 1112.629680] ? ww_mutex_lock+0x160/0x160
[ 1112.634879] ? selinux_inode_free_security+0x330/0x330
[ 1112.641450] ? cap_capable+0x1d6/0x3e0
[ 1112.646454] ? threaded_store+0x132/0x220
[ 1112.651748] threaded_store+0x132/0x220
[ 1112.656849] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.662143] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.667443] ? sysfs_kf_write+0x65/0x160
[ 1112.672645] ? sysfs_file_ops+0x140/0x140
[ 1112.677937] kernfs_fop_write_iter+0x335/0x510
[ 1112.683721] ? kernfs_ops+0xf0/0xf0
[ 1112.688432] new_sync_write+0x333/0x750
[ 1112.693537] ? __lock_acquire+0x508/0xc10
[ 1112.698824] ? new_sync_read+0x740/0x740
[ 1112.704023] ? lock_acquire.part.0+0xbc/0x260
[ 1112.709710] ? ksys_write+0x116/0x250
[ 1112.714620] vfs_write+0x657/0x9b0
[ 1112.719233] ksys_write+0x116/0x250
[ 1112.723943] ? __ia32_sys_read+0xc0/0xc0
[ 1112.729140] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.734729] ? rcu_is_watching+0x15/0xd0
[ 1112.739920] do_syscall_64+0xf3/0x650
[ 1112.744825] ? trace_hardirqs_off+0xd/0x30
[ 1112.750217] ? exc_page_fault+0xda/0xf0
[ 1112.755317] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.761784] RIP: 0033:0x7fa65b9ef22e
[ 1112.766591] RSP: 002b:00007fff9f3adf90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.775888] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa65b9ef22e
[ 1112.784694] RDX: 0000000000000001 RSI: 000055627ee07cd0 RDI: 0000000000000007
[ 1112.793500] RBP: 00007fff9f3adfa0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.802307] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa65b867390
[ 1112.811113] R13: 000055627ee07cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.819924]
[ 1112.823209] INFO: task python3:5885 is blocked on a mutex likely owned by task python3:3844.
[ 1112.833481] task:python3 state:D stack:25672 pid:3844 tgid:3844 ppid:3843 task_flags:0x400100 flags:0x00080802
[ 1112.846683] Call Trace:
[ 1112.850219]
[ 1112.853374] __schedule+0xcc3/0x19c0
[ 1112.858183] ? io_schedule_timeout+0x140/0x140
[ 1112.863964] ? find_held_lock+0x2b/0x80
[ 1112.869067] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.875236] schedule+0xd4/0x260
[ 1112.879651] schedule_timeout+0x13f/0x290
[ 1112.884946] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.891314] ? trace_contention_end+0xb3/0x1a0
[ 1112.897100] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.902780] ? ww_mutex_lock+0x160/0x160
[ 1112.907979] msleep+0x1b/0x30
[ 1112.912102] napi_set_threaded+0x3a5/0x440
[ 1112.917497] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.922989] netif_set_threaded+0x257/0x400
[ 1112.928481] threaded_store+0x1b8/0x220
[ 1112.933576] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.938873] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.944166] ? sysfs_kf_write+0x65/0x160
[ 1112.949363] ? sysfs_file_ops+0x140/0x140
[ 1112.954659] kernfs_fop_write_iter+0x335/0x510
[ 1112.960441] ? kernfs_ops+0xf0/0xf0
[ 1112.965152] new_sync_write+0x333/0x750
[ 1112.970252] ? __lock_acquire+0x508/0xc10
[ 1112.975546] ? new_sync_read+0x740/0x740
[ 1112.980746] ? lock_acquire.part.0+0xbc/0x260
[ 1112.986422] ? ksys_write+0x116/0x250
[ 1112.991334] vfs_write+0x657/0x9b0
[ 1112.995950] ksys_write+0x116/0x250
[ 1113.000664] ? __ia32_sys_read+0xc0/0xc0
[ 1113.005861] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.011450] ? rcu_is_watching+0x15/0xd0
[ 1113.016647] do_syscall_64+0xf3/0x650
[ 1113.021554] ? irq_exit_rcu+0x1a/0x30
[ 1113.026462] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.032929] RIP: 0033:0x7f4ab98df22e
[ 1113.037737] RSP: 002b:00007ffc248eef50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.047031] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ab98df22e
[ 1113.055838] RDX: 0000000000000001 RSI: 0000558decd07cd0 RDI: 0000000000000007
[ 1113.064647] RBP: 00007ffc248eef60 R08: 0000000000000000 R09: 0000000000000000
[ 1113.073455] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4ab9757390
[ 1113.082253] R13: 0000558decd07cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.091066]
[ 1113.094327] \x0aShowing all locks held in the system:
[ 1113.102865] 1 lock held by khungtaskd/185:
[ 1113.108255] #0: ffffffffad2fe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.119735] 4 locks held by python3/3844:
[ 1113.125031] #0: ff1100012ee3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.134922] #1: ff11000178cafa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.145883] #2: ff11000121766b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.157039] #3: ff110001217b9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.167133] 4 locks held by python3/5885:
[ 1113.172427] #0: ff1100012ee3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.182314] #1: ff110001e968ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.193274] #2: ff11000121766b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.204430] #3: ff110001217b9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.214521]
[ 1113.216988] =============================================\x0a
[ 1235.423586] INFO: task python3:5885 blocked for more than 368 seconds.
[ 1235.431733] Not tainted 7.1.0-rc3-mcrq-gd43ac5d8eace #1
[ 1235.438984] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.448574] task:python3 state:D stack:25672 pid:5885 tgid:5885 ppid:5884 task_flags:0x400100 flags:0x00080002
[ 1235.461773] Call Trace:
[ 1235.465316]
[ 1235.468457] __schedule+0xcc3/0x19c0
[ 1235.473273] ? io_schedule_timeout+0x140/0x140
[ 1235.479055] ? find_held_lock+0x2b/0x80
[ 1235.484153] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.490038] schedule+0xd4/0x260
[ 1235.494456] schedule_preempt_disabled+0x18/0x30
[ 1235.500437] __mutex_lock+0x6a3/0x2000
[ 1235.505443] ? threaded_store+0x132/0x220
[ 1235.510744] ? ww_mutex_lock+0x160/0x160
[ 1235.515943] ? selinux_inode_free_security+0x330/0x330
[ 1235.522514] ? cap_capable+0x1d6/0x3e0
[ 1235.527521] ? threaded_store+0x132/0x220
[ 1235.532816] threaded_store+0x132/0x220
[ 1235.537920] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.543218] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.548520] ? sysfs_kf_write+0x65/0x160
[ 1235.553719] ? sysfs_file_ops+0x140/0x140
[ 1235.559014] kernfs_fop_write_iter+0x335/0x510
[ 1235.564798] ? kernfs_ops+0xf0/0xf0
[ 1235.569511] new_sync_write+0x333/0x750
[ 1235.574617] ? __lock_acquire+0x508/0xc10
[ 1235.579915] ? new_sync_read+0x740/0x740
[ 1235.585115] ? lock_acquire.part.0+0xbc/0x260
[ 1235.590803] ? ksys_write+0x116/0x250
[ 1235.595713] vfs_write+0x657/0x9b0
[ 1235.600328] ksys_write+0x116/0x250
[ 1235.605039] ? __ia32_sys_read+0xc0/0xc0
[ 1235.610237] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.615826] ? rcu_is_watching+0x15/0xd0
[ 1235.621027] do_syscall_64+0xf3/0x650
[ 1235.625934] ? trace_hardirqs_off+0xd/0x30
[ 1235.631329] ? exc_page_fault+0xda/0xf0
[ 1235.636436] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.642905] RIP: 0033:0x7fa65b9ef22e
[ 1235.647717] RSP: 002b:00007fff9f3adf90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.657018] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa65b9ef22e
[ 1235.665830] RDX: 0000000000000001 RSI: 000055627ee07cd0 RDI: 0000000000000007
[ 1235.674637] RBP: 00007fff9f3adfa0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.683445] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa65b867390
[ 1235.692244] R13: 000055627ee07cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.701051]
[ 1235.704325] INFO: task python3:5885 is blocked on a mutex likely owned by task python3:3844.
[ 1235.714600] task:python3 state:D stack:25672 pid:3844 tgid:3844 ppid:3843 task_flags:0x400100 flags:0x00080802
[ 1235.727802] Call Trace:
[ 1235.731342]
[ 1235.734495] __schedule+0xcc3/0x19c0
[ 1235.739304] ? io_schedule_timeout+0x140/0x140
[ 1235.745090] ? find_held_lock+0x2b/0x80
[ 1235.750197] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.756377] schedule+0xd4/0x260
[ 1235.760796] schedule_timeout+0x13f/0x290
[ 1235.766095] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.772466] ? trace_contention_end+0xb3/0x1a0
[ 1235.778250] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.783943] ? ww_mutex_lock+0x160/0x160
[ 1235.789143] msleep+0x1b/0x30
[ 1235.793270] napi_set_threaded+0x3a5/0x440
[ 1235.798659] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.804153] netif_set_threaded+0x257/0x400
[ 1235.809650] threaded_store+0x1b8/0x220
[ 1235.814751] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.820047] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.825342] ? sysfs_kf_write+0x65/0x160
[ 1235.830544] ? sysfs_file_ops+0x140/0x140
[ 1235.835839] kernfs_fop_write_iter+0x335/0x510
[ 1235.841624] ? kernfs_ops+0xf0/0xf0
[ 1235.846337] new_sync_write+0x333/0x750
[ 1235.851435] ? __lock_acquire+0x508/0xc10
[ 1235.856732] ? new_sync_read+0x740/0x740
[ 1235.861933] ? lock_acquire.part.0+0xbc/0x260
[ 1235.867621] ? ksys_write+0x116/0x250
[ 1235.872531] vfs_write+0x657/0x9b0
[ 1235.877146] ksys_write+0x116/0x250
[ 1235.881860] ? __ia32_sys_read+0xc0/0xc0
[ 1235.887059] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.892646] ? rcu_is_watching+0x15/0xd0
[ 1235.897847] do_syscall_64+0xf3/0x650
[ 1235.902752] ? irq_exit_rcu+0x1a/0x30
[ 1235.907661] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.914119] RIP: 0033:0x7f4ab98df22e
[ 1235.918919] RSP: 002b:00007ffc248eef50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.928217] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ab98df22e
[ 1235.937025] RDX: 0000000000000001 RSI: 0000558decd07cd0 RDI: 0000000000000007
[ 1235.945832] RBP: 00007ffc248eef60 R08: 0000000000000000 R09: 0000000000000000
[ 1235.954631] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4ab9757390
[ 1235.963437] R13: 0000558decd07cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.972249]
[ 1235.975514] \x0aShowing all locks held in the system:
[ 1235.984051] 1 lock held by khungtaskd/185:
[ 1235.989445] #0: ffffffffad2fe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.000916] 2 locks held by systemd-journal/802:
[ 1236.006898] #0: ff1100180e2372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.016787] #1: ffffffffad5033a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.029612] 4 locks held by python3/3844:
[ 1236.034907] #0: ff1100012ee3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.044797] #1: ff11000178cafa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.055759] #2: ff11000121766b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.066916] #3: ff110001217b9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.077011] 4 locks held by python3/5885:
[ 1236.082310] #0: ff1100012ee3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.092202] #1: ff110001e968ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.103161] #2: ff11000121766b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.114317] #3: ff110001217b9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.124408]
[ 1236.126876] =============================================\x0a
[ 1358.305651] INFO: task python3:5885 blocked for more than 491 seconds.
[ 1358.313798] Not tainted 7.1.0-rc3-mcrq-gd43ac5d8eace #1
[ 1358.321040] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.330630] task:python3 state:D stack:25672 pid:5885 tgid:5885 ppid:5884 task_flags:0x400100 flags:0x00080002
[ 1358.343836] Call Trace:
[ 1358.347378]
[ 1358.350528] __schedule+0xcc3/0x19c0
[ 1358.355344] ? io_schedule_timeout+0x140/0x140
[ 1358.361132] ? find_held_lock+0x2b/0x80
[ 1358.366235] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.372121] schedule+0xd4/0x260
[ 1358.376539] schedule_preempt_disabled+0x18/0x30
[ 1358.382516] __mutex_lock+0x6a3/0x2000
[ 1358.387520] ? threaded_store+0x132/0x220
[ 1358.392820] ? ww_mutex_lock+0x160/0x160
[ 1358.398021] ? selinux_inode_free_security+0x330/0x330
[ 1358.404591] ? cap_capable+0x1d6/0x3e0
[ 1358.409598] ? threaded_store+0x132/0x220
[ 1358.414895] threaded_store+0x132/0x220
[ 1358.419997] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.425296] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.430596] ? sysfs_kf_write+0x65/0x160
[ 1358.435801] ? sysfs_file_ops+0x140/0x140
[ 1358.441095] kernfs_fop_write_iter+0x335/0x510
[ 1358.446879] ? kernfs_ops+0xf0/0xf0
[ 1358.451592] new_sync_write+0x333/0x750
[ 1358.456697] ? __lock_acquire+0x508/0xc10
[ 1358.461995] ? new_sync_read+0x740/0x740
[ 1358.467198] ? lock_acquire.part.0+0xbc/0x260
[ 1358.472885] ? ksys_write+0x116/0x250
[ 1358.477796] vfs_write+0x657/0x9b0
[ 1358.482410] ksys_write+0x116/0x250
[ 1358.487124] ? __ia32_sys_read+0xc0/0xc0
[ 1358.492322] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.497913] ? rcu_is_watching+0x15/0xd0
[ 1358.503115] do_syscall_64+0xf3/0x650
[ 1358.508024] ? trace_hardirqs_off+0xd/0x30
[ 1358.513421] ? exc_page_fault+0xda/0xf0
[ 1358.518525] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.524991] RIP: 0033:0x7fa65b9ef22e
[ 1358.529794] RSP: 002b:00007fff9f3adf90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.539094] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa65b9ef22e
[ 1358.547904] RDX: 0000000000000001 RSI: 000055627ee07cd0 RDI: 0000000000000007
[ 1358.556714] RBP: 00007fff9f3adfa0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.565525] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa65b867390
[ 1358.574332] R13: 000055627ee07cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.583146]
[ 1358.586413] INFO: task python3:5885 is blocked on a mutex likely owned by task python3:3844.
[ 1358.596684] task:python3 state:D stack:25672 pid:3844 tgid:3844 ppid:3843 task_flags:0x400100 flags:0x00080802
[ 1358.609889] Call Trace:
[ 1358.613427]
[ 1358.616580] __schedule+0xcc3/0x19c0
[ 1358.621392] ? io_schedule_timeout+0x140/0x140
[ 1358.627178] ? find_held_lock+0x2b/0x80
[ 1358.632283] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.638461] schedule+0xd4/0x260
[ 1358.642880] schedule_timeout+0x13f/0x290
[ 1358.648169] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.654531] ? trace_contention_end+0xb3/0x1a0
[ 1358.660306] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.665995] ? ww_mutex_lock+0x160/0x160
[ 1358.671197] msleep+0x1b/0x30
[ 1358.675324] napi_set_threaded+0x3a5/0x440
[ 1358.680719] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.686213] netif_set_threaded+0x257/0x400
[ 1358.691707] threaded_store+0x1b8/0x220
[ 1358.696811] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.702106] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.707401] ? sysfs_kf_write+0x65/0x160
[ 1358.712603] ? sysfs_file_ops+0x140/0x140
[ 1358.717899] kernfs_fop_write_iter+0x335/0x510
[ 1358.723683] ? kernfs_ops+0xf0/0xf0
[ 1358.728395] new_sync_write+0x333/0x750
[ 1358.733501] ? __lock_acquire+0x508/0xc10
[ 1358.738797] ? new_sync_read+0x740/0x740
[ 1358.743999] ? lock_acquire.part.0+0xbc/0x260
[ 1358.749687] ? ksys_write+0x116/0x250
[ 1358.754588] vfs_write+0x657/0x9b0
[ 1358.759206] ksys_write+0x116/0x250
[ 1358.763921] ? __ia32_sys_read+0xc0/0xc0
[ 1358.769120] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.774707] ? rcu_is_watching+0x15/0xd0
[ 1358.779907] do_syscall_64+0xf3/0x650
[ 1358.784814] ? irq_exit_rcu+0x1a/0x30
[ 1358.789722] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.796188] RIP: 0033:0x7f4ab98df22e
[ 1358.800997] RSP: 002b:00007ffc248eef50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.810286] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4ab98df22e
[ 1358.819092] RDX: 0000000000000001 RSI: 0000558decd07cd0 RDI: 0000000000000007
[ 1358.827899] RBP: 00007ffc248eef60 R08: 0000000000000000 R09: 0000000000000000
[ 1358.836706] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4ab9757390
[ 1358.845512] R13: 0000558decd07cd0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.854324]
[ 1358.857592] \x0aShowing all locks held in the system:
[ 1358.866130] 1 lock held by khungtaskd/185:
[ 1358.871523] #0: ffffffffad2fe060 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.882996] 2 locks held by systemd-journal/802:
[ 1358.888978] #0: ff1100180e2372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1358.898866] #1: ffffffffad5033a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.911695] 4 locks held by python3/3844:
[ 1358.916991] #0: ff1100012ee3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.926881] #1: ff11000178cafa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.937832] #2: ff11000121766b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.948993] #3: ff110001217b9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.959086] 4 locks held by python3/5885:
[ 1358.964383] #0: ff1100012ee3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.974272] #1: ff110001e968ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.985227] #2: ff11000121766b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.996382] #3: ff110001217b9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.006476]
[ 1359.008943] =============================================\x0a