[ 789.633892] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 789.636343] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 789.786974] kselftest: Running tests in drivers/net
[ 989.691876] INFO: task python3:5811 blocked for more than 122 seconds.
[ 989.700114] Not tainted 7.1.0-rc5-tlvk-gc1c90e81b188 #1
[ 989.708049] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.717640] task:python3 state:D stack:25672 pid:5811 tgid:5811 ppid:5810 task_flags:0x400100 flags:0x00080000
[ 989.730846] Call Trace:
[ 989.734385]
[ 989.737535] __schedule+0xcc3/0x19c0
[ 989.742352] ? io_schedule_timeout+0x140/0x140
[ 989.748135] ? find_held_lock+0x2b/0x80
[ 989.753232] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.759119] schedule+0xd8/0x260
[ 989.763537] schedule_preempt_disabled+0x18/0x30
[ 989.769515] __mutex_lock+0x6af/0x2010
[ 989.774520] ? threaded_store+0x132/0x220
[ 989.779821] ? ww_mutex_lock+0x160/0x160
[ 989.785023] ? selinux_inode_free_security+0x330/0x330
[ 989.791593] ? cap_capable+0x1d6/0x3e0
[ 989.796603] ? threaded_store+0x132/0x220
[ 989.801902] threaded_store+0x132/0x220
[ 989.807004] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.812294] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.817597] ? sysfs_kf_write+0x65/0x160
[ 989.822800] ? sysfs_file_ops+0x140/0x140
[ 989.828095] kernfs_fop_write_iter+0x335/0x510
[ 989.833879] ? kernfs_ops+0xf0/0xf0
[ 989.838592] new_sync_write+0x333/0x750
[ 989.843697] ? __lock_acquire+0x508/0xc10
[ 989.848995] ? new_sync_read+0x740/0x740
[ 989.854189] ? lock_acquire.part.0+0xbc/0x260
[ 989.859878] ? ksys_write+0x116/0x250
[ 989.864789] vfs_write+0x657/0x9b0
[ 989.869402] ksys_write+0x116/0x250
[ 989.874116] ? __ia32_sys_read+0xc0/0xc0
[ 989.879316] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.884905] ? rcu_is_watching+0x15/0xd0
[ 989.890098] do_syscall_64+0xf3/0x650
[ 989.895004] ? trace_hardirqs_off+0xd/0x30
[ 989.900398] ? exc_page_fault+0xda/0xf0
[ 989.905502] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.911969] RIP: 0033:0x7fee5ddf522e
[ 989.916772] RSP: 002b:00007ffd0d8a6a10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.926073] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fee5ddf522e
[ 989.934883] RDX: 0000000000000001 RSI: 00005567020736b0 RDI: 0000000000000007
[ 989.943689] RBP: 00007ffd0d8a6a20 R08: 0000000000000000 R09: 0000000000000000
[ 989.952498] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fee5dc6d390
[ 989.961308] R13: 00005567020736b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.970133]
[ 989.973420] INFO: task python3:5811 is blocked on a mutex likely owned by task python3:3749.
[ 989.983694] task:python3 state:D stack:25672 pid:3749 tgid:3749 ppid:3748 task_flags:0x400100 flags:0x00080802
[ 989.996899] Call Trace:
[ 990.000439]
[ 990.003592] __schedule+0xcc3/0x19c0
[ 990.008406] ? io_schedule_timeout+0x140/0x140
[ 990.014191] ? find_held_lock+0x2b/0x80
[ 990.019288] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.025467] schedule+0xd8/0x260
[ 990.029886] schedule_timeout+0x13f/0x290
[ 990.035177] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.041548] ? sysvec_apic_timer_interrupt+0xaa/0xe0
[ 990.047920] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.053610] ? __free_object+0x2ad/0x490
[ 990.058813] msleep+0x1b/0x30
[ 990.062941] napi_set_threaded+0x3a5/0x440
[ 990.068338] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.073834] netif_set_threaded+0x257/0x400
[ 990.079326] threaded_store+0x1b8/0x220
[ 990.084430] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.089729] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.095027] ? sysfs_kf_write+0x65/0x160
[ 990.100221] ? sysfs_file_ops+0x140/0x140
[ 990.105520] kernfs_fop_write_iter+0x335/0x510
[ 990.111303] ? kernfs_ops+0xf0/0xf0
[ 990.116016] new_sync_write+0x333/0x750
[ 990.121120] ? __lock_acquire+0x508/0xc10
[ 990.126408] ? new_sync_read+0x740/0x740
[ 990.131602] ? lock_acquire.part.0+0xbc/0x260
[ 990.137289] ? ksys_write+0x116/0x250
[ 990.142199] vfs_write+0x657/0x9b0
[ 990.146815] ksys_write+0x116/0x250
[ 990.151526] ? __ia32_sys_read+0xc0/0xc0
[ 990.156726] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.162314] ? rcu_is_watching+0x15/0xd0
[ 990.167514] do_syscall_64+0xf3/0x650
[ 990.172409] ? trace_hardirqs_off+0xd/0x30
[ 990.177806] ? exc_page_fault+0xda/0xf0
[ 990.182910] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.189376] RIP: 0033:0x7fb9833a822e
[ 990.194188] RSP: 002b:00007fff2b5f1b10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.203486] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb9833a822e
[ 990.212294] RDX: 0000000000000001 RSI: 0000560f607146b0 RDI: 0000000000000007
[ 990.221091] RBP: 00007fff2b5f1b20 R08: 0000000000000000 R09: 0000000000000000
[ 990.229898] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb983220390
[ 990.238704] R13: 0000560f607146b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.247517]
[ 990.250776] \x0aShowing all locks held in the system:
[ 990.259316] 1 lock held by khungtaskd/184:
[ 990.264716] #0: ffffffffa82fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.276193] 3 locks held by systemd-journal/802:
[ 990.282173] #0: ff1100180db372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.292060] #1: ffffffffa8502c20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.304878] #2: ff110001a5752f40 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.316441] 4 locks held by python3/3749:
[ 990.321738] #0: ff1100012f3d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.331637] #1: ff11000162603280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.342613] #2: ff1100011172cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.353773] #3: ff110001116b1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.363872] 4 locks held by python3/5811:
[ 990.369168] #0: ff1100012f3d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.379059] #1: ff110001e42cac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.390021] #2: ff1100011172cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.401178] #3: ff110001116b1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.411269]
[ 990.413737] =============================================\x0a
[ 1112.572237] INFO: task python3:5811 blocked for more than 245 seconds.
[ 1112.580382] Not tainted 7.1.0-rc5-tlvk-gc1c90e81b188 #1
[ 1112.587633] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.597223] task:python3 state:D stack:25672 pid:5811 tgid:5811 ppid:5810 task_flags:0x400100 flags:0x00080000
[ 1112.610428] Call Trace:
[ 1112.613970]
[ 1112.617116] __schedule+0xcc3/0x19c0
[ 1112.621935] ? io_schedule_timeout+0x140/0x140
[ 1112.627723] ? find_held_lock+0x2b/0x80
[ 1112.632831] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.638717] schedule+0xd8/0x260
[ 1112.643134] schedule_preempt_disabled+0x18/0x30
[ 1112.649113] __mutex_lock+0x6af/0x2010
[ 1112.654117] ? threaded_store+0x132/0x220
[ 1112.659417] ? ww_mutex_lock+0x160/0x160
[ 1112.664617] ? selinux_inode_free_security+0x330/0x330
[ 1112.671187] ? cap_capable+0x1d6/0x3e0
[ 1112.676197] ? threaded_store+0x132/0x220
[ 1112.681496] threaded_store+0x132/0x220
[ 1112.686597] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.691896] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.697197] ? sysfs_kf_write+0x65/0x160
[ 1112.702402] ? sysfs_file_ops+0x140/0x140
[ 1112.707699] kernfs_fop_write_iter+0x335/0x510
[ 1112.713474] ? kernfs_ops+0xf0/0xf0
[ 1112.718186] new_sync_write+0x333/0x750
[ 1112.723293] ? __lock_acquire+0x508/0xc10
[ 1112.728589] ? new_sync_read+0x740/0x740
[ 1112.733791] ? lock_acquire.part.0+0xbc/0x260
[ 1112.739479] ? ksys_write+0x116/0x250
[ 1112.744390] vfs_write+0x657/0x9b0
[ 1112.749009] ksys_write+0x116/0x250
[ 1112.753723] ? __ia32_sys_read+0xc0/0xc0
[ 1112.758922] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.764513] ? rcu_is_watching+0x15/0xd0
[ 1112.769716] do_syscall_64+0xf3/0x650
[ 1112.774621] ? trace_hardirqs_off+0xd/0x30
[ 1112.780017] ? exc_page_fault+0xda/0xf0
[ 1112.785111] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.791578] RIP: 0033:0x7fee5ddf522e
[ 1112.796389] RSP: 002b:00007ffd0d8a6a10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.805689] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fee5ddf522e
[ 1112.814499] RDX: 0000000000000001 RSI: 00005567020736b0 RDI: 0000000000000007
[ 1112.823306] RBP: 00007ffd0d8a6a20 R08: 0000000000000000 R09: 0000000000000000
[ 1112.832114] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fee5dc6d390
[ 1112.840926] R13: 00005567020736b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.849741]
[ 1112.853023] INFO: task python3:5811 is blocked on a mutex likely owned by task python3:3749.
[ 1112.863286] task:python3 state:D stack:25672 pid:3749 tgid:3749 ppid:3748 task_flags:0x400100 flags:0x00080802
[ 1112.876492] Call Trace:
[ 1112.880030]
[ 1112.883183] __schedule+0xcc3/0x19c0
[ 1112.887996] ? io_schedule_timeout+0x140/0x140
[ 1112.893781] ? find_held_lock+0x2b/0x80
[ 1112.898886] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.905071] schedule+0xd8/0x260
[ 1112.909487] schedule_timeout+0x13f/0x290
[ 1112.914784] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.921155] ? sysvec_apic_timer_interrupt+0xaa/0xe0
[ 1112.927527] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.933216] ? __free_object+0x2ad/0x490
[ 1112.938418] msleep+0x1b/0x30
[ 1112.942545] napi_set_threaded+0x3a5/0x440
[ 1112.947941] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.953439] netif_set_threaded+0x257/0x400
[ 1112.958933] threaded_store+0x1b8/0x220
[ 1112.964035] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.969334] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.974630] ? sysfs_kf_write+0x65/0x160
[ 1112.979831] ? sysfs_file_ops+0x140/0x140
[ 1112.985128] kernfs_fop_write_iter+0x335/0x510
[ 1112.990911] ? kernfs_ops+0xf0/0xf0
[ 1112.995622] new_sync_write+0x333/0x750
[ 1113.000726] ? __lock_acquire+0x508/0xc10
[ 1113.006016] ? new_sync_read+0x740/0x740
[ 1113.011218] ? lock_acquire.part.0+0xbc/0x260
[ 1113.016905] ? ksys_write+0x116/0x250
[ 1113.021814] vfs_write+0x657/0x9b0
[ 1113.026432] ksys_write+0x116/0x250
[ 1113.031142] ? __ia32_sys_read+0xc0/0xc0
[ 1113.036341] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.041932] ? rcu_is_watching+0x15/0xd0
[ 1113.047131] do_syscall_64+0xf3/0x650
[ 1113.052036] ? trace_hardirqs_off+0xd/0x30
[ 1113.057430] ? exc_page_fault+0xda/0xf0
[ 1113.062535] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.069003] RIP: 0033:0x7fb9833a822e
[ 1113.073811] RSP: 002b:00007fff2b5f1b10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.083108] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb9833a822e
[ 1113.091906] RDX: 0000000000000001 RSI: 0000560f607146b0 RDI: 0000000000000007
[ 1113.100715] RBP: 00007fff2b5f1b20 R08: 0000000000000000 R09: 0000000000000000
[ 1113.109524] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb983220390
[ 1113.118334] R13: 0000560f607146b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.127149]
[ 1113.130412] \x0aShowing all locks held in the system:
[ 1113.138951] 1 lock held by khungtaskd/184:
[ 1113.144344] #0: ffffffffa82fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.155820] 2 locks held by systemd-journal/802:
[ 1113.161800] #0: ff1100180dab72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1113.171687] #1: ffffffffa8502c20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1113.184506] 4 locks held by python3/3749:
[ 1113.189801] #0: ff1100012f3d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.199691] #1: ff11000162603280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.210655] #2: ff1100011172cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.221816] #3: ff110001116b1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.231910] 4 locks held by python3/5811:
[ 1113.237206] #0: ff1100012f3d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.247095] #1: ff110001e42cac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.258059] #2: ff1100011172cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.269223] #3: ff110001116b1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.279321]
[ 1113.281795] =============================================\x0a
[ 1235.454563] INFO: task python3:5811 blocked for more than 368 seconds.
[ 1235.462709] Not tainted 7.1.0-rc5-tlvk-gc1c90e81b188 #1
[ 1235.469960] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.479547] task:python3 state:D stack:25672 pid:5811 tgid:5811 ppid:5810 task_flags:0x400100 flags:0x00080002
[ 1235.492750] Call Trace:
[ 1235.496289]
[ 1235.499437] __schedule+0xcc3/0x19c0
[ 1235.504250] ? io_schedule_timeout+0x140/0x140
[ 1235.510035] ? find_held_lock+0x2b/0x80
[ 1235.515137] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.521022] schedule+0xd8/0x260
[ 1235.525439] schedule_preempt_disabled+0x18/0x30
[ 1235.531418] __mutex_lock+0x6af/0x2010
[ 1235.536421] ? threaded_store+0x132/0x220
[ 1235.541710] ? ww_mutex_lock+0x160/0x160
[ 1235.546906] ? selinux_inode_free_security+0x330/0x330
[ 1235.553476] ? cap_capable+0x1d6/0x3e0
[ 1235.558486] ? threaded_store+0x132/0x220
[ 1235.563780] threaded_store+0x132/0x220
[ 1235.568881] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.574175] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.579474] ? sysfs_kf_write+0x65/0x160
[ 1235.584673] ? sysfs_file_ops+0x140/0x140
[ 1235.589967] kernfs_fop_write_iter+0x335/0x510
[ 1235.595750] ? kernfs_ops+0xf0/0xf0
[ 1235.600458] new_sync_write+0x333/0x750
[ 1235.605560] ? __lock_acquire+0x508/0xc10
[ 1235.610856] ? new_sync_read+0x740/0x740
[ 1235.616053] ? lock_acquire.part.0+0xbc/0x260
[ 1235.621737] ? ksys_write+0x116/0x250
[ 1235.626647] vfs_write+0x657/0x9b0
[ 1235.631261] ksys_write+0x116/0x250
[ 1235.635971] ? __ia32_sys_read+0xc0/0xc0
[ 1235.641170] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.646757] ? rcu_is_watching+0x15/0xd0
[ 1235.651959] do_syscall_64+0xf3/0x650
[ 1235.656865] ? trace_hardirqs_off+0xd/0x30
[ 1235.662257] ? exc_page_fault+0xda/0xf0
[ 1235.667361] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.673827] RIP: 0033:0x7fee5ddf522e
[ 1235.678626] RSP: 002b:00007ffd0d8a6a10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.687922] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fee5ddf522e
[ 1235.696728] RDX: 0000000000000001 RSI: 00005567020736b0 RDI: 0000000000000007
[ 1235.705533] RBP: 00007ffd0d8a6a20 R08: 0000000000000000 R09: 0000000000000000
[ 1235.714340] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fee5dc6d390
[ 1235.723146] R13: 00005567020736b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.731957]
[ 1235.735242] INFO: task python3:5811 is blocked on a mutex likely owned by task python3:3749.
[ 1235.745515] task:python3 state:D stack:25672 pid:3749 tgid:3749 ppid:3748 task_flags:0x400100 flags:0x00080802
[ 1235.758716] Call Trace:
[ 1235.762255]
[ 1235.765403] __schedule+0xcc3/0x19c0
[ 1235.770218] ? io_schedule_timeout+0x140/0x140
[ 1235.775999] ? find_held_lock+0x2b/0x80
[ 1235.781100] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.787279] schedule+0xd8/0x260
[ 1235.791695] schedule_timeout+0x13f/0x290
[ 1235.796990] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.803357] ? sysvec_apic_timer_interrupt+0xaa/0xe0
[ 1235.809726] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.815417] ? __free_object+0x2ad/0x490
[ 1235.820618] msleep+0x1b/0x30
[ 1235.824743] napi_set_threaded+0x3a5/0x440
[ 1235.830138] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.835630] netif_set_threaded+0x257/0x400
[ 1235.841123] threaded_store+0x1b8/0x220
[ 1235.846224] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.851522] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.856819] ? sysfs_kf_write+0x65/0x160
[ 1235.862016] ? sysfs_file_ops+0x140/0x140
[ 1235.867310] kernfs_fop_write_iter+0x335/0x510
[ 1235.873094] ? kernfs_ops+0xf0/0xf0
[ 1235.877802] new_sync_write+0x333/0x750
[ 1235.882902] ? __lock_acquire+0x508/0xc10
[ 1235.888199] ? new_sync_read+0x740/0x740
[ 1235.893388] ? lock_acquire.part.0+0xbc/0x260
[ 1235.899073] ? ksys_write+0x116/0x250
[ 1235.903985] vfs_write+0x657/0x9b0
[ 1235.908601] ksys_write+0x116/0x250
[ 1235.913312] ? __ia32_sys_read+0xc0/0xc0
[ 1235.918512] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.924101] ? rcu_is_watching+0x15/0xd0
[ 1235.929293] do_syscall_64+0xf3/0x650
[ 1235.934190] ? trace_hardirqs_off+0xd/0x30
[ 1235.939582] ? exc_page_fault+0xda/0xf0
[ 1235.944683] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.951150] RIP: 0033:0x7fb9833a822e
[ 1235.955957] RSP: 002b:00007fff2b5f1b10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.965253] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb9833a822e
[ 1235.974052] RDX: 0000000000000001 RSI: 0000560f607146b0 RDI: 0000000000000007
[ 1235.982859] RBP: 00007fff2b5f1b20 R08: 0000000000000000 R09: 0000000000000000
[ 1235.991658] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb983220390
[ 1236.000455] R13: 0000560f607146b0 R14: 0000000000000007 R15: 0000000000000003
[ 1236.009270]
[ 1236.012531] \x0aShowing all locks held in the system:
[ 1236.021069] 1 lock held by khungtaskd/184:
[ 1236.026459] #0: ffffffffa82fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.037931] 2 locks held by systemd-journal/802:
[ 1236.043910] #0: ff1100180e9b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.053797] #1: ffffffffa8502c20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.066615] 4 locks held by python3/3749:
[ 1236.071908] #0: ff1100012f3d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.081797] #1: ff11000162603280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.092757] #2: ff1100011172cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.103914] #3: ff110001116b1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.114007] 4 locks held by python3/5811:
[ 1236.119303] #0: ff1100012f3d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.129192] #1: ff110001e42cac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.140150] #2: ff1100011172cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.151303] #3: ff110001116b1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.161391]
[ 1236.163855] =============================================\x0a
[ 1358.334927] INFO: task python3:5811 blocked for more than 491 seconds.
[ 1358.343266] Not tainted 7.1.0-rc5-tlvk-gc1c90e81b188 #1
[ 1358.350521] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.360113] task:python3 state:D stack:25672 pid:5811 tgid:5811 ppid:5810 task_flags:0x400100 flags:0x00080002
[ 1358.373321] Call Trace:
[ 1358.376863]
[ 1358.380012] __schedule+0xcc3/0x19c0
[ 1358.384832] ? io_schedule_timeout+0x140/0x140
[ 1358.390614] ? find_held_lock+0x2b/0x80
[ 1358.395721] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.401606] schedule+0xd8/0x260
[ 1358.406023] schedule_preempt_disabled+0x18/0x30
[ 1358.412000] __mutex_lock+0x6af/0x2010
[ 1358.417004] ? threaded_store+0x132/0x220
[ 1358.422302] ? ww_mutex_lock+0x160/0x160
[ 1358.427503] ? selinux_inode_free_security+0x330/0x330
[ 1358.434075] ? cap_capable+0x1d6/0x3e0
[ 1358.439085] ? threaded_store+0x132/0x220
[ 1358.444384] threaded_store+0x132/0x220
[ 1358.449486] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.454784] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.460083] ? sysfs_kf_write+0x65/0x160
[ 1358.465283] ? sysfs_file_ops+0x140/0x140
[ 1358.470571] kernfs_fop_write_iter+0x335/0x510
[ 1358.476358] ? kernfs_ops+0xf0/0xf0
[ 1358.481071] new_sync_write+0x333/0x750
[ 1358.486176] ? __lock_acquire+0x508/0xc10
[ 1358.491474] ? new_sync_read+0x740/0x740
[ 1358.496667] ? lock_acquire.part.0+0xbc/0x260
[ 1358.502354] ? ksys_write+0x116/0x250
[ 1358.507265] vfs_write+0x657/0x9b0
[ 1358.511883] ksys_write+0x116/0x250
[ 1358.516597] ? __ia32_sys_read+0xc0/0xc0
[ 1358.521798] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.527389] ? rcu_is_watching+0x15/0xd0
[ 1358.532590] do_syscall_64+0xf3/0x650
[ 1358.537489] ? trace_hardirqs_off+0xd/0x30
[ 1358.542886] ? exc_page_fault+0xda/0xf0
[ 1358.547990] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.554457] RIP: 0033:0x7fee5ddf522e
[ 1358.559257] RSP: 002b:00007ffd0d8a6a10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.568548] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fee5ddf522e
[ 1358.577358] RDX: 0000000000000001 RSI: 00005567020736b0 RDI: 0000000000000007
[ 1358.586168] RBP: 00007ffd0d8a6a20 R08: 0000000000000000 R09: 0000000000000000
[ 1358.594978] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fee5dc6d390
[ 1358.603788] R13: 00005567020736b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.612605]
[ 1358.615895] INFO: task python3:5811 is blocked on a mutex likely owned by task python3:3749.
[ 1358.626166] task:python3 state:D stack:25672 pid:3749 tgid:3749 ppid:3748 task_flags:0x400100 flags:0x00080802
[ 1358.639370] Call Trace:
[ 1358.642909]
[ 1358.646062] __schedule+0xcc3/0x19c0
[ 1358.650875] ? io_schedule_timeout+0x140/0x140
[ 1358.656660] ? find_held_lock+0x2b/0x80
[ 1358.661764] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.667942] schedule+0xd8/0x260
[ 1358.672361] schedule_timeout+0x13f/0x290
[ 1358.677658] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.684027] ? sysvec_apic_timer_interrupt+0xaa/0xe0
[ 1358.690399] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.696087] ? __free_object+0x2ad/0x490
[ 1358.701291] msleep+0x1b/0x30
[ 1358.705418] napi_set_threaded+0x3a5/0x440
[ 1358.710815] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.716309] netif_set_threaded+0x257/0x400
[ 1358.721804] threaded_store+0x1b8/0x220
[ 1358.726905] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.732204] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.737503] ? sysfs_kf_write+0x65/0x160
[ 1358.742703] ? sysfs_file_ops+0x140/0x140
[ 1358.747991] kernfs_fop_write_iter+0x335/0x510
[ 1358.753778] ? kernfs_ops+0xf0/0xf0
[ 1358.758489] new_sync_write+0x333/0x750
[ 1358.763591] ? __lock_acquire+0x508/0xc10
[ 1358.768886] ? new_sync_read+0x740/0x740
[ 1358.774089] ? lock_acquire.part.0+0xbc/0x260
[ 1358.779775] ? ksys_write+0x116/0x250
[ 1358.784685] vfs_write+0x657/0x9b0
[ 1358.789301] ksys_write+0x116/0x250
[ 1358.794015] ? __ia32_sys_read+0xc0/0xc0
[ 1358.799217] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.804809] ? rcu_is_watching+0x15/0xd0
[ 1358.810007] do_syscall_64+0xf3/0x650
[ 1358.814912] ? trace_hardirqs_off+0xd/0x30
[ 1358.820307] ? exc_page_fault+0xda/0xf0
[ 1358.825401] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.831869] RIP: 0033:0x7fb9833a822e
[ 1358.836678] RSP: 002b:00007fff2b5f1b10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.845975] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fb9833a822e
[ 1358.854786] RDX: 0000000000000001 RSI: 0000560f607146b0 RDI: 0000000000000007
[ 1358.863595] RBP: 00007fff2b5f1b20 R08: 0000000000000000 R09: 0000000000000000
[ 1358.872405] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fb983220390
[ 1358.881212] R13: 0000560f607146b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.890027]
[ 1358.893299] \x0aShowing all locks held in the system:
[ 1358.901837] 1 lock held by khungtaskd/184:
[ 1358.907230] #0: ffffffffa82fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.918711] 4 locks held by python3/3749:
[ 1358.924007] #0: ff1100012f3d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.933898] #1: ff11000162603280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.944860] #2: ff1100011172cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.956008] #3: ff110001116b1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.966104] 4 locks held by python3/5811:
[ 1358.971399] #0: ff1100012f3d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.981291] #1: ff110001e42cac80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.992254] #2: ff1100011172cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.003412] #3: ff110001116b1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.013497]
[ 1359.015965] =============================================\x0a