====================================== | [ 788.797452] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 788.799837] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py | [ 788.949099] kselftest: Running tests in drivers/net [ 989.694037] INFO: task python3:5809 blocked for more than 122 seconds. [ 989.702262] Not tainted 7.1.0-rc4-rhie-g7ec97933f2d1 #1 [ 989.710127] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.719715] task:python3 state:D stack:25536 pid:5809 tgid:5809 ppid:5808 task_flags:0x400100 flags:0x00080000 [ 989.732921] Call Trace: [ 989.736458] [ 989.739608] __schedule+0xcc3/0x19c0 [ 989.744425] ? io_schedule_timeout+0x140/0x140 [ 989.750205] ? find_held_lock+0x2b/0x80 [ 989.755311] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.761192] schedule+0xd8/0x260 [ 989.765610] schedule_preempt_disabled+0x18/0x30 [ 989.771588] __mutex_lock+0x6af/0x2010 [ 989.776592] ? threaded_store+0x132/0x220 [ 989.781892] ? ww_mutex_lock+0x160/0x160 [ 989.787080] ? selinux_inode_free_security+0x330/0x330 [ 989.793647] ? cap_capable+0x1d6/0x3e0 [ 989.798652] ? threaded_store+0x132/0x220 [ 989.803950] threaded_store+0x132/0x220 [ 989.809043] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.814342] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.819638] ? sysfs_kf_write+0x65/0x160 [ 989.824837] ? sysfs_file_ops+0x140/0x140 [ 989.830133] kernfs_fop_write_iter+0x335/0x510 [ 989.835914] ? kernfs_ops+0xf0/0xf0 [ 989.840625] new_sync_write+0x333/0x750 [ 989.845726] ? __lock_acquire+0x508/0xc10 [ 989.851020] ? new_sync_read+0x740/0x740 [ 989.856220] ? lock_acquire.part.0+0xbc/0x260 [ 989.861897] ? ksys_write+0x116/0x250 [ 989.866806] vfs_write+0x657/0x9b0 [ 989.871418] ksys_write+0x116/0x250 [ 989.876127] ? __ia32_sys_read+0xc0/0xc0 [ 989.881323] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.886909] ? rcu_is_watching+0x15/0xd0 [ 989.892109] do_syscall_64+0xf3/0x650 [ 989.897012] ? trace_hardirqs_off+0xd/0x30 [ 989.902409] ? exc_page_fault+0xda/0xf0 [ 989.907501] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.913967] RIP: 0033:0x7fc67b05d22e [ 989.918777] RSP: 002b:00007ffd39a890a0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.928064] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc67b05d22e [ 989.936874] RDX: 0000000000000001 RSI: 0000562e8695f6b0 RDI: 0000000000000007 [ 989.945683] RBP: 00007ffd39a890b0 R08: 0000000000000000 R09: 0000000000000000 [ 989.954489] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc67aed5390 [ 989.963297] R13: 0000562e8695f6b0 R14: 0000000000000007 R15: 0000000000000003 | [ 990.356576] #1: ff110001b9ba1480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.367538] #2: ff11000121a86b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.378695] #3: ff11000121ac9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.388776] | [ 990.391242] =============================================\x0a [ 1112.574164] INFO: task python3:5809 blocked for more than 245 seconds. [ 1112.582314] Not tainted 7.1.0-rc4-rhie-g7ec97933f2d1 #1 [ 1112.589566] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.599153] task:python3 state:D stack:25536 pid:5809 tgid:5809 ppid:5808 task_flags:0x400100 flags:0x00080000 [ 1112.612356] Call Trace: [ 1112.615895] [ 1112.619044] __schedule+0xcc3/0x19c0 [ 1112.623857] ? io_schedule_timeout+0x140/0x140 [ 1112.629639] ? find_held_lock+0x2b/0x80 [ 1112.634812] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.640695] schedule+0xd8/0x260 [ 1112.645110] schedule_preempt_disabled+0x18/0x30 [ 1112.651088] __mutex_lock+0x6af/0x2010 [ 1112.656093] ? threaded_store+0x132/0x220 [ 1112.661391] ? ww_mutex_lock+0x160/0x160 [ 1112.666589] ? selinux_inode_free_security+0x330/0x330 [ 1112.673157] ? cap_capable+0x1d6/0x3e0 [ 1112.678164] ? threaded_store+0x132/0x220 [ 1112.683464] threaded_store+0x132/0x220 [ 1112.688565] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.693862] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.699159] ? sysfs_kf_write+0x65/0x160 [ 1112.704361] ? sysfs_file_ops+0x140/0x140 [ 1112.709656] kernfs_fop_write_iter+0x335/0x510 [ 1112.715438] ? kernfs_ops+0xf0/0xf0 [ 1112.720149] new_sync_write+0x333/0x750 [ 1112.725256] ? __lock_acquire+0x508/0xc10 [ 1112.730551] ? new_sync_read+0x740/0x740 [ 1112.735752] ? lock_acquire.part.0+0xbc/0x260 [ 1112.741437] ? ksys_write+0x116/0x250 [ 1112.746345] vfs_write+0x657/0x9b0 [ 1112.750960] ksys_write+0x116/0x250 [ 1112.755670] ? __ia32_sys_read+0xc0/0xc0 [ 1112.760872] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.766463] ? rcu_is_watching+0x15/0xd0 [ 1112.771666] do_syscall_64+0xf3/0x650 [ 1112.776570] ? trace_hardirqs_off+0xd/0x30 [ 1112.781965] ? exc_page_fault+0xda/0xf0 [ 1112.787067] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.793533] RIP: 0033:0x7fc67b05d22e [ 1112.798343] RSP: 002b:00007ffd39a890a0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.807651] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc67b05d22e [ 1112.816462] RDX: 0000000000000001 RSI: 0000562e8695f6b0 RDI: 0000000000000007 [ 1112.825270] RBP: 00007ffd39a890b0 R08: 0000000000000000 R09: 0000000000000000 [ 1112.834083] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc67aed5390 [ 1112.842893] R13: 0000562e8695f6b0 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.319657] #3: ffffffff895686f0 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650 | [ 1113.331305] #4: ffffffff897698d0 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650 | [ 1113.343732] | [ 1113.346200] =============================================\x0a | [ 1174.015684] kworker/u130:2 (349) used greatest stack depth: 21936 bytes left [ 1235.456287] INFO: task python3:5809 blocked for more than 368 seconds. [ 1235.464437] Not tainted 7.1.0-rc4-rhie-g7ec97933f2d1 #1 [ 1235.471690] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.481277] task:python3 state:D stack:25536 pid:5809 tgid:5809 ppid:5808 task_flags:0x400100 flags:0x00080002 [ 1235.494483] Call Trace: [ 1235.498021] [ 1235.501173] __schedule+0xcc3/0x19c0 [ 1235.505987] ? io_schedule_timeout+0x140/0x140 [ 1235.511764] ? find_held_lock+0x2b/0x80 [ 1235.516866] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.522752] schedule+0xd8/0x260 [ 1235.527168] schedule_preempt_disabled+0x18/0x30 [ 1235.533146] __mutex_lock+0x6af/0x2010 [ 1235.538148] ? threaded_store+0x132/0x220 [ 1235.543448] ? ww_mutex_lock+0x160/0x160 [ 1235.548638] ? selinux_inode_free_security+0x330/0x330 [ 1235.555207] ? cap_capable+0x1d6/0x3e0 [ 1235.560219] ? threaded_store+0x132/0x220 [ 1235.565514] threaded_store+0x132/0x220 [ 1235.570615] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.575908] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.581206] ? sysfs_kf_write+0x65/0x160 [ 1235.586403] ? sysfs_file_ops+0x140/0x140 [ 1235.591696] kernfs_fop_write_iter+0x335/0x510 [ 1235.597478] ? kernfs_ops+0xf0/0xf0 [ 1235.602190] new_sync_write+0x333/0x750 [ 1235.607291] ? __lock_acquire+0x508/0xc10 [ 1235.612586] ? new_sync_read+0x740/0x740 [ 1235.617788] ? lock_acquire.part.0+0xbc/0x260 [ 1235.623471] ? ksys_write+0x116/0x250 [ 1235.628381] vfs_write+0x657/0x9b0 [ 1235.632994] ksys_write+0x116/0x250 [ 1235.637707] ? __ia32_sys_read+0xc0/0xc0 [ 1235.642896] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.648482] ? rcu_is_watching+0x15/0xd0 [ 1235.653684] do_syscall_64+0xf3/0x650 [ 1235.658579] ? trace_hardirqs_off+0xd/0x30 [ 1235.663971] ? exc_page_fault+0xda/0xf0 [ 1235.669072] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.675539] RIP: 0033:0x7fc67b05d22e [ 1235.680347] RSP: 002b:00007ffd39a890a0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.689645] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc67b05d22e [ 1235.698453] RDX: 0000000000000001 RSI: 0000562e8695f6b0 RDI: 0000000000000007 [ 1235.707260] RBP: 00007ffd39a890b0 R08: 0000000000000000 R09: 0000000000000000 [ 1235.716067] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc67aed5390 [ 1235.724875] R13: 0000562e8695f6b0 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.091451] #1: ff110001b9ba1480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.102405] #2: ff11000121a86b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.113561] #3: ff11000121ac9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.123650] | [ 1236.126122] =============================================\x0a [ 1358.337415] INFO: task python3:5809 blocked for more than 491 seconds. [ 1358.345566] Not tainted 7.1.0-rc4-rhie-g7ec97933f2d1 #1 [ 1358.352817] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.362411] task:python3 state:D stack:25536 pid:5809 tgid:5809 ppid:5808 task_flags:0x400100 flags:0x00080002 [ 1358.375618] Call Trace: [ 1358.379157] [ 1358.382310] __schedule+0xcc3/0x19c0 [ 1358.387126] ? io_schedule_timeout+0x140/0x140 [ 1358.392912] ? find_held_lock+0x2b/0x80 [ 1358.398018] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.403903] schedule+0xd8/0x260 [ 1358.408324] schedule_preempt_disabled+0x18/0x30 [ 1358.414306] __mutex_lock+0x6af/0x2010 [ 1358.419309] ? threaded_store+0x132/0x220 [ 1358.424610] ? ww_mutex_lock+0x160/0x160 [ 1358.429808] ? selinux_inode_free_security+0x330/0x330 [ 1358.436368] ? cap_capable+0x1d6/0x3e0 [ 1358.441377] ? threaded_store+0x132/0x220 [ 1358.446674] threaded_store+0x132/0x220 [ 1358.451779] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.457078] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.462377] ? sysfs_kf_write+0x65/0x160 [ 1358.467577] ? sysfs_file_ops+0x140/0x140 [ 1358.472874] kernfs_fop_write_iter+0x335/0x510 [ 1358.478653] ? kernfs_ops+0xf0/0xf0 [ 1358.483366] new_sync_write+0x333/0x750 [ 1358.488471] ? __lock_acquire+0x508/0xc10 [ 1358.493770] ? new_sync_read+0x740/0x740 [ 1358.498972] ? lock_acquire.part.0+0xbc/0x260 [ 1358.504657] ? ksys_write+0x116/0x250 [ 1358.509569] vfs_write+0x657/0x9b0 [ 1358.514185] ksys_write+0x116/0x250 [ 1358.518897] ? __ia32_sys_read+0xc0/0xc0 [ 1358.524091] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.529680] ? rcu_is_watching+0x15/0xd0 [ 1358.534884] do_syscall_64+0xf3/0x650 [ 1358.539792] ? trace_hardirqs_off+0xd/0x30 [ 1358.545188] ? exc_page_fault+0xda/0xf0 [ 1358.550284] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.556752] RIP: 0033:0x7fc67b05d22e [ 1358.561563] RSP: 002b:00007ffd39a890a0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.570864] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fc67b05d22e [ 1358.579675] RDX: 0000000000000001 RSI: 0000562e8695f6b0 RDI: 0000000000000007 [ 1358.588483] RBP: 00007ffd39a890b0 R08: 0000000000000000 R09: 0000000000000000 [ 1358.597286] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fc67aed5390 [ 1358.606097] R13: 0000562e8695f6b0 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store