====================================== | [ 790.404866] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 790.407389] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py | [ 790.558491] kselftest: Running tests in drivers/net | [ 915.946650] kworker/u129:2 (187) used greatest stack depth: 21936 bytes left [ 989.676074] INFO: task python3:5865 blocked for more than 122 seconds. [ 989.684289] Not tainted 7.1.0-rc3-odag-g1991050ad993 #1 [ 989.692188] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.701777] task:python3 state:D stack:25672 pid:5865 tgid:5865 ppid:5864 task_flags:0x400100 flags:0x00080000 [ 989.714983] Call Trace: [ 989.718520] [ 989.721668] __schedule+0xcc3/0x19c0 [ 989.726483] ? io_schedule_timeout+0x140/0x140 [ 989.732265] ? find_held_lock+0x2b/0x80 [ 989.737370] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.743254] schedule+0xd4/0x260 [ 989.747672] schedule_preempt_disabled+0x18/0x30 [ 989.753648] __mutex_lock+0x6a3/0x2000 [ 989.758650] ? threaded_store+0x132/0x220 [ 989.763949] ? ww_mutex_lock+0x160/0x160 [ 989.769145] ? selinux_inode_free_security+0x330/0x330 [ 989.775712] ? cap_capable+0x1d6/0x3e0 [ 989.780721] ? threaded_store+0x132/0x220 [ 989.786018] threaded_store+0x132/0x220 [ 989.791121] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.796418] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.801718] ? sysfs_kf_write+0x65/0x160 [ 989.806914] ? sysfs_file_ops+0x140/0x140 [ 989.812208] kernfs_fop_write_iter+0x335/0x510 [ 989.817992] ? kernfs_ops+0xf0/0xf0 [ 989.822700] new_sync_write+0x333/0x750 [ 989.827805] ? __lock_acquire+0x508/0xc10 [ 989.833093] ? new_sync_read+0x740/0x740 [ 989.838291] ? lock_acquire.part.0+0xbc/0x260 [ 989.843975] ? ksys_write+0x116/0x250 [ 989.848886] vfs_write+0x657/0x9b0 [ 989.853501] ksys_write+0x116/0x250 [ 989.858210] ? __ia32_sys_read+0xc0/0xc0 [ 989.863408] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.868996] ? rcu_is_watching+0x15/0xd0 [ 989.874198] do_syscall_64+0xf3/0x650 [ 989.879105] ? trace_hardirqs_off+0xd/0x30 [ 989.884489] ? exc_page_fault+0xda/0xf0 [ 989.889590] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.896067] RIP: 0033:0x7f254801822e [ 989.900875] RSP: 002b:00007fff28889f90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.910170] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f254801822e [ 989.918977] RDX: 0000000000000001 RSI: 0000558f63da6cd0 RDI: 0000000000000007 [ 989.927783] RBP: 00007fff28889fa0 R08: 0000000000000000 R09: 0000000000000000 [ 989.936591] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2547e90390 [ 989.945391] R13: 0000558f63da6cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 990.357452] #1: ff110001f2315c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.368412] #2: ff11000123686b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.379565] #3: ff11000123661d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.389650] | [ 990.392116] =============================================\x0a [ 1112.556838] INFO: task python3:5865 blocked for more than 245 seconds. [ 1112.564982] Not tainted 7.1.0-rc3-odag-g1991050ad993 #1 [ 1112.572234] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.581821] task:python3 state:D stack:25672 pid:5865 tgid:5865 ppid:5864 task_flags:0x400100 flags:0x00080000 [ 1112.595027] Call Trace: [ 1112.598566] [ 1112.601714] __schedule+0xcc3/0x19c0 [ 1112.606532] ? io_schedule_timeout+0x140/0x140 [ 1112.612317] ? find_held_lock+0x2b/0x80 [ 1112.617425] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.623307] schedule+0xd4/0x260 [ 1112.627722] schedule_preempt_disabled+0x18/0x30 [ 1112.633698] __mutex_lock+0x6a3/0x2000 [ 1112.638700] ? threaded_store+0x132/0x220 [ 1112.643998] ? ww_mutex_lock+0x160/0x160 [ 1112.649197] ? selinux_inode_free_security+0x330/0x330 [ 1112.655765] ? cap_capable+0x1d6/0x3e0 [ 1112.660773] ? threaded_store+0x132/0x220 [ 1112.666067] threaded_store+0x132/0x220 [ 1112.671167] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.676467] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.681766] ? sysfs_kf_write+0x65/0x160 [ 1112.686965] ? sysfs_file_ops+0x140/0x140 [ 1112.692258] kernfs_fop_write_iter+0x335/0x510 [ 1112.698043] ? kernfs_ops+0xf0/0xf0 [ 1112.702745] new_sync_write+0x333/0x750 [ 1112.707846] ? __lock_acquire+0x508/0xc10 [ 1112.713141] ? new_sync_read+0x740/0x740 [ 1112.718339] ? lock_acquire.part.0+0xbc/0x260 [ 1112.724025] ? ksys_write+0x116/0x250 [ 1112.728933] vfs_write+0x657/0x9b0 [ 1112.733546] ksys_write+0x116/0x250 [ 1112.738254] ? __ia32_sys_read+0xc0/0xc0 [ 1112.743451] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.749038] ? rcu_is_watching+0x15/0xd0 [ 1112.754239] do_syscall_64+0xf3/0x650 [ 1112.759143] ? trace_hardirqs_off+0xd/0x30 [ 1112.764539] ? exc_page_fault+0xda/0xf0 [ 1112.769642] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.776107] RIP: 0033:0x7f254801822e [ 1112.780914] RSP: 002b:00007fff28889f90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.790209] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f254801822e [ 1112.799014] RDX: 0000000000000001 RSI: 0000558f63da6cd0 RDI: 0000000000000007 [ 1112.807820] RBP: 00007fff28889fa0 R08: 0000000000000000 R09: 0000000000000000 [ 1112.816625] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2547e90390 [ 1112.825433] R13: 0000558f63da6cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.212969] #1: ff110001f2315c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1113.223930] #2: ff11000123686b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1113.235077] #3: ff11000123661d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1113.245166] | [ 1113.247629] =============================================\x0a [ 1235.436988] INFO: task python3:5865 blocked for more than 368 seconds. [ 1235.445132] Not tainted 7.1.0-rc3-odag-g1991050ad993 #1 [ 1235.452381] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.461972] task:python3 state:D stack:25672 pid:5865 tgid:5865 ppid:5864 task_flags:0x400100 flags:0x00080002 [ 1235.475180] Call Trace: [ 1235.478719] [ 1235.481867] __schedule+0xcc3/0x19c0 [ 1235.486685] ? io_schedule_timeout+0x140/0x140 [ 1235.492469] ? find_held_lock+0x2b/0x80 [ 1235.497571] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.503455] schedule+0xd4/0x260 [ 1235.507861] schedule_preempt_disabled+0x18/0x30 [ 1235.513837] __mutex_lock+0x6a3/0x2000 [ 1235.518841] ? threaded_store+0x132/0x220 [ 1235.524130] ? ww_mutex_lock+0x160/0x160 [ 1235.529326] ? selinux_inode_free_security+0x330/0x330 [ 1235.535895] ? cap_capable+0x1d6/0x3e0 [ 1235.540901] ? threaded_store+0x132/0x220 [ 1235.546199] threaded_store+0x132/0x220 [ 1235.551300] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.556597] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.561893] ? sysfs_kf_write+0x65/0x160 [ 1235.567090] ? sysfs_file_ops+0x140/0x140 [ 1235.572383] kernfs_fop_write_iter+0x335/0x510 [ 1235.578165] ? kernfs_ops+0xf0/0xf0 [ 1235.582877] new_sync_write+0x333/0x750 [ 1235.587978] ? __lock_acquire+0x508/0xc10 [ 1235.593273] ? new_sync_read+0x740/0x740 [ 1235.598474] ? lock_acquire.part.0+0xbc/0x260 [ 1235.604161] ? ksys_write+0x116/0x250 [ 1235.609071] vfs_write+0x657/0x9b0 [ 1235.613684] ksys_write+0x116/0x250 [ 1235.618393] ? __ia32_sys_read+0xc0/0xc0 [ 1235.623591] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.629176] ? rcu_is_watching+0x15/0xd0 [ 1235.634378] do_syscall_64+0xf3/0x650 [ 1235.639282] ? trace_hardirqs_off+0xd/0x30 [ 1235.644674] ? exc_page_fault+0xda/0xf0 [ 1235.649777] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.656243] RIP: 0033:0x7f254801822e [ 1235.661050] RSP: 002b:00007fff28889f90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.670349] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f254801822e [ 1235.679154] RDX: 0000000000000001 RSI: 0000558f63da6cd0 RDI: 0000000000000007 [ 1235.687960] RBP: 00007fff28889fa0 R08: 0000000000000000 R09: 0000000000000000 [ 1235.696766] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2547e90390 [ 1235.705575] R13: 0000558f63da6cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.106045] #1: ff110001f2315c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.117004] #2: ff11000123686b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.128160] #3: ff11000123661d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.138248] | [ 1236.140712] =============================================\x0a [ 1358.319185] INFO: task python3:5865 blocked for more than 491 seconds. [ 1358.327342] Not tainted 7.1.0-rc3-odag-g1991050ad993 #1 [ 1358.334586] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.344175] task:python3 state:D stack:25672 pid:5865 tgid:5865 ppid:5864 task_flags:0x400100 flags:0x00080002 [ 1358.357383] Call Trace: [ 1358.360924] [ 1358.364076] __schedule+0xcc3/0x19c0 [ 1358.368895] ? io_schedule_timeout+0x140/0x140 [ 1358.374681] ? find_held_lock+0x2b/0x80 [ 1358.379788] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.385677] schedule+0xd4/0x260 [ 1358.390095] schedule_preempt_disabled+0x18/0x30 [ 1358.396076] __mutex_lock+0x6a3/0x2000 [ 1358.401083] ? threaded_store+0x132/0x220 [ 1358.406382] ? ww_mutex_lock+0x160/0x160 [ 1358.411582] ? selinux_inode_free_security+0x330/0x330 [ 1358.418151] ? cap_capable+0x1d6/0x3e0 [ 1358.423159] ? threaded_store+0x132/0x220 [ 1358.428456] threaded_store+0x132/0x220 [ 1358.433557] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.438855] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.444156] ? sysfs_kf_write+0x65/0x160 [ 1358.449358] ? sysfs_file_ops+0x140/0x140 [ 1358.454655] kernfs_fop_write_iter+0x335/0x510 [ 1358.460437] ? kernfs_ops+0xf0/0xf0 [ 1358.465148] new_sync_write+0x333/0x750 [ 1358.470243] ? __lock_acquire+0x508/0xc10 [ 1358.475539] ? new_sync_read+0x740/0x740 [ 1358.480741] ? lock_acquire.part.0+0xbc/0x260 [ 1358.486428] ? ksys_write+0x116/0x250 [ 1358.491341] vfs_write+0x657/0x9b0 [ 1358.495958] ksys_write+0x116/0x250 [ 1358.500671] ? __ia32_sys_read+0xc0/0xc0 [ 1358.505864] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.511455] ? rcu_is_watching+0x15/0xd0 [ 1358.516656] do_syscall_64+0xf3/0x650 [ 1358.521564] ? trace_hardirqs_off+0xd/0x30 [ 1358.526960] ? exc_page_fault+0xda/0xf0 [ 1358.532064] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.538531] RIP: 0033:0x7f254801822e [ 1358.543341] RSP: 002b:00007fff28889f90 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.552639] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f254801822e [ 1358.561448] RDX: 0000000000000001 RSI: 0000558f63da6cd0 RDI: 0000000000000007 [ 1358.570257] RBP: 00007fff28889fa0 R08: 0000000000000000 R09: 0000000000000000 [ 1358.579067] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2547e90390 [ 1358.587875] R13: 0000558f63da6cd0 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store