====================================== | [ 781.626392] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 781.628750] nipa-hw-worker: [5/44] Retrying drivers/net:napi_threaded.py | [ 781.782831] kselftest: Running tests in drivers/net | [ 846.289833] kworker/u130:1 (325) used greatest stack depth: 21456 bytes left [ 989.652265] INFO: task python3:5674 blocked for more than 122 seconds. [ 989.660477] Not tainted 7.1.0-rc1-cabx-gaaafcc9812ea #1 [ 989.668169] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.677760] task:python3 state:D stack:25672 pid:5674 tgid:5674 ppid:5673 task_flags:0x400100 flags:0x00080000 [ 989.690964] Call Trace: [ 989.694501] [ 989.697652] __schedule+0xcba/0x1940 [ 989.702468] ? io_schedule_timeout+0x140/0x140 [ 989.708251] ? find_held_lock+0x2b/0x80 [ 989.713348] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.719230] schedule+0xd4/0x260 [ 989.723649] schedule_preempt_disabled+0x18/0x30 [ 989.729627] __mutex_lock+0x6a3/0x2000 [ 989.734632] ? threaded_store+0x132/0x220 [ 989.739931] ? ww_mutex_lock+0x160/0x160 [ 989.745127] ? selinux_inode_free_security+0x330/0x330 [ 989.751693] ? cap_capable+0x1d6/0x3e0 [ 989.756700] ? threaded_store+0x132/0x220 [ 989.761985] threaded_store+0x132/0x220 [ 989.767084] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.772383] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.777681] ? sysfs_kf_write+0x65/0x160 [ 989.782878] ? sysfs_file_ops+0x140/0x140 [ 989.788172] kernfs_fop_write_iter+0x335/0x510 [ 989.793958] ? kernfs_ops+0xf0/0xf0 [ 989.798667] new_sync_write+0x333/0x750 [ 989.803769] ? __lock_acquire+0x508/0xc10 [ 989.809064] ? new_sync_read+0x740/0x740 [ 989.814264] ? lock_acquire.part.0+0xbc/0x260 [ 989.819949] ? ksys_write+0x116/0x250 [ 989.824857] vfs_write+0x657/0x9b0 [ 989.829472] ksys_write+0x116/0x250 [ 989.834175] ? __ia32_sys_read+0xc0/0xc0 [ 989.839372] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.844959] ? rcu_is_watching+0x15/0xd0 [ 989.850157] do_syscall_64+0xf3/0x650 [ 989.855059] ? trace_hardirqs_off+0xd/0x30 [ 989.860454] ? exc_page_fault+0xda/0xf0 [ 989.865556] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.872015] RIP: 0033:0x7fdb1cb6822e [ 989.876824] RSP: 002b:00007ffe9cfd9bc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.886119] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdb1cb6822e [ 989.894924] RDX: 0000000000000001 RSI: 000055723bd763d0 RDI: 0000000000000007 [ 989.903731] RBP: 00007ffe9cfd9bd0 R08: 0000000000000000 R09: 0000000000000000 [ 989.912533] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdb1c9e0390 [ 989.921341] R13: 000055723bd763d0 R14: 0000000000000007 R15: 0000000000000003 | [ 990.292524] #1: ff110001e4e20280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.303482] #2: ff11000123ff0b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.314640] #3: ff11000124069d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.324727] | [ 990.327191] =============================================\x0a [ 1112.533528] INFO: task python3:5674 blocked for more than 245 seconds. [ 1112.541678] Not tainted 7.1.0-rc1-cabx-gaaafcc9812ea #1 [ 1112.548929] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.558520] task:python3 state:D stack:25672 pid:5674 tgid:5674 ppid:5673 task_flags:0x400100 flags:0x00080000 [ 1112.571727] Call Trace: [ 1112.575267] [ 1112.578418] __schedule+0xcba/0x1940 [ 1112.583233] ? io_schedule_timeout+0x140/0x140 [ 1112.589018] ? find_held_lock+0x2b/0x80 [ 1112.594123] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.600009] schedule+0xd4/0x260 [ 1112.604428] schedule_preempt_disabled+0x18/0x30 [ 1112.610405] __mutex_lock+0x6a3/0x2000 [ 1112.615408] ? threaded_store+0x132/0x220 [ 1112.620707] ? ww_mutex_lock+0x160/0x160 [ 1112.625896] ? selinux_inode_free_security+0x330/0x330 [ 1112.632467] ? cap_capable+0x1d6/0x3e0 [ 1112.637472] ? threaded_store+0x132/0x220 [ 1112.642769] threaded_store+0x132/0x220 [ 1112.647872] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.653169] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.658459] ? sysfs_kf_write+0x65/0x160 [ 1112.663655] ? sysfs_file_ops+0x140/0x140 [ 1112.668950] kernfs_fop_write_iter+0x335/0x510 [ 1112.674726] ? kernfs_ops+0xf0/0xf0 [ 1112.679438] new_sync_write+0x333/0x750 [ 1112.684539] ? __lock_acquire+0x508/0xc10 [ 1112.689904] ? new_sync_read+0x740/0x740 [ 1112.695103] ? lock_acquire.part.0+0xbc/0x260 [ 1112.700780] ? ksys_write+0x116/0x250 [ 1112.705688] vfs_write+0x657/0x9b0 [ 1112.710304] ksys_write+0x116/0x250 [ 1112.715016] ? __ia32_sys_read+0xc0/0xc0 [ 1112.720212] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.725802] ? rcu_is_watching+0x15/0xd0 [ 1112.731000] do_syscall_64+0xf3/0x650 [ 1112.735904] ? trace_hardirqs_off+0xd/0x30 [ 1112.741298] ? exc_page_fault+0xda/0xf0 [ 1112.746400] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.752856] RIP: 0033:0x7fdb1cb6822e [ 1112.757667] RSP: 002b:00007ffe9cfd9bc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.766957] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdb1cb6822e [ 1112.775766] RDX: 0000000000000001 RSI: 000055723bd763d0 RDI: 0000000000000007 [ 1112.784570] RBP: 00007ffe9cfd9bd0 R08: 0000000000000000 R09: 0000000000000000 [ 1112.793379] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdb1c9e0390 [ 1112.802185] R13: 000055723bd763d0 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.231892] #2: ffffffffa8f69ca0 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_lock_and_drain_offline+0xa6/0x640 | [ 1113.243537] #3: ffffffffa8d68970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2a3/0x5c0 | [ 1113.255075] #4: ffffffffa8f69a10 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2af/0x5c0 | [ 1113.267405] | [ 1113.269871] =============================================\x0a [ 1235.413751] INFO: task python3:5674 blocked for more than 368 seconds. [ 1235.421901] Not tainted 7.1.0-rc1-cabx-gaaafcc9812ea #1 [ 1235.429152] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.438742] task:python3 state:D stack:25672 pid:5674 tgid:5674 ppid:5673 task_flags:0x400100 flags:0x00080002 [ 1235.451947] Call Trace: [ 1235.455486] [ 1235.458638] __schedule+0xcba/0x1940 [ 1235.463452] ? io_schedule_timeout+0x140/0x140 [ 1235.469234] ? find_held_lock+0x2b/0x80 [ 1235.474336] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.480221] schedule+0xd4/0x260 [ 1235.484637] schedule_preempt_disabled+0x18/0x30 [ 1235.490613] __mutex_lock+0x6a3/0x2000 [ 1235.495616] ? threaded_store+0x132/0x220 [ 1235.500914] ? ww_mutex_lock+0x160/0x160 [ 1235.506113] ? selinux_inode_free_security+0x330/0x330 [ 1235.512682] ? cap_capable+0x1d6/0x3e0 [ 1235.517687] ? threaded_store+0x132/0x220 [ 1235.522981] threaded_store+0x132/0x220 [ 1235.528082] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.533376] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.538675] ? sysfs_kf_write+0x65/0x160 [ 1235.543866] ? sysfs_file_ops+0x140/0x140 [ 1235.549160] kernfs_fop_write_iter+0x335/0x510 [ 1235.554945] ? kernfs_ops+0xf0/0xf0 [ 1235.559657] new_sync_write+0x333/0x750 [ 1235.564761] ? __lock_acquire+0x508/0xc10 [ 1235.570057] ? new_sync_read+0x740/0x740 [ 1235.575259] ? lock_acquire.part.0+0xbc/0x260 [ 1235.580945] ? ksys_write+0x116/0x250 [ 1235.585854] vfs_write+0x657/0x9b0 [ 1235.590468] ksys_write+0x116/0x250 [ 1235.595180] ? __ia32_sys_read+0xc0/0xc0 [ 1235.600377] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.605964] ? rcu_is_watching+0x15/0xd0 [ 1235.611164] do_syscall_64+0xf3/0x650 [ 1235.616059] ? trace_hardirqs_off+0xd/0x30 [ 1235.621451] ? exc_page_fault+0xda/0xf0 [ 1235.626553] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.633010] RIP: 0033:0x7fdb1cb6822e [ 1235.637818] RSP: 002b:00007ffe9cfd9bc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.647113] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdb1cb6822e [ 1235.655920] RDX: 0000000000000001 RSI: 000055723bd763d0 RDI: 0000000000000007 [ 1235.664727] RBP: 00007ffe9cfd9bd0 R08: 0000000000000000 R09: 0000000000000000 [ 1235.673533] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdb1c9e0390 [ 1235.682340] R13: 000055723bd763d0 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.053529] #1: ff110001e4e20280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.064490] #2: ff11000123ff0b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.075636] #3: ff11000124069d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.085726] | [ 1236.088193] =============================================\x0a [ 1358.295998] INFO: task python3:5674 blocked for more than 491 seconds. [ 1358.304157] Not tainted 7.1.0-rc1-cabx-gaaafcc9812ea #1 [ 1358.311409] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.320995] task:python3 state:D stack:25672 pid:5674 tgid:5674 ppid:5673 task_flags:0x400100 flags:0x00080002 [ 1358.334202] Call Trace: [ 1358.337742] [ 1358.340889] __schedule+0xcba/0x1940 [ 1358.345697] ? io_schedule_timeout+0x140/0x140 [ 1358.351483] ? find_held_lock+0x2b/0x80 [ 1358.356588] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.362471] schedule+0xd4/0x260 [ 1358.366887] schedule_preempt_disabled+0x18/0x30 [ 1358.372863] __mutex_lock+0x6a3/0x2000 [ 1358.377865] ? threaded_store+0x132/0x220 [ 1358.383163] ? ww_mutex_lock+0x160/0x160 [ 1358.388362] ? selinux_inode_free_security+0x330/0x330 [ 1358.394930] ? cap_capable+0x1d6/0x3e0 [ 1358.399940] ? threaded_store+0x132/0x220 [ 1358.405237] threaded_store+0x132/0x220 [ 1358.410337] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.415635] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.420932] ? sysfs_kf_write+0x65/0x160 [ 1358.426133] ? sysfs_file_ops+0x140/0x140 [ 1358.431428] kernfs_fop_write_iter+0x335/0x510 [ 1358.437211] ? kernfs_ops+0xf0/0xf0 [ 1358.441923] new_sync_write+0x333/0x750 [ 1358.447023] ? __lock_acquire+0x508/0xc10 [ 1358.452318] ? new_sync_read+0x740/0x740 [ 1358.457519] ? lock_acquire.part.0+0xbc/0x260 [ 1358.463207] ? ksys_write+0x116/0x250 [ 1358.468116] vfs_write+0x657/0x9b0 [ 1358.472728] ksys_write+0x116/0x250 [ 1358.477440] ? __ia32_sys_read+0xc0/0xc0 [ 1358.482637] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.488227] ? rcu_is_watching+0x15/0xd0 [ 1358.493427] do_syscall_64+0xf3/0x650 [ 1358.498330] ? trace_hardirqs_off+0xd/0x30 [ 1358.503724] ? exc_page_fault+0xda/0xf0 [ 1358.508827] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.515292] RIP: 0033:0x7fdb1cb6822e [ 1358.520098] RSP: 002b:00007ffe9cfd9bc0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.529398] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fdb1cb6822e [ 1358.538207] RDX: 0000000000000001 RSI: 000055723bd763d0 RDI: 0000000000000007 [ 1358.547013] RBP: 00007ffe9cfd9bd0 R08: 0000000000000000 R09: 0000000000000000 [ 1358.555817] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fdb1c9e0390 [ 1358.564622] R13: 000055723bd763d0 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store