====================================== | [ 785.766908] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 785.769867] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py | [ 785.900195] kselftest: Running tests in drivers/net [ 989.668311] INFO: task python3:5736 blocked for more than 122 seconds. [ 989.676544] Not tainted 7.1.0-rc2-rhfv-ge446480fb140 #1 [ 989.683794] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.694008] task:python3 state:D stack:25672 pid:5736 tgid:5736 ppid:5735 task_flags:0x400100 flags:0x00080000 [ 989.707217] Call Trace: [ 989.710758] [ 989.713909] __schedule+0xcba/0x1940 [ 989.718727] ? io_schedule_timeout+0x140/0x140 [ 989.724513] ? find_held_lock+0x2b/0x80 [ 989.729617] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.735505] schedule+0xd4/0x260 [ 989.739922] schedule_preempt_disabled+0x18/0x30 [ 989.745904] __mutex_lock+0x6a3/0x2000 [ 989.750911] ? threaded_store+0x132/0x220 [ 989.756210] ? ww_mutex_lock+0x160/0x160 [ 989.761403] ? selinux_inode_free_security+0x330/0x330 [ 989.767975] ? cap_capable+0x1d6/0x3e0 [ 989.772985] ? threaded_store+0x132/0x220 [ 989.778283] threaded_store+0x132/0x220 [ 989.783379] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.788680] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.793977] ? sysfs_kf_write+0x65/0x160 [ 989.799179] ? sysfs_file_ops+0x140/0x140 [ 989.804474] kernfs_fop_write_iter+0x335/0x510 [ 989.810259] ? kernfs_ops+0xf0/0xf0 [ 989.814971] new_sync_write+0x333/0x750 [ 989.820076] ? __lock_acquire+0x508/0xc10 [ 989.825373] ? new_sync_read+0x740/0x740 [ 989.830575] ? lock_acquire.part.0+0xbc/0x260 [ 989.836264] ? ksys_write+0x116/0x250 [ 989.841173] vfs_write+0x657/0x9b0 [ 989.845788] ksys_write+0x116/0x250 [ 989.850492] ? __ia32_sys_read+0xc0/0xc0 [ 989.855692] ? rcu_is_watching+0x15/0xd0 [ 989.860890] ? rcu_is_watching+0x15/0xd0 [ 989.866091] do_syscall_64+0xf3/0x650 [ 989.870998] ? irq_exit_rcu+0x1a/0x30 [ 989.875898] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.882365] RIP: 0033:0x7fd654dd622e [ 989.887166] RSP: 002b:00007ffd8bf43990 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.896469] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd654dd622e [ 989.905276] RDX: 0000000000000001 RSI: 0000564a90f1afe0 RDI: 0000000000000007 [ 989.914082] RBP: 00007ffd8bf439a0 R08: 0000000000000000 R09: 0000000000000000 [ 989.922892] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd654c4e390 [ 989.931703] R13: 0000564a90f1afe0 R14: 0000000000000007 R15: 0000000000000003 | [ 990.361408] #2: ffffffff8c169ce0 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_lock_and_drain_offline+0xa6/0x640 | [ 990.373052] #3: ffffffff8bf68970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2a3/0x5c0 | [ 990.384599] #4: ffffffff8c169a50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_update_dfl_csses+0x2af/0x5c0 | [ 990.396929] | [ 990.399395] =============================================\x0a [ 1112.549452] INFO: task python3:5736 blocked for more than 245 seconds. [ 1112.557601] Not tainted 7.1.0-rc2-rhfv-ge446480fb140 #1 [ 1112.564852] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.574443] task:python3 state:D stack:25672 pid:5736 tgid:5736 ppid:5735 task_flags:0x400100 flags:0x00080000 [ 1112.587651] Call Trace: [ 1112.591193] [ 1112.594346] __schedule+0xcba/0x1940 [ 1112.599166] ? io_schedule_timeout+0x140/0x140 [ 1112.604952] ? find_held_lock+0x2b/0x80 [ 1112.610058] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.615944] schedule+0xd4/0x260 [ 1112.620364] schedule_preempt_disabled+0x18/0x30 [ 1112.626346] __mutex_lock+0x6a3/0x2000 [ 1112.631350] ? threaded_store+0x132/0x220 [ 1112.636644] ? ww_mutex_lock+0x160/0x160 [ 1112.641844] ? selinux_inode_free_security+0x330/0x330 [ 1112.648413] ? cap_capable+0x1d6/0x3e0 [ 1112.653422] ? threaded_store+0x132/0x220 [ 1112.658718] threaded_store+0x132/0x220 [ 1112.663819] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.669119] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.674421] ? sysfs_kf_write+0x65/0x160 [ 1112.679621] ? sysfs_file_ops+0x140/0x140 [ 1112.684917] kernfs_fop_write_iter+0x335/0x510 [ 1112.690704] ? kernfs_ops+0xf0/0xf0 [ 1112.695414] new_sync_write+0x333/0x750 [ 1112.700518] ? __lock_acquire+0x508/0xc10 [ 1112.705809] ? new_sync_read+0x740/0x740 [ 1112.711011] ? lock_acquire.part.0+0xbc/0x260 [ 1112.716696] ? ksys_write+0x116/0x250 [ 1112.721605] vfs_write+0x657/0x9b0 [ 1112.726222] ksys_write+0x116/0x250 [ 1112.730934] ? __ia32_sys_read+0xc0/0xc0 [ 1112.736136] ? rcu_is_watching+0x15/0xd0 [ 1112.741337] ? rcu_is_watching+0x15/0xd0 [ 1112.746538] do_syscall_64+0xf3/0x650 [ 1112.751446] ? irq_exit_rcu+0x1a/0x30 [ 1112.756354] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.762824] RIP: 0033:0x7fd654dd622e [ 1112.767634] RSP: 002b:00007ffd8bf43990 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.776933] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd654dd622e [ 1112.785742] RDX: 0000000000000001 RSI: 0000564a90f1afe0 RDI: 0000000000000007 [ 1112.794550] RBP: 00007ffd8bf439a0 R08: 0000000000000000 R09: 0000000000000000 [ 1112.803350] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd654c4e390 [ 1112.812161] R13: 0000564a90f1afe0 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.183468] #1: ff110001e85abe80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1113.194432] #2: ff11000111b20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1113.205591] #3: ff11000111b71d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1113.215684] | [ 1113.218151] =============================================\x0a [ 1235.429743] INFO: task python3:5736 blocked for more than 368 seconds. [ 1235.437888] Not tainted 7.1.0-rc2-rhfv-ge446480fb140 #1 [ 1235.445132] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.454724] task:python3 state:D stack:25672 pid:5736 tgid:5736 ppid:5735 task_flags:0x400100 flags:0x00080002 [ 1235.467932] Call Trace: [ 1235.471471] [ 1235.474626] __schedule+0xcba/0x1940 [ 1235.479444] ? io_schedule_timeout+0x140/0x140 [ 1235.485231] ? find_held_lock+0x2b/0x80 [ 1235.490338] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.496226] schedule+0xd4/0x260 [ 1235.500647] schedule_preempt_disabled+0x18/0x30 [ 1235.506625] __mutex_lock+0x6a3/0x2000 [ 1235.511633] ? threaded_store+0x132/0x220 [ 1235.516934] ? ww_mutex_lock+0x160/0x160 [ 1235.522133] ? selinux_inode_free_security+0x330/0x330 [ 1235.528702] ? cap_capable+0x1d6/0x3e0 [ 1235.533714] ? threaded_store+0x132/0x220 [ 1235.539012] threaded_store+0x132/0x220 [ 1235.544113] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.549411] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.554707] ? sysfs_kf_write+0x65/0x160 [ 1235.559908] ? sysfs_file_ops+0x140/0x140 [ 1235.565194] kernfs_fop_write_iter+0x335/0x510 [ 1235.570981] ? kernfs_ops+0xf0/0xf0 [ 1235.575692] new_sync_write+0x333/0x750 [ 1235.580787] ? __lock_acquire+0x508/0xc10 [ 1235.586073] ? new_sync_read+0x740/0x740 [ 1235.591275] ? lock_acquire.part.0+0xbc/0x260 [ 1235.596963] ? ksys_write+0x116/0x250 [ 1235.601872] vfs_write+0x657/0x9b0 [ 1235.606489] ksys_write+0x116/0x250 [ 1235.611200] ? __ia32_sys_read+0xc0/0xc0 [ 1235.616403] ? rcu_is_watching+0x15/0xd0 [ 1235.621603] ? rcu_is_watching+0x15/0xd0 [ 1235.626802] do_syscall_64+0xf3/0x650 [ 1235.631702] ? irq_exit_rcu+0x1a/0x30 [ 1235.636612] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.643079] RIP: 0033:0x7fd654dd622e [ 1235.647955] RSP: 002b:00007ffd8bf43990 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.657320] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd654dd622e [ 1235.666128] RDX: 0000000000000001 RSI: 0000564a90f1afe0 RDI: 0000000000000007 [ 1235.674937] RBP: 00007ffd8bf439a0 R08: 0000000000000000 R09: 0000000000000000 [ 1235.683743] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd654c4e390 [ 1235.692550] R13: 0000564a90f1afe0 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.104123] #1: ff110001e85abe80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.115076] #2: ff11000111b20b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.126231] #3: ff11000111b71d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.136321] | [ 1236.138781] =============================================\x0a [ 1358.311949] INFO: task python3:5736 blocked for more than 491 seconds. [ 1358.320099] Not tainted 7.1.0-rc2-rhfv-ge446480fb140 #1 [ 1358.327350] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.336941] task:python3 state:D stack:25672 pid:5736 tgid:5736 ppid:5735 task_flags:0x400100 flags:0x00080002 [ 1358.350144] Call Trace: [ 1358.353684] [ 1358.356836] __schedule+0xcba/0x1940 [ 1358.361650] ? io_schedule_timeout+0x140/0x140 [ 1358.367436] ? find_held_lock+0x2b/0x80 [ 1358.372542] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.378425] schedule+0xd4/0x260 [ 1358.382835] schedule_preempt_disabled+0x18/0x30 [ 1358.388815] __mutex_lock+0x6a3/0x2000 [ 1358.393811] ? threaded_store+0x132/0x220 [ 1358.399112] ? ww_mutex_lock+0x160/0x160 [ 1358.404311] ? selinux_inode_free_security+0x330/0x330 [ 1358.410880] ? cap_capable+0x1d6/0x3e0 [ 1358.415890] ? threaded_store+0x132/0x220 [ 1358.421187] threaded_store+0x132/0x220 [ 1358.426287] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.431582] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.436881] ? sysfs_kf_write+0x65/0x160 [ 1358.442073] ? sysfs_file_ops+0x140/0x140 [ 1358.447361] kernfs_fop_write_iter+0x335/0x510 [ 1358.453147] ? kernfs_ops+0xf0/0xf0 [ 1358.457857] new_sync_write+0x333/0x750 [ 1358.462962] ? __lock_acquire+0x508/0xc10 [ 1358.468257] ? new_sync_read+0x740/0x740 [ 1358.473459] ? lock_acquire.part.0+0xbc/0x260 [ 1358.479146] ? ksys_write+0x116/0x250 [ 1358.484057] vfs_write+0x657/0x9b0 [ 1358.488670] ksys_write+0x116/0x250 [ 1358.493382] ? __ia32_sys_read+0xc0/0xc0 [ 1358.498578] ? rcu_is_watching+0x15/0xd0 [ 1358.503779] ? rcu_is_watching+0x15/0xd0 [ 1358.508983] do_syscall_64+0xf3/0x650 [ 1358.513888] ? irq_exit_rcu+0x1a/0x30 [ 1358.518796] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.525262] RIP: 0033:0x7fd654dd622e [ 1358.530071] RSP: 002b:00007ffd8bf43990 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.539369] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fd654dd622e [ 1358.548176] RDX: 0000000000000001 RSI: 0000564a90f1afe0 RDI: 0000000000000007 [ 1358.556985] RBP: 00007ffd8bf439a0 R08: 0000000000000000 R09: 0000000000000000 [ 1358.565792] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fd654c4e390 [ 1358.574589] R13: 0000564a90f1afe0 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store