====================================== | [ 790.311180] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 790.314180] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py | [ 790.449618] kselftest: Running tests in drivers/net [ 989.672864] INFO: task python3:5891 blocked for more than 122 seconds. [ 989.681082] Not tainted 7.1.0-rc3-fbrn-g82170046794c #1 [ 989.688334] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.698549] task:python3 state:D stack:25616 pid:5891 tgid:5891 ppid:5888 task_flags:0x400100 flags:0x00080000 [ 989.711758] Call Trace: [ 989.715298] [ 989.718451] __schedule+0xcc3/0x19c0 [ 989.723269] ? io_schedule_timeout+0x140/0x140 [ 989.729054] ? find_held_lock+0x2b/0x80 [ 989.734163] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.740046] schedule+0xd4/0x260 [ 989.744466] schedule_preempt_disabled+0x18/0x30 [ 989.750436] __mutex_lock+0x6a3/0x2000 [ 989.755442] ? threaded_store+0x132/0x220 [ 989.760743] ? ww_mutex_lock+0x160/0x160 [ 989.765942] ? selinux_inode_free_security+0x330/0x330 [ 989.772514] ? cap_capable+0x1d6/0x3e0 [ 989.777522] ? threaded_store+0x132/0x220 [ 989.782817] threaded_store+0x132/0x220 [ 989.787919] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.793219] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.798521] ? sysfs_kf_write+0x65/0x160 [ 989.803721] ? sysfs_file_ops+0x140/0x140 [ 989.809019] kernfs_fop_write_iter+0x335/0x510 [ 989.814806] ? kernfs_ops+0xf0/0xf0 [ 989.819517] new_sync_write+0x333/0x750 [ 989.824611] ? __lock_acquire+0x508/0xc10 [ 989.829911] ? new_sync_read+0x740/0x740 [ 989.835112] ? lock_acquire.part.0+0xbc/0x260 [ 989.840797] ? ksys_write+0x116/0x250 [ 989.845711] vfs_write+0x657/0x9b0 [ 989.850329] ksys_write+0x116/0x250 [ 989.855040] ? __ia32_sys_read+0xc0/0xc0 [ 989.860241] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.865832] ? rcu_is_watching+0x15/0xd0 [ 989.871036] do_syscall_64+0xf3/0x650 [ 989.875943] ? trace_hardirqs_off+0xd/0x30 [ 989.881339] ? exc_page_fault+0xda/0xf0 [ 989.886440] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.892908] RIP: 0033:0x7f05dd7cd22e [ 989.897719] RSP: 002b:00007ffd59b66980 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.907017] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f05dd7cd22e [ 989.915826] RDX: 0000000000000001 RSI: 0000563a85d37cd0 RDI: 0000000000000007 [ 989.924635] RBP: 00007ffd59b66990 R08: 0000000000000000 R09: 0000000000000000 [ 989.933445] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f05dd645390 [ 989.942252] R13: 0000563a85d37cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 990.341739] #1: ff110001f3568880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.352706] #2: ff11000122382b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.363862] #3: ff11000122429d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.373952] | [ 990.376429] =============================================\x0a [ 1112.553063] INFO: task python3:5891 blocked for more than 245 seconds. [ 1112.561204] Not tainted 7.1.0-rc3-fbrn-g82170046794c #1 [ 1112.568456] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.578044] task:python3 state:D stack:25616 pid:5891 tgid:5891 ppid:5888 task_flags:0x400100 flags:0x00080000 [ 1112.591249] Call Trace: [ 1112.594791] [ 1112.597940] __schedule+0xcc3/0x19c0 [ 1112.602755] ? io_schedule_timeout+0x140/0x140 [ 1112.608543] ? find_held_lock+0x2b/0x80 [ 1112.613646] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.619532] schedule+0xd4/0x260 [ 1112.623950] schedule_preempt_disabled+0x18/0x30 [ 1112.629928] __mutex_lock+0x6a3/0x2000 [ 1112.634931] ? threaded_store+0x132/0x220 [ 1112.640230] ? ww_mutex_lock+0x160/0x160 [ 1112.645431] ? selinux_inode_free_security+0x330/0x330 [ 1112.652002] ? cap_capable+0x1d6/0x3e0 [ 1112.657008] ? threaded_store+0x132/0x220 [ 1112.662308] threaded_store+0x132/0x220 [ 1112.667412] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.672711] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.678008] ? sysfs_kf_write+0x65/0x160 [ 1112.683210] ? sysfs_file_ops+0x140/0x140 [ 1112.688509] kernfs_fop_write_iter+0x335/0x510 [ 1112.694292] ? kernfs_ops+0xf0/0xf0 [ 1112.699005] new_sync_write+0x333/0x750 [ 1112.704111] ? __lock_acquire+0x508/0xc10 [ 1112.709408] ? new_sync_read+0x740/0x740 [ 1112.714611] ? lock_acquire.part.0+0xbc/0x260 [ 1112.720298] ? ksys_write+0x116/0x250 [ 1112.725208] vfs_write+0x657/0x9b0 [ 1112.729826] ksys_write+0x116/0x250 [ 1112.734540] ? __ia32_sys_read+0xc0/0xc0 [ 1112.739738] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.745325] ? rcu_is_watching+0x15/0xd0 [ 1112.750527] do_syscall_64+0xf3/0x650 [ 1112.755432] ? trace_hardirqs_off+0xd/0x30 [ 1112.760828] ? exc_page_fault+0xda/0xf0 [ 1112.765922] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.772389] RIP: 0033:0x7f05dd7cd22e [ 1112.777200] RSP: 002b:00007ffd59b66980 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.786500] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f05dd7cd22e [ 1112.795310] RDX: 0000000000000001 RSI: 0000563a85d37cd0 RDI: 0000000000000007 [ 1112.804120] RBP: 00007ffd59b66990 R08: 0000000000000000 R09: 0000000000000000 [ 1112.812927] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f05dd645390 [ 1112.821735] R13: 0000563a85d37cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.221745] #1: ff110001f3568880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1113.232707] #2: ff11000122382b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1113.243864] #3: ff11000122429d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1113.253955] | [ 1113.256937] =============================================\x0a [ 1235.435228] INFO: task python3:5891 blocked for more than 368 seconds. [ 1235.443366] Not tainted 7.1.0-rc3-fbrn-g82170046794c #1 [ 1235.450617] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.460205] task:python3 state:D stack:25616 pid:5891 tgid:5891 ppid:5888 task_flags:0x400100 flags:0x00080002 [ 1235.473410] Call Trace: [ 1235.476949] [ 1235.480097] __schedule+0xcc3/0x19c0 [ 1235.484911] ? io_schedule_timeout+0x140/0x140 [ 1235.490694] ? find_held_lock+0x2b/0x80 [ 1235.495796] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.501682] schedule+0xd4/0x260 [ 1235.506098] schedule_preempt_disabled+0x18/0x30 [ 1235.512075] __mutex_lock+0x6a3/0x2000 [ 1235.517078] ? threaded_store+0x132/0x220 [ 1235.522368] ? ww_mutex_lock+0x160/0x160 [ 1235.527568] ? selinux_inode_free_security+0x330/0x330 [ 1235.534135] ? cap_capable+0x1d6/0x3e0 [ 1235.539140] ? threaded_store+0x132/0x220 [ 1235.544435] threaded_store+0x132/0x220 [ 1235.549537] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.554833] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.560133] ? sysfs_kf_write+0x65/0x160 [ 1235.565331] ? sysfs_file_ops+0x140/0x140 [ 1235.570625] kernfs_fop_write_iter+0x335/0x510 [ 1235.576408] ? kernfs_ops+0xf0/0xf0 [ 1235.581115] new_sync_write+0x333/0x750 [ 1235.586218] ? __lock_acquire+0x508/0xc10 [ 1235.591514] ? new_sync_read+0x740/0x740 [ 1235.596705] ? lock_acquire.part.0+0xbc/0x260 [ 1235.602388] ? ksys_write+0x116/0x250 [ 1235.607299] vfs_write+0x657/0x9b0 [ 1235.611913] ksys_write+0x116/0x250 [ 1235.616623] ? __ia32_sys_read+0xc0/0xc0 [ 1235.621822] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.627410] ? rcu_is_watching+0x15/0xd0 [ 1235.632613] do_syscall_64+0xf3/0x650 [ 1235.637518] ? trace_hardirqs_off+0xd/0x30 [ 1235.642912] ? exc_page_fault+0xda/0xf0 [ 1235.648012] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.654479] RIP: 0033:0x7f05dd7cd22e [ 1235.659287] RSP: 002b:00007ffd59b66980 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.668583] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f05dd7cd22e [ 1235.677391] RDX: 0000000000000001 RSI: 0000563a85d37cd0 RDI: 0000000000000007 [ 1235.686190] RBP: 00007ffd59b66990 R08: 0000000000000000 R09: 0000000000000000 [ 1235.694998] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f05dd645390 [ 1235.703806] R13: 0000563a85d37cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.085951] #2: ff11000122382b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.097106] #3: ff11000122429d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.107196] | [ 1236.109655] =============================================\x0a | [ 1288.683705] kworker/u129:0 (177) used greatest stack depth: 21936 bytes left [ 1358.316402] INFO: task python3:5891 blocked for more than 491 seconds. [ 1358.324548] Not tainted 7.1.0-rc3-fbrn-g82170046794c #1 [ 1358.331796] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.341384] task:python3 state:D stack:25616 pid:5891 tgid:5891 ppid:5888 task_flags:0x400100 flags:0x00080002 [ 1358.354588] Call Trace: [ 1358.358124] [ 1358.361273] __schedule+0xcc3/0x19c0 [ 1358.366087] ? io_schedule_timeout+0x140/0x140 [ 1358.371864] ? find_held_lock+0x2b/0x80 [ 1358.376967] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.382851] schedule+0xd4/0x260 [ 1358.387267] schedule_preempt_disabled+0x18/0x30 [ 1358.393244] __mutex_lock+0x6a3/0x2000 [ 1358.398247] ? threaded_store+0x132/0x220 [ 1358.403536] ? ww_mutex_lock+0x160/0x160 [ 1358.408732] ? selinux_inode_free_security+0x330/0x330 [ 1358.415302] ? cap_capable+0x1d6/0x3e0 [ 1358.420307] ? threaded_store+0x132/0x220 [ 1358.425601] threaded_store+0x132/0x220 [ 1358.430703] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.435997] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.441298] ? sysfs_kf_write+0x65/0x160 [ 1358.446497] ? sysfs_file_ops+0x140/0x140 [ 1358.451790] kernfs_fop_write_iter+0x335/0x510 [ 1358.457573] ? kernfs_ops+0xf0/0xf0 [ 1358.462280] new_sync_write+0x333/0x750 [ 1358.467382] ? __lock_acquire+0x508/0xc10 [ 1358.472679] ? new_sync_read+0x740/0x740 [ 1358.477877] ? lock_acquire.part.0+0xbc/0x260 [ 1358.483564] ? ksys_write+0x116/0x250 [ 1358.488465] vfs_write+0x657/0x9b0 [ 1358.493079] ksys_write+0x116/0x250 [ 1358.497789] ? __ia32_sys_read+0xc0/0xc0 [ 1358.502987] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.508574] ? rcu_is_watching+0x15/0xd0 [ 1358.513776] do_syscall_64+0xf3/0x650 [ 1358.518680] ? trace_hardirqs_off+0xd/0x30 [ 1358.524073] ? exc_page_fault+0xda/0xf0 [ 1358.529176] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.535642] RIP: 0033:0x7f05dd7cd22e [ 1358.540449] RSP: 002b:00007ffd59b66980 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.549744] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f05dd7cd22e [ 1358.558552] RDX: 0000000000000001 RSI: 0000563a85d37cd0 RDI: 0000000000000007 [ 1358.567350] RBP: 00007ffd59b66990 R08: 0000000000000000 R09: 0000000000000000 [ 1358.576158] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f05dd645390 [ 1358.584956] R13: 0000563a85d37cd0 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store