====================================== | [ 787.416392] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 787.418904] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py | [ 787.551419] kselftest: Running tests in drivers/net [ 989.716747] INFO: task python3:5840 blocked for more than 122 seconds. [ 989.724977] Not tainted 7.1.0-rc4-ibhq-gad6a1ad5271b #1 [ 989.732909] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.742491] task:python3 state:D stack:25672 pid:5840 tgid:5840 ppid:5839 task_flags:0x400100 flags:0x00080000 [ 989.755697] Call Trace: [ 989.759238] [ 989.762391] __schedule+0xcc3/0x19c0 [ 989.767207] ? io_schedule_timeout+0x140/0x140 [ 989.772990] ? find_held_lock+0x2b/0x80 [ 989.778087] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.783973] schedule+0xd8/0x260 [ 989.788392] schedule_preempt_disabled+0x18/0x30 [ 989.794370] __mutex_lock+0x6af/0x2010 [ 989.799373] ? threaded_store+0x132/0x220 [ 989.804664] ? ww_mutex_lock+0x160/0x160 [ 989.809862] ? selinux_inode_free_security+0x330/0x330 [ 989.816434] ? cap_capable+0x1d6/0x3e0 [ 989.821444] ? threaded_store+0x132/0x220 [ 989.826739] threaded_store+0x132/0x220 [ 989.831842] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.837141] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.842442] ? sysfs_kf_write+0x65/0x160 [ 989.847640] ? sysfs_file_ops+0x140/0x140 [ 989.852935] kernfs_fop_write_iter+0x335/0x510 [ 989.858722] ? kernfs_ops+0xf0/0xf0 [ 989.863435] new_sync_write+0x333/0x750 [ 989.868541] ? __lock_acquire+0x508/0xc10 [ 989.873838] ? new_sync_read+0x740/0x740 [ 989.879039] ? lock_acquire.part.0+0xbc/0x260 [ 989.884717] ? ksys_write+0x116/0x250 [ 989.889631] vfs_write+0x657/0x9b0 [ 989.894245] ksys_write+0x116/0x250 [ 989.898956] ? __ia32_sys_read+0xc0/0xc0 [ 989.904156] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.909737] ? rcu_is_watching+0x15/0xd0 [ 989.914929] do_syscall_64+0xf3/0x650 [ 989.919836] ? irq_exit_rcu+0x1a/0x30 [ 989.924735] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.931202] RIP: 0033:0x7fce21fc122e [ 989.936012] RSP: 002b:00007ffd37dfed60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.945312] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fce21fc122e [ 989.954120] RDX: 0000000000000001 RSI: 000056428a46c6b0 RDI: 0000000000000007 [ 989.962927] RBP: 00007ffd37dfed70 R08: 0000000000000000 R09: 0000000000000000 [ 989.971725] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fce21e39390 [ 989.980534] R13: 000056428a46c6b0 R14: 0000000000000007 R15: 0000000000000003 | [ 990.389543] #1: ff110001f5f3d680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.400504] #2: ff110017d9288b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.411661] #3: ff110017d9261d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.421742] | [ 990.424210] =============================================\x0a [ 1112.597803] INFO: task python3:5840 blocked for more than 245 seconds. [ 1112.605952] Not tainted 7.1.0-rc4-ibhq-gad6a1ad5271b #1 [ 1112.613204] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.622792] task:python3 state:D stack:25672 pid:5840 tgid:5840 ppid:5839 task_flags:0x400100 flags:0x00080000 [ 1112.635998] Call Trace: [ 1112.639539] [ 1112.642689] __schedule+0xcc3/0x19c0 [ 1112.647508] ? io_schedule_timeout+0x140/0x140 [ 1112.653295] ? find_held_lock+0x2b/0x80 [ 1112.658400] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.664284] schedule+0xd8/0x260 [ 1112.668703] schedule_preempt_disabled+0x18/0x30 [ 1112.674681] __mutex_lock+0x6af/0x2010 [ 1112.679685] ? threaded_store+0x132/0x220 [ 1112.684988] ? ww_mutex_lock+0x160/0x160 [ 1112.690188] ? selinux_inode_free_security+0x330/0x330 [ 1112.696759] ? cap_capable+0x1d6/0x3e0 [ 1112.701769] ? threaded_store+0x132/0x220 [ 1112.707068] threaded_store+0x132/0x220 [ 1112.712169] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.717468] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.722770] ? sysfs_kf_write+0x65/0x160 [ 1112.727972] ? sysfs_file_ops+0x140/0x140 [ 1112.733270] kernfs_fop_write_iter+0x335/0x510 [ 1112.739049] ? kernfs_ops+0xf0/0xf0 [ 1112.743761] new_sync_write+0x333/0x750 [ 1112.748868] ? __lock_acquire+0x508/0xc10 [ 1112.754163] ? new_sync_read+0x740/0x740 [ 1112.759365] ? lock_acquire.part.0+0xbc/0x260 [ 1112.765052] ? ksys_write+0x116/0x250 [ 1112.769962] vfs_write+0x657/0x9b0 [ 1112.774580] ksys_write+0x116/0x250 [ 1112.779293] ? __ia32_sys_read+0xc0/0xc0 [ 1112.784494] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.790086] ? rcu_is_watching+0x15/0xd0 [ 1112.795287] do_syscall_64+0xf3/0x650 [ 1112.800183] ? irq_exit_rcu+0x1a/0x30 [ 1112.805093] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.811563] RIP: 0033:0x7fce21fc122e [ 1112.816374] RSP: 002b:00007ffd37dfed60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.825672] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fce21fc122e [ 1112.834483] RDX: 0000000000000001 RSI: 000056428a46c6b0 RDI: 0000000000000007 [ 1112.843289] RBP: 00007ffd37dfed70 R08: 0000000000000000 R09: 0000000000000000 [ 1112.852098] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fce21e39390 [ 1112.860909] R13: 000056428a46c6b0 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.232218] #1: ff110001f5f3d680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1113.243179] #2: ff110017d9288b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1113.254328] #3: ff110017d9261d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1113.264421] | [ 1113.266888] =============================================\x0a [ 1235.478865] INFO: task python3:5840 blocked for more than 368 seconds. [ 1235.487013] Not tainted 7.1.0-rc4-ibhq-gad6a1ad5271b #1 [ 1235.494264] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.503852] task:python3 state:D stack:25672 pid:5840 tgid:5840 ppid:5839 task_flags:0x400100 flags:0x00080002 [ 1235.517055] Call Trace: [ 1235.520595] [ 1235.523743] __schedule+0xcc3/0x19c0 [ 1235.528560] ? io_schedule_timeout+0x140/0x140 [ 1235.534346] ? find_held_lock+0x2b/0x80 [ 1235.539454] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.545336] schedule+0xd8/0x260 [ 1235.549753] schedule_preempt_disabled+0x18/0x30 [ 1235.555730] __mutex_lock+0x6af/0x2010 [ 1235.560733] ? threaded_store+0x132/0x220 [ 1235.566023] ? ww_mutex_lock+0x160/0x160 [ 1235.571218] ? selinux_inode_free_security+0x330/0x330 [ 1235.577790] ? cap_capable+0x1d6/0x3e0 [ 1235.582799] ? threaded_store+0x132/0x220 [ 1235.588093] threaded_store+0x132/0x220 [ 1235.593194] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.598492] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.603793] ? sysfs_kf_write+0x65/0x160 [ 1235.608995] ? sysfs_file_ops+0x140/0x140 [ 1235.614291] kernfs_fop_write_iter+0x335/0x510 [ 1235.620073] ? kernfs_ops+0xf0/0xf0 [ 1235.624784] new_sync_write+0x333/0x750 [ 1235.629879] ? __lock_acquire+0x508/0xc10 [ 1235.635167] ? new_sync_read+0x740/0x740 [ 1235.640365] ? lock_acquire.part.0+0xbc/0x260 [ 1235.646048] ? ksys_write+0x116/0x250 [ 1235.650958] vfs_write+0x657/0x9b0 [ 1235.655571] ksys_write+0x116/0x250 [ 1235.660281] ? __ia32_sys_read+0xc0/0xc0 [ 1235.665477] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.671066] ? rcu_is_watching+0x15/0xd0 [ 1235.676266] do_syscall_64+0xf3/0x650 [ 1235.681171] ? irq_exit_rcu+0x1a/0x30 [ 1235.686079] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.692536] RIP: 0033:0x7fce21fc122e [ 1235.697347] RSP: 002b:00007ffd37dfed60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.706645] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fce21fc122e [ 1235.715452] RDX: 0000000000000001 RSI: 000056428a46c6b0 RDI: 0000000000000007 [ 1235.724260] RBP: 00007ffd37dfed70 R08: 0000000000000000 R09: 0000000000000000 [ 1235.733066] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fce21e39390 [ 1235.741874] R13: 000056428a46c6b0 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.113073] #1: ff110001f5f3d680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.124023] #2: ff110017d9288b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.135179] #3: ff110017d9261d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.145273] | [ 1236.147740] =============================================\x0a [ 1358.358959] INFO: task python3:5840 blocked for more than 491 seconds. [ 1358.367110] Not tainted 7.1.0-rc4-ibhq-gad6a1ad5271b #1 [ 1358.374362] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.383952] task:python3 state:D stack:25672 pid:5840 tgid:5840 ppid:5839 task_flags:0x400100 flags:0x00080002 [ 1358.397158] Call Trace: [ 1358.400700] [ 1358.403849] __schedule+0xcc3/0x19c0 [ 1358.408666] ? io_schedule_timeout+0x140/0x140 [ 1358.414453] ? find_held_lock+0x2b/0x80 [ 1358.419556] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.425442] schedule+0xd8/0x260 [ 1358.429860] schedule_preempt_disabled+0x18/0x30 [ 1358.435838] __mutex_lock+0x6af/0x2010 [ 1358.440842] ? threaded_store+0x132/0x220 [ 1358.446142] ? ww_mutex_lock+0x160/0x160 [ 1358.451340] ? selinux_inode_free_security+0x330/0x330 [ 1358.457902] ? cap_capable+0x1d6/0x3e0 [ 1358.462915] ? threaded_store+0x132/0x220 [ 1358.468212] threaded_store+0x132/0x220 [ 1358.473315] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.478613] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.483910] ? sysfs_kf_write+0x65/0x160 [ 1358.489109] ? sysfs_file_ops+0x140/0x140 [ 1358.494406] kernfs_fop_write_iter+0x335/0x510 [ 1358.500181] ? kernfs_ops+0xf0/0xf0 [ 1358.504893] new_sync_write+0x333/0x750 [ 1358.509995] ? __lock_acquire+0x508/0xc10 [ 1358.515293] ? new_sync_read+0x740/0x740 [ 1358.520496] ? lock_acquire.part.0+0xbc/0x260 [ 1358.526185] ? ksys_write+0x116/0x250 [ 1358.531096] vfs_write+0x657/0x9b0 [ 1358.535714] ksys_write+0x116/0x250 [ 1358.540427] ? __ia32_sys_read+0xc0/0xc0 [ 1358.545626] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.551217] ? rcu_is_watching+0x15/0xd0 [ 1358.556419] do_syscall_64+0xf3/0x650 [ 1358.561324] ? irq_exit_rcu+0x1a/0x30 [ 1358.566233] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.572700] RIP: 0033:0x7fce21fc122e [ 1358.577501] RSP: 002b:00007ffd37dfed60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.587580] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fce21fc122e [ 1358.596392] RDX: 0000000000000001 RSI: 000056428a46c6b0 RDI: 0000000000000007 [ 1358.605199] RBP: 00007ffd37dfed70 R08: 0000000000000000 R09: 0000000000000000 [ 1358.614008] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fce21e39390 [ 1358.622816] R13: 000056428a46c6b0 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store