====================================== | [ 788.202490] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 788.204975] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py | [ 788.335725] kselftest: Running tests in drivers/net [ 989.663346] INFO: task python3:5758 blocked for more than 122 seconds. [ 989.671547] Not tainted 7.1.0-rc3-oadl-g03c42cd70454 #1 [ 989.678799] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.688768] task:python3 state:D stack:25032 pid:5758 tgid:5758 ppid:5757 task_flags:0x400100 flags:0x00080000 [ 989.701976] Call Trace: [ 989.705514] [ 989.708665] __schedule+0xcc3/0x19c0 [ 989.713482] ? io_schedule_timeout+0x140/0x140 [ 989.719265] ? find_held_lock+0x2b/0x80 [ 989.724369] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.730244] schedule+0xd4/0x260 [ 989.734659] schedule_preempt_disabled+0x18/0x30 [ 989.740637] __mutex_lock+0x6a3/0x2000 [ 989.745643] ? threaded_store+0x132/0x220 [ 989.750940] ? ww_mutex_lock+0x160/0x160 [ 989.756136] ? selinux_inode_free_security+0x330/0x330 [ 989.762704] ? cap_capable+0x1d6/0x3e0 [ 989.767710] ? threaded_store+0x132/0x220 [ 989.773005] threaded_store+0x132/0x220 [ 989.778105] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.783404] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.788704] ? sysfs_kf_write+0x65/0x160 [ 989.793903] ? sysfs_file_ops+0x140/0x140 [ 989.799198] kernfs_fop_write_iter+0x335/0x510 [ 989.804982] ? kernfs_ops+0xf0/0xf0 [ 989.809692] new_sync_write+0x333/0x750 [ 989.814796] ? __lock_acquire+0x508/0xc10 [ 989.820085] ? new_sync_read+0x740/0x740 [ 989.825285] ? lock_acquire.part.0+0xbc/0x260 [ 989.830970] ? ksys_write+0x116/0x250 [ 989.835881] vfs_write+0x657/0x9b0 [ 989.840497] ksys_write+0x116/0x250 [ 989.845208] ? __ia32_sys_read+0xc0/0xc0 [ 989.850404] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.855992] ? rcu_is_watching+0x15/0xd0 [ 989.861193] do_syscall_64+0xf3/0x650 [ 989.866100] ? trace_hardirqs_off+0xd/0x30 [ 989.871485] ? exc_page_fault+0xda/0xf0 [ 989.876586] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.883061] RIP: 0033:0x7f352ac5722e [ 989.887870] RSP: 002b:00007ffd3f08e130 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.897165] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f352ac5722e [ 989.905971] RDX: 0000000000000001 RSI: 00005640e1ea3cd0 RDI: 0000000000000007 [ 989.914779] RBP: 00007ffd3f08e140 R08: 0000000000000000 R09: 0000000000000000 [ 989.923587] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f352aacf390 [ 989.932388] R13: 00005640e1ea3cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 990.309148] #1: ff11000231684a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.320107] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.331266] #3: ff11000122239d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.341355] | [ 990.343820] =============================================\x0a [ 1112.543545] INFO: task python3:5758 blocked for more than 245 seconds. [ 1112.551694] Not tainted 7.1.0-rc3-oadl-g03c42cd70454 #1 [ 1112.558943] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.568534] task:python3 state:D stack:25032 pid:5758 tgid:5758 ppid:5757 task_flags:0x400100 flags:0x00080000 [ 1112.581739] Call Trace: [ 1112.585279] [ 1112.588432] __schedule+0xcc3/0x19c0 [ 1112.593249] ? io_schedule_timeout+0x140/0x140 [ 1112.599037] ? find_held_lock+0x2b/0x80 [ 1112.604145] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.610028] schedule+0xd4/0x260 [ 1112.614445] schedule_preempt_disabled+0x18/0x30 [ 1112.620427] __mutex_lock+0x6a3/0x2000 [ 1112.625434] ? threaded_store+0x132/0x220 [ 1112.630736] ? ww_mutex_lock+0x160/0x160 [ 1112.635934] ? selinux_inode_free_security+0x330/0x330 [ 1112.642503] ? cap_capable+0x1d6/0x3e0 [ 1112.647512] ? threaded_store+0x132/0x220 [ 1112.652808] threaded_store+0x132/0x220 [ 1112.657913] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.663213] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.668512] ? sysfs_kf_write+0x65/0x160 [ 1112.673703] ? sysfs_file_ops+0x140/0x140 [ 1112.678999] kernfs_fop_write_iter+0x335/0x510 [ 1112.684787] ? kernfs_ops+0xf0/0xf0 [ 1112.689498] new_sync_write+0x333/0x750 [ 1112.694602] ? __lock_acquire+0x508/0xc10 [ 1112.699897] ? new_sync_read+0x740/0x740 [ 1112.705099] ? lock_acquire.part.0+0xbc/0x260 [ 1112.710784] ? ksys_write+0x116/0x250 [ 1112.715693] vfs_write+0x657/0x9b0 [ 1112.720310] ksys_write+0x116/0x250 [ 1112.725023] ? __ia32_sys_read+0xc0/0xc0 [ 1112.730224] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.735814] ? rcu_is_watching+0x15/0xd0 [ 1112.741014] do_syscall_64+0xf3/0x650 [ 1112.745921] ? trace_hardirqs_off+0xd/0x30 [ 1112.751316] ? exc_page_fault+0xda/0xf0 [ 1112.756419] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.762877] RIP: 0033:0x7f352ac5722e [ 1112.767687] RSP: 002b:00007ffd3f08e130 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.776979] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f352ac5722e [ 1112.785787] RDX: 0000000000000001 RSI: 00005640e1ea3cd0 RDI: 0000000000000007 [ 1112.794587] RBP: 00007ffd3f08e140 R08: 0000000000000000 R09: 0000000000000000 [ 1112.803397] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f352aacf390 [ 1112.812205] R13: 00005640e1ea3cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.189051] #1: ff11000231684a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1113.200012] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1113.211164] #3: ff11000122239d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1113.221258] | [ 1113.223726] =============================================\x0a [ 1235.424758] INFO: task python3:5758 blocked for more than 368 seconds. [ 1235.432908] Not tainted 7.1.0-rc3-oadl-g03c42cd70454 #1 [ 1235.440158] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.449749] task:python3 state:D stack:25032 pid:5758 tgid:5758 ppid:5757 task_flags:0x400100 flags:0x00080002 [ 1235.462955] Call Trace: [ 1235.466495] [ 1235.469648] __schedule+0xcc3/0x19c0 [ 1235.474466] ? io_schedule_timeout+0x140/0x140 [ 1235.480253] ? find_held_lock+0x2b/0x80 [ 1235.485359] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.491243] schedule+0xd4/0x260 [ 1235.495661] schedule_preempt_disabled+0x18/0x30 [ 1235.501642] __mutex_lock+0x6a3/0x2000 [ 1235.506645] ? threaded_store+0x132/0x220 [ 1235.511944] ? ww_mutex_lock+0x160/0x160 [ 1235.517142] ? selinux_inode_free_security+0x330/0x330 [ 1235.523715] ? cap_capable+0x1d6/0x3e0 [ 1235.528727] ? threaded_store+0x132/0x220 [ 1235.534024] threaded_store+0x132/0x220 [ 1235.539119] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.544416] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.549717] ? sysfs_kf_write+0x65/0x160 [ 1235.554917] ? sysfs_file_ops+0x140/0x140 [ 1235.560213] kernfs_fop_write_iter+0x335/0x510 [ 1235.566001] ? kernfs_ops+0xf0/0xf0 [ 1235.570711] new_sync_write+0x333/0x750 [ 1235.575815] ? __lock_acquire+0x508/0xc10 [ 1235.581113] ? new_sync_read+0x740/0x740 [ 1235.586315] ? lock_acquire.part.0+0xbc/0x260 [ 1235.592003] ? ksys_write+0x116/0x250 [ 1235.596915] vfs_write+0x657/0x9b0 [ 1235.601532] ksys_write+0x116/0x250 [ 1235.606244] ? __ia32_sys_read+0xc0/0xc0 [ 1235.611446] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.617034] ? rcu_is_watching+0x15/0xd0 [ 1235.622229] do_syscall_64+0xf3/0x650 [ 1235.627137] ? trace_hardirqs_off+0xd/0x30 [ 1235.632533] ? exc_page_fault+0xda/0xf0 [ 1235.637635] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.644095] RIP: 0033:0x7f352ac5722e [ 1235.648905] RSP: 002b:00007ffd3f08e130 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.658194] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f352ac5722e [ 1235.666993] RDX: 0000000000000001 RSI: 00005640e1ea3cd0 RDI: 0000000000000007 [ 1235.675801] RBP: 00007ffd3f08e140 R08: 0000000000000000 R09: 0000000000000000 [ 1235.684612] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f352aacf390 [ 1235.693420] R13: 00005640e1ea3cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.070282] #1: ff11000231684a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.081244] #2: ff110001221b6b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.092399] #3: ff11000122239d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.102493] | [ 1236.104960] =============================================\x0a [ 1358.306962] INFO: task python3:5758 blocked for more than 491 seconds. [ 1358.315110] Not tainted 7.1.0-rc3-oadl-g03c42cd70454 #1 [ 1358.322360] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.331952] task:python3 state:D stack:25032 pid:5758 tgid:5758 ppid:5757 task_flags:0x400100 flags:0x00080002 [ 1358.345160] Call Trace: [ 1358.348700] [ 1358.351853] __schedule+0xcc3/0x19c0 [ 1358.356673] ? io_schedule_timeout+0x140/0x140 [ 1358.362460] ? find_held_lock+0x2b/0x80 [ 1358.367569] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.373452] schedule+0xd4/0x260 [ 1358.377860] schedule_preempt_disabled+0x18/0x30 [ 1358.383840] __mutex_lock+0x6a3/0x2000 [ 1358.388838] ? threaded_store+0x132/0x220 [ 1358.394140] ? ww_mutex_lock+0x160/0x160 [ 1358.399339] ? selinux_inode_free_security+0x330/0x330 [ 1358.405908] ? cap_capable+0x1d6/0x3e0 [ 1358.410916] ? threaded_store+0x132/0x220 [ 1358.416214] threaded_store+0x132/0x220 [ 1358.421307] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.426608] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.431909] ? sysfs_kf_write+0x65/0x160 [ 1358.437109] ? sysfs_file_ops+0x140/0x140 [ 1358.442397] kernfs_fop_write_iter+0x335/0x510 [ 1358.448183] ? kernfs_ops+0xf0/0xf0 [ 1358.452894] new_sync_write+0x333/0x750 [ 1358.457989] ? __lock_acquire+0x508/0xc10 [ 1358.463285] ? new_sync_read+0x740/0x740 [ 1358.468488] ? lock_acquire.part.0+0xbc/0x260 [ 1358.474174] ? ksys_write+0x116/0x250 [ 1358.479075] vfs_write+0x657/0x9b0 [ 1358.483692] ksys_write+0x116/0x250 [ 1358.488406] ? __ia32_sys_read+0xc0/0xc0 [ 1358.493604] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.499195] ? rcu_is_watching+0x15/0xd0 [ 1358.504399] do_syscall_64+0xf3/0x650 [ 1358.509304] ? trace_hardirqs_off+0xd/0x30 [ 1358.514699] ? exc_page_fault+0xda/0xf0 [ 1358.519795] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.526266] RIP: 0033:0x7f352ac5722e [ 1358.531077] RSP: 002b:00007ffd3f08e130 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.540374] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f352ac5722e [ 1358.549173] RDX: 0000000000000001 RSI: 00005640e1ea3cd0 RDI: 0000000000000007 [ 1358.557973] RBP: 00007ffd3f08e140 R08: 0000000000000000 R09: 0000000000000000 [ 1358.566783] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f352aacf390 [ 1358.575593] R13: 00005640e1ea3cd0 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store