====================================== | [ 789.445150] nipa-hw-worker: drivers/net:napi_threaded.py: timed out | [ 789.447588] nipa-hw-worker: [5/47] Retrying drivers/net:napi_threaded.py | [ 789.611951] kselftest: Running tests in drivers/net | [ 928.219167] kworker/u129:15 (308) used greatest stack depth: 21456 bytes left [ 989.659700] INFO: task python3:5851 blocked for more than 122 seconds. [ 989.667940] Not tainted 7.1.0-rc3-yitb-ga5808e471b85 #1 [ 989.675902] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 989.685492] task:python3 state:D stack:25672 pid:5851 tgid:5851 ppid:5850 task_flags:0x400100 flags:0x00080000 [ 989.698697] Call Trace: [ 989.702238] [ 989.705388] __schedule+0xcc3/0x19c0 [ 989.710209] ? io_schedule_timeout+0x140/0x140 [ 989.715996] ? find_held_lock+0x2b/0x80 [ 989.721098] ? __lock_release.isra.0+0x6b/0x1a0 [ 989.726985] schedule+0xd4/0x260 [ 989.731403] schedule_preempt_disabled+0x18/0x30 [ 989.737384] __mutex_lock+0x6a3/0x2000 [ 989.742391] ? threaded_store+0x132/0x220 [ 989.747691] ? ww_mutex_lock+0x160/0x160 [ 989.752890] ? selinux_inode_free_security+0x330/0x330 [ 989.759461] ? cap_capable+0x1d6/0x3e0 [ 989.764470] ? threaded_store+0x132/0x220 [ 989.769767] threaded_store+0x132/0x220 [ 989.774863] ? xps_rxqs_store+0x2e0/0x2e0 [ 989.780160] ? sysfs_file_kobj+0xbd/0x1e0 [ 989.785458] ? sysfs_kf_write+0x65/0x160 [ 989.790661] ? sysfs_file_ops+0x140/0x140 [ 989.795958] kernfs_fop_write_iter+0x335/0x510 [ 989.801742] ? kernfs_ops+0xf0/0xf0 [ 989.806454] new_sync_write+0x333/0x750 [ 989.811559] ? __lock_acquire+0x508/0xc10 [ 989.816856] ? new_sync_read+0x740/0x740 [ 989.822050] ? lock_acquire.part.0+0xbc/0x260 [ 989.827737] ? ksys_write+0x116/0x250 [ 989.832648] vfs_write+0x657/0x9b0 [ 989.837266] ksys_write+0x116/0x250 [ 989.841979] ? __ia32_sys_read+0xc0/0xc0 [ 989.847177] ? kernfs_fop_llseek+0x160/0x1f0 [ 989.852769] ? rcu_is_watching+0x15/0xd0 [ 989.857971] do_syscall_64+0xf3/0x650 [ 989.862877] ? trace_hardirqs_off+0xd/0x30 [ 989.868275] ? exc_page_fault+0xda/0xf0 [ 989.873378] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 989.879848] RIP: 0033:0x7f4290e5a22e [ 989.884660] RSP: 002b:00007ffd412af070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 989.893959] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4290e5a22e [ 989.902770] RDX: 0000000000000001 RSI: 000055c2abff5cd0 RDI: 0000000000000007 [ 989.911581] RBP: 00007ffd412af080 R08: 0000000000000000 R09: 0000000000000000 [ 989.920390] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4290cd2390 [ 989.929199] R13: 000055c2abff5cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 990.300459] #1: ff110001db2dd680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 990.311420] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 990.322568] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 990.332649] | [ 990.335113] =============================================\x0a [ 1112.540873] INFO: task python3:5851 blocked for more than 245 seconds. [ 1112.549025] Not tainted 7.1.0-rc3-yitb-ga5808e471b85 #1 [ 1112.556279] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1112.565930] task:python3 state:D stack:25672 pid:5851 tgid:5851 ppid:5850 task_flags:0x400100 flags:0x00080000 [ 1112.579134] Call Trace: [ 1112.582675] [ 1112.585823] __schedule+0xcc3/0x19c0 [ 1112.590641] ? io_schedule_timeout+0x140/0x140 [ 1112.596424] ? find_held_lock+0x2b/0x80 [ 1112.601529] ? __lock_release.isra.0+0x6b/0x1a0 [ 1112.607411] schedule+0xd4/0x260 [ 1112.611820] schedule_preempt_disabled+0x18/0x30 [ 1112.617800] __mutex_lock+0x6a3/0x2000 [ 1112.622796] ? threaded_store+0x132/0x220 [ 1112.628096] ? ww_mutex_lock+0x160/0x160 [ 1112.633293] ? selinux_inode_free_security+0x330/0x330 [ 1112.639864] ? cap_capable+0x1d6/0x3e0 [ 1112.644875] ? threaded_store+0x132/0x220 [ 1112.650171] threaded_store+0x132/0x220 [ 1112.655273] ? xps_rxqs_store+0x2e0/0x2e0 [ 1112.660571] ? sysfs_file_kobj+0xbd/0x1e0 [ 1112.665868] ? sysfs_kf_write+0x65/0x160 [ 1112.671067] ? sysfs_file_ops+0x140/0x140 [ 1112.676362] kernfs_fop_write_iter+0x335/0x510 [ 1112.682146] ? kernfs_ops+0xf0/0xf0 [ 1112.686859] new_sync_write+0x333/0x750 [ 1112.691962] ? __lock_acquire+0x508/0xc10 [ 1112.697255] ? new_sync_read+0x740/0x740 [ 1112.702456] ? lock_acquire.part.0+0xbc/0x260 [ 1112.708140] ? ksys_write+0x116/0x250 [ 1112.713048] vfs_write+0x657/0x9b0 [ 1112.717664] ksys_write+0x116/0x250 [ 1112.722376] ? __ia32_sys_read+0xc0/0xc0 [ 1112.727573] ? kernfs_fop_llseek+0x160/0x1f0 [ 1112.733159] ? rcu_is_watching+0x15/0xd0 [ 1112.738383] do_syscall_64+0xf3/0x650 [ 1112.743323] ? trace_hardirqs_off+0xd/0x30 [ 1112.748721] ? exc_page_fault+0xda/0xf0 [ 1112.753824] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1112.760296] RIP: 0033:0x7f4290e5a22e [ 1112.765107] RSP: 002b:00007ffd412af070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1112.774409] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4290e5a22e [ 1112.783220] RDX: 0000000000000001 RSI: 000055c2abff5cd0 RDI: 0000000000000007 [ 1112.792031] RBP: 00007ffd412af080 R08: 0000000000000000 R09: 0000000000000000 [ 1112.800843] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4290cd2390 [ 1112.809651] R13: 000055c2abff5cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 1113.220943] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1113.232099] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1113.242187] 1 lock held by systemd/6900: | [ 1113.247391] | [ 1113.249860] =============================================\x0a [ 1235.421023] INFO: task python3:5851 blocked for more than 368 seconds. [ 1235.429171] Not tainted 7.1.0-rc3-yitb-ga5808e471b85 #1 [ 1235.436423] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1235.446016] task:python3 state:D stack:25672 pid:5851 tgid:5851 ppid:5850 task_flags:0x400100 flags:0x00080002 [ 1235.459226] Call Trace: [ 1235.462768] [ 1235.465922] __schedule+0xcc3/0x19c0 [ 1235.470741] ? io_schedule_timeout+0x140/0x140 [ 1235.476527] ? find_held_lock+0x2b/0x80 [ 1235.481635] ? __lock_release.isra.0+0x6b/0x1a0 [ 1235.487523] schedule+0xd4/0x260 [ 1235.491944] schedule_preempt_disabled+0x18/0x30 [ 1235.497924] __mutex_lock+0x6a3/0x2000 [ 1235.502930] ? threaded_store+0x132/0x220 [ 1235.508230] ? ww_mutex_lock+0x160/0x160 [ 1235.513430] ? selinux_inode_free_security+0x330/0x330 [ 1235.520000] ? cap_capable+0x1d6/0x3e0 [ 1235.525009] ? threaded_store+0x132/0x220 [ 1235.530308] threaded_store+0x132/0x220 [ 1235.535412] ? xps_rxqs_store+0x2e0/0x2e0 [ 1235.540710] ? sysfs_file_kobj+0xbd/0x1e0 [ 1235.546013] ? sysfs_kf_write+0x65/0x160 [ 1235.551215] ? sysfs_file_ops+0x140/0x140 [ 1235.556510] kernfs_fop_write_iter+0x335/0x510 [ 1235.562299] ? kernfs_ops+0xf0/0xf0 [ 1235.567010] new_sync_write+0x333/0x750 [ 1235.572115] ? __lock_acquire+0x508/0xc10 [ 1235.577414] ? new_sync_read+0x740/0x740 [ 1235.582617] ? lock_acquire.part.0+0xbc/0x260 [ 1235.588306] ? ksys_write+0x116/0x250 [ 1235.593219] vfs_write+0x657/0x9b0 [ 1235.597838] ksys_write+0x116/0x250 [ 1235.602553] ? __ia32_sys_read+0xc0/0xc0 [ 1235.607754] ? kernfs_fop_llseek+0x160/0x1f0 [ 1235.613343] ? rcu_is_watching+0x15/0xd0 [ 1235.618548] do_syscall_64+0xf3/0x650 [ 1235.623455] ? trace_hardirqs_off+0xd/0x30 [ 1235.628856] ? exc_page_fault+0xda/0xf0 [ 1235.633957] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1235.640416] RIP: 0033:0x7f4290e5a22e [ 1235.645224] RSP: 002b:00007ffd412af070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1235.654523] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4290e5a22e [ 1235.663335] RDX: 0000000000000001 RSI: 000055c2abff5cd0 RDI: 0000000000000007 [ 1235.672144] RBP: 00007ffd412af080 R08: 0000000000000000 R09: 0000000000000000 [ 1235.680955] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4290cd2390 [ 1235.689764] R13: 000055c2abff5cd0 R14: 0000000000000007 R15: 0000000000000003 | [ 1236.061067] #1: ff110001db2dd680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510 | [ 1236.072032] #2: ff11000121c54b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510 | [ 1236.083189] #3: ff11000121c29d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220 | [ 1236.093285] | [ 1236.095752] =============================================\x0a [ 1358.302131] INFO: task python3:5851 blocked for more than 491 seconds. [ 1358.310281] Not tainted 7.1.0-rc3-yitb-ga5808e471b85 #1 [ 1358.317534] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. [ 1358.327127] task:python3 state:D stack:25672 pid:5851 tgid:5851 ppid:5850 task_flags:0x400100 flags:0x00080002 [ 1358.340334] Call Trace: [ 1358.343877] [ 1358.347029] __schedule+0xcc3/0x19c0 [ 1358.351849] ? io_schedule_timeout+0x140/0x140 [ 1358.357637] ? find_held_lock+0x2b/0x80 [ 1358.362742] ? __lock_release.isra.0+0x6b/0x1a0 [ 1358.368642] schedule+0xd4/0x260 [ 1358.373292] schedule_preempt_disabled+0x18/0x30 [ 1358.379275] __mutex_lock+0x6a3/0x2000 [ 1358.384281] ? threaded_store+0x132/0x220 [ 1358.389581] ? ww_mutex_lock+0x160/0x160 [ 1358.394783] ? selinux_inode_free_security+0x330/0x330 [ 1358.401354] ? cap_capable+0x1d6/0x3e0 [ 1358.406363] ? threaded_store+0x132/0x220 [ 1358.411664] threaded_store+0x132/0x220 [ 1358.416771] ? xps_rxqs_store+0x2e0/0x2e0 [ 1358.422069] ? sysfs_file_kobj+0xbd/0x1e0 [ 1358.427367] ? sysfs_kf_write+0x65/0x160 [ 1358.432571] ? sysfs_file_ops+0x140/0x140 [ 1358.437870] kernfs_fop_write_iter+0x335/0x510 [ 1358.443659] ? kernfs_ops+0xf0/0xf0 [ 1358.448371] new_sync_write+0x333/0x750 [ 1358.453476] ? __lock_acquire+0x508/0xc10 [ 1358.458774] ? new_sync_read+0x740/0x740 [ 1358.463984] ? lock_acquire.part.0+0xbc/0x260 [ 1358.469669] ? ksys_write+0x116/0x250 [ 1358.474581] vfs_write+0x657/0x9b0 [ 1358.479196] ksys_write+0x116/0x250 [ 1358.483908] ? __ia32_sys_read+0xc0/0xc0 [ 1358.489107] ? kernfs_fop_llseek+0x160/0x1f0 [ 1358.494717] ? rcu_is_watching+0x15/0xd0 [ 1358.499919] do_syscall_64+0xf3/0x650 [ 1358.504826] ? trace_hardirqs_off+0xd/0x30 [ 1358.510217] ? exc_page_fault+0xda/0xf0 [ 1358.515320] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1358.521791] RIP: 0033:0x7f4290e5a22e [ 1358.526603] RSP: 002b:00007ffd412af070 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 1358.535902] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f4290e5a22e [ 1358.544723] RDX: 0000000000000001 RSI: 000055c2abff5cd0 RDI: 0000000000000007 [ 1358.553535] RBP: 00007ffd412af080 R08: 0000000000000000 R09: 0000000000000000 [ 1358.562346] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f4290cd2390 [ 1358.571241] R13: 000055c2abff5cd0 R14: 0000000000000007 R15: 0000000000000003 Finger prints: __schedule:schedule:schedule_preempt_disabled:__mutex_lock:threaded_store