[ 779.697554] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 779.700202] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 779.851153] kselftest: Running tests in drivers/net
[ 977.947555] block nvme0n1: No UUID available providing old NGUID
SUBSYSTEM=block
DEVICE=b259:0
[ 989.665503] INFO: task python3:5689 blocked for more than 122 seconds.
[ 989.673727] Not tainted 7.1.0-rc1-hpyl-g3827bfba0884 #1
[ 989.680980] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.691161] task:python3 state:D stack:25672 pid:5689 tgid:5689 ppid:5688 task_flags:0x400100 flags:0x00080000
[ 989.704366] Call Trace:
[ 989.707903]
[ 989.711055] __schedule+0xcba/0x1940
[ 989.715871] ? io_schedule_timeout+0x140/0x140
[ 989.721653] ? find_held_lock+0x2b/0x80
[ 989.726758] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.732640] schedule+0xd4/0x260
[ 989.737058] schedule_preempt_disabled+0x18/0x30
[ 989.743036] __mutex_lock+0x6a3/0x2000
[ 989.748040] ? threaded_store+0x132/0x220
[ 989.753343] ? ww_mutex_lock+0x160/0x160
[ 989.758540] ? selinux_inode_free_security+0x330/0x330
[ 989.765107] ? cap_capable+0x1d6/0x3e0
[ 989.770114] ? threaded_store+0x132/0x220
[ 989.775410] threaded_store+0x132/0x220
[ 989.780515] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.785812] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.791101] ? sysfs_kf_write+0x65/0x160
[ 989.796313] ? sysfs_file_ops+0x140/0x140
[ 989.801608] kernfs_fop_write_iter+0x335/0x510
[ 989.807393] ? kernfs_ops+0xf0/0xf0
[ 989.812103] new_sync_write+0x333/0x750
[ 989.817204] ? __lock_acquire+0x508/0xc10
[ 989.822502] ? new_sync_read+0x740/0x740
[ 989.827702] ? lock_acquire.part.0+0xbc/0x260
[ 989.833387] ? ksys_write+0x116/0x250
[ 989.838298] vfs_write+0x657/0x9b0
[ 989.842913] ksys_write+0x116/0x250
[ 989.847623] ? __ia32_sys_read+0xc0/0xc0
[ 989.852821] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.858411] ? rcu_is_watching+0x15/0xd0
[ 989.863608] do_syscall_64+0xf3/0x650
[ 989.868515] ? trace_hardirqs_off+0xd/0x30
[ 989.873908] ? exc_page_fault+0xda/0xf0
[ 989.879008] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.885475] RIP: 0033:0x7f3d2fd2722e
[ 989.890283] RSP: 002b:00007ffdab1a2200 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.899579] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3d2fd2722e
[ 989.908386] RDX: 0000000000000001 RSI: 000055ea67d1a8b0 RDI: 0000000000000007
[ 989.917192] RBP: 00007ffdab1a2210 R08: 0000000000000000 R09: 0000000000000000
[ 989.926000] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3d2fb9f390
[ 989.934796] R13: 000055ea67d1a8b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.943608]
[ 989.946909] INFO: task python3:5689 is blocked on a mutex likely owned by task python3:3620.
[ 989.957181] task:python3 state:D stack:25672 pid:3620 tgid:3620 ppid:3619 task_flags:0x400100 flags:0x00080802
[ 989.970382] Call Trace:
[ 989.973919]
[ 989.977068] __schedule+0xcba/0x1940
[ 989.981878] ? io_schedule_timeout+0x140/0x140
[ 989.987660] ? find_held_lock+0x2b/0x80
[ 989.992764] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.998939] schedule+0xd4/0x260
[ 990.003356] schedule_timeout+0x13f/0x290
[ 990.008651] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.015018] ? trace_contention_end+0xb3/0x1a0
[ 990.020803] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.026499] ? ww_mutex_lock+0x160/0x160
[ 990.031698] msleep+0x1b/0x30
[ 990.035822] napi_set_threaded+0x3a5/0x440
[ 990.041218] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.046712] netif_set_threaded+0x257/0x400
[ 990.052203] threaded_store+0x1b8/0x220
[ 990.057307] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.062603] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.067899] ? sysfs_kf_write+0x65/0x160
[ 990.073096] ? sysfs_file_ops+0x140/0x140
[ 990.078389] kernfs_fop_write_iter+0x335/0x510
[ 990.084173] ? kernfs_ops+0xf0/0xf0
[ 990.088882] new_sync_write+0x333/0x750
[ 990.093982] ? __lock_acquire+0x508/0xc10
[ 990.099280] ? new_sync_read+0x740/0x740
[ 990.104469] ? lock_acquire.part.0+0xbc/0x260
[ 990.110155] ? ksys_write+0x116/0x250
[ 990.115065] vfs_write+0x657/0x9b0
[ 990.119680] ksys_write+0x116/0x250
[ 990.124383] ? __ia32_sys_read+0xc0/0xc0
[ 990.129582] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.135171] ? rcu_is_watching+0x15/0xd0
[ 990.140372] do_syscall_64+0xf3/0x650
[ 990.145274] ? trace_hardirqs_off+0xd/0x30
[ 990.150666] ? exc_page_fault+0xda/0xf0
[ 990.155767] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.162235] RIP: 0033:0x7f376acda22e
[ 990.167041] RSP: 002b:00007ffd10e9d780 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.176338] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f376acda22e
[ 990.185147] RDX: 0000000000000001 RSI: 000055b72e3508b0 RDI: 0000000000000007
[ 990.193955] RBP: 00007ffd10e9d790 R08: 0000000000000000 R09: 0000000000000000
[ 990.202761] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f376ab52390
[ 990.211567] R13: 000055b72e3508b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.220381]
[ 990.223642] \x0aShowing all locks held in the system:
[ 990.232182] 1 lock held by khungtaskd/184:
[ 990.237572] #0: ffffffff9c4fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.249061] 4 locks held by python3/3620:
[ 990.254355] #0: ff1100012f32c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.264244] #1: ff110001633b2680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.275207] #2: ff11000122650b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.286359] #3: ff110001226d9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.296460] 4 locks held by python3/5689:
[ 990.301755] #0: ff1100012f32c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.311647] #1: ff1100019df76880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.322617] #2: ff11000122650b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.333779] #3: ff110001226d9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.343858]
[ 990.347294] =============================================\x0a
[ 1112.545819] INFO: task python3:5689 blocked for more than 245 seconds.
[ 1112.553966] Not tainted 7.1.0-rc1-hpyl-g3827bfba0884 #1
[ 1112.561206] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.570795] task:python3 state:D stack:25672 pid:5689 tgid:5689 ppid:5688 task_flags:0x400100 flags:0x00080000
[ 1112.584002] Call Trace:
[ 1112.587540]
[ 1112.590688] __schedule+0xcba/0x1940
[ 1112.595505] ? io_schedule_timeout+0x140/0x140
[ 1112.601292] ? find_held_lock+0x2b/0x80
[ 1112.606396] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.612271] schedule+0xd4/0x260
[ 1112.616687] schedule_preempt_disabled+0x18/0x30
[ 1112.622666] __mutex_lock+0x6a3/0x2000
[ 1112.627667] ? threaded_store+0x132/0x220
[ 1112.632966] ? ww_mutex_lock+0x160/0x160
[ 1112.638164] ? selinux_inode_free_security+0x330/0x330
[ 1112.644734] ? cap_capable+0x1d6/0x3e0
[ 1112.649744] ? threaded_store+0x132/0x220
[ 1112.655043] threaded_store+0x132/0x220
[ 1112.660142] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.665439] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.670733] ? sysfs_kf_write+0x65/0x160
[ 1112.675933] ? sysfs_file_ops+0x140/0x140
[ 1112.681220] kernfs_fop_write_iter+0x335/0x510
[ 1112.687001] ? kernfs_ops+0xf0/0xf0
[ 1112.691713] new_sync_write+0x333/0x750
[ 1112.696808] ? __lock_acquire+0x508/0xc10
[ 1112.702103] ? new_sync_read+0x740/0x740
[ 1112.707305] ? lock_acquire.part.0+0xbc/0x260
[ 1112.712992] ? ksys_write+0x116/0x250
[ 1112.717901] vfs_write+0x657/0x9b0
[ 1112.722513] ksys_write+0x116/0x250
[ 1112.727225] ? __ia32_sys_read+0xc0/0xc0
[ 1112.732412] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.737998] ? rcu_is_watching+0x15/0xd0
[ 1112.743198] do_syscall_64+0xf3/0x650
[ 1112.748093] ? trace_hardirqs_off+0xd/0x30
[ 1112.753485] ? exc_page_fault+0xda/0xf0
[ 1112.758588] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.765053] RIP: 0033:0x7f3d2fd2722e
[ 1112.769864] RSP: 002b:00007ffdab1a2200 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.779153] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3d2fd2722e
[ 1112.787958] RDX: 0000000000000001 RSI: 000055ea67d1a8b0 RDI: 0000000000000007
[ 1112.796762] RBP: 00007ffdab1a2210 R08: 0000000000000000 R09: 0000000000000000
[ 1112.805567] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3d2fb9f390
[ 1112.814377] R13: 000055ea67d1a8b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.823190]
[ 1112.826473] INFO: task python3:5689 is blocked on a mutex likely owned by task python3:3620.
[ 1112.836743] task:python3 state:D stack:25672 pid:3620 tgid:3620 ppid:3619 task_flags:0x400100 flags:0x00080802
[ 1112.849946] Call Trace:
[ 1112.853485]
[ 1112.856632] __schedule+0xcba/0x1940
[ 1112.861441] ? io_schedule_timeout+0x140/0x140
[ 1112.867222] ? find_held_lock+0x2b/0x80
[ 1112.872322] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.878500] schedule+0xd4/0x260
[ 1112.882919] schedule_timeout+0x13f/0x290
[ 1112.888216] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.894582] ? trace_contention_end+0xb3/0x1a0
[ 1112.900363] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.906051] ? ww_mutex_lock+0x160/0x160
[ 1112.911243] msleep+0x1b/0x30
[ 1112.915356] napi_set_threaded+0x3a5/0x440
[ 1112.920751] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.926245] netif_set_threaded+0x257/0x400
[ 1112.931737] threaded_store+0x1b8/0x220
[ 1112.936839] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.942134] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.947427] ? sysfs_kf_write+0x65/0x160
[ 1112.952623] ? sysfs_file_ops+0x140/0x140
[ 1112.957917] kernfs_fop_write_iter+0x335/0x510
[ 1112.963701] ? kernfs_ops+0xf0/0xf0
[ 1112.968405] new_sync_write+0x333/0x750
[ 1112.973506] ? __lock_acquire+0x508/0xc10
[ 1112.978803] ? new_sync_read+0x740/0x740
[ 1112.984002] ? lock_acquire.part.0+0xbc/0x260
[ 1112.989686] ? ksys_write+0x116/0x250
[ 1112.994593] vfs_write+0x657/0x9b0
[ 1112.999208] ksys_write+0x116/0x250
[ 1113.003910] ? __ia32_sys_read+0xc0/0xc0
[ 1113.009110] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.014698] ? rcu_is_watching+0x15/0xd0
[ 1113.019899] do_syscall_64+0xf3/0x650
[ 1113.024890] ? trace_hardirqs_off+0xd/0x30
[ 1113.030280] ? exc_page_fault+0xda/0xf0
[ 1113.035382] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.041838] RIP: 0033:0x7f376acda22e
[ 1113.046644] RSP: 002b:00007ffd10e9d780 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.055938] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f376acda22e
[ 1113.064744] RDX: 0000000000000001 RSI: 000055b72e3508b0 RDI: 0000000000000007
[ 1113.073549] RBP: 00007ffd10e9d790 R08: 0000000000000000 R09: 0000000000000000
[ 1113.082356] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f376ab52390
[ 1113.091151] R13: 000055b72e3508b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.099962]
[ 1113.103231] \x0aShowing all locks held in the system:
[ 1113.111771] 1 lock held by khungtaskd/184:
[ 1113.117164] #0: ffffffff9c4fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.128643] 4 locks held by python3/3620:
[ 1113.133937] #0: ff1100012f32c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.143827] #1: ff110001633b2680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.154789] #2: ff11000122650b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.165937] #3: ff110001226d9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.176033] 4 locks held by python3/5689:
[ 1113.181326] #0: ff1100012f32c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.191216] #1: ff1100019df76880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.202177] #2: ff11000122650b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.213326] #3: ff110001226d9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.223419]
[ 1113.225885] =============================================\x0a
[ 1173.987447] kworker/u129:9 (291) used greatest stack depth: 21936 bytes left
[ 1235.428146] INFO: task python3:5689 blocked for more than 368 seconds.
[ 1235.436295] Not tainted 7.1.0-rc1-hpyl-g3827bfba0884 #1
[ 1235.443545] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.453137] task:python3 state:D stack:25672 pid:5689 tgid:5689 ppid:5688 task_flags:0x400100 flags:0x00080002
[ 1235.466345] Call Trace:
[ 1235.469886]
[ 1235.473040] __schedule+0xcba/0x1940
[ 1235.477859] ? io_schedule_timeout+0x140/0x140
[ 1235.483646] ? find_held_lock+0x2b/0x80
[ 1235.488752] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.494638] schedule+0xd4/0x260
[ 1235.499060] schedule_preempt_disabled+0x18/0x30
[ 1235.505041] __mutex_lock+0x6a3/0x2000
[ 1235.510048] ? threaded_store+0x132/0x220
[ 1235.515350] ? ww_mutex_lock+0x160/0x160
[ 1235.520549] ? selinux_inode_free_security+0x330/0x330
[ 1235.527117] ? cap_capable+0x1d6/0x3e0
[ 1235.532127] ? threaded_store+0x132/0x220
[ 1235.537425] threaded_store+0x132/0x220
[ 1235.542522] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.547822] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.553124] ? sysfs_kf_write+0x65/0x160
[ 1235.558325] ? sysfs_file_ops+0x140/0x140
[ 1235.563621] kernfs_fop_write_iter+0x335/0x510
[ 1235.569407] ? kernfs_ops+0xf0/0xf0
[ 1235.574118] new_sync_write+0x333/0x750
[ 1235.579222] ? __lock_acquire+0x508/0xc10
[ 1235.584509] ? new_sync_read+0x740/0x740
[ 1235.589711] ? lock_acquire.part.0+0xbc/0x260
[ 1235.595397] ? ksys_write+0x116/0x250
[ 1235.600306] vfs_write+0x657/0x9b0
[ 1235.604923] ksys_write+0x116/0x250
[ 1235.609635] ? __ia32_sys_read+0xc0/0xc0
[ 1235.614825] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.620414] ? rcu_is_watching+0x15/0xd0
[ 1235.625616] do_syscall_64+0xf3/0x650
[ 1235.630525] ? trace_hardirqs_off+0xd/0x30
[ 1235.635920] ? exc_page_fault+0xda/0xf0
[ 1235.641023] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.647492] RIP: 0033:0x7f3d2fd2722e
[ 1235.652302] RSP: 002b:00007ffdab1a2200 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.661591] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3d2fd2722e
[ 1235.670400] RDX: 0000000000000001 RSI: 000055ea67d1a8b0 RDI: 0000000000000007
[ 1235.679209] RBP: 00007ffdab1a2210 R08: 0000000000000000 R09: 0000000000000000
[ 1235.688018] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3d2fb9f390
[ 1235.696827] R13: 000055ea67d1a8b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.705639]
[ 1235.708917] INFO: task python3:5689 is blocked on a mutex likely owned by task python3:3620.
[ 1235.719190] task:python3 state:D stack:25672 pid:3620 tgid:3620 ppid:3619 task_flags:0x400100 flags:0x00080802
[ 1235.732392] Call Trace:
[ 1235.735931]
[ 1235.739083] __schedule+0xcba/0x1940
[ 1235.743895] ? io_schedule_timeout+0x140/0x140
[ 1235.749678] ? find_held_lock+0x2b/0x80
[ 1235.754783] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.760964] schedule+0xd4/0x260
[ 1235.765382] schedule_timeout+0x13f/0x290
[ 1235.770678] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.777047] ? trace_contention_end+0xb3/0x1a0
[ 1235.782834] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.788525] ? ww_mutex_lock+0x160/0x160
[ 1235.793724] msleep+0x1b/0x30
[ 1235.797849] napi_set_threaded+0x3a5/0x440
[ 1235.803248] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.808741] netif_set_threaded+0x257/0x400
[ 1235.814235] threaded_store+0x1b8/0x220
[ 1235.819340] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.824638] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.829936] ? sysfs_kf_write+0x65/0x160
[ 1235.835136] ? sysfs_file_ops+0x140/0x140
[ 1235.840423] kernfs_fop_write_iter+0x335/0x510
[ 1235.846205] ? kernfs_ops+0xf0/0xf0
[ 1235.850916] new_sync_write+0x333/0x750
[ 1235.856019] ? __lock_acquire+0x508/0xc10
[ 1235.861315] ? new_sync_read+0x740/0x740
[ 1235.866516] ? lock_acquire.part.0+0xbc/0x260
[ 1235.872203] ? ksys_write+0x116/0x250
[ 1235.877111] vfs_write+0x657/0x9b0
[ 1235.881729] ksys_write+0x116/0x250
[ 1235.886442] ? __ia32_sys_read+0xc0/0xc0
[ 1235.891644] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.897233] ? rcu_is_watching+0x15/0xd0
[ 1235.902427] do_syscall_64+0xf3/0x650
[ 1235.907336] ? trace_hardirqs_off+0xd/0x30
[ 1235.912730] ? exc_page_fault+0xda/0xf0
[ 1235.917832] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.924291] RIP: 0033:0x7f376acda22e
[ 1235.929101] RSP: 002b:00007ffd10e9d780 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.938398] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f376acda22e
[ 1235.947206] RDX: 0000000000000001 RSI: 000055b72e3508b0 RDI: 0000000000000007
[ 1235.956016] RBP: 00007ffd10e9d790 R08: 0000000000000000 R09: 0000000000000000
[ 1235.964826] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f376ab52390
[ 1235.973633] R13: 000055b72e3508b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.982445]
[ 1235.985716] \x0aShowing all locks held in the system:
[ 1235.994254] 1 lock held by khungtaskd/184:
[ 1235.999650] #0: ffffffff9c4fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.011130] 4 locks held by python3/3620:
[ 1236.016426] #0: ff1100012f32c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.026317] #1: ff110001633b2680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.037281] #2: ff11000122650b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.048440] #3: ff110001226d9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.058533] 4 locks held by python3/5689:
[ 1236.063828] #0: ff1100012f32c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.073718] #1: ff1100019df76880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.084678] #2: ff11000122650b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.095839] #3: ff110001226d9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.105932]
[ 1236.108399] =============================================\x0a
[ 1358.309452] INFO: task python3:5689 blocked for more than 491 seconds.
[ 1358.317603] Not tainted 7.1.0-rc1-hpyl-g3827bfba0884 #1
[ 1358.324852] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.334433] task:python3 state:D stack:25672 pid:5689 tgid:5689 ppid:5688 task_flags:0x400100 flags:0x00080002
[ 1358.347639] Call Trace:
[ 1358.351178]
[ 1358.354329] __schedule+0xcba/0x1940
[ 1358.359145] ? io_schedule_timeout+0x140/0x140
[ 1358.364930] ? find_held_lock+0x2b/0x80
[ 1358.370035] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.375938] schedule+0xd4/0x260
[ 1358.380361] schedule_preempt_disabled+0x18/0x30
[ 1358.386340] __mutex_lock+0x6a3/0x2000
[ 1358.391341] ? threaded_store+0x132/0x220
[ 1358.396638] ? ww_mutex_lock+0x160/0x160
[ 1358.401835] ? selinux_inode_free_security+0x330/0x330
[ 1358.408402] ? cap_capable+0x1d6/0x3e0
[ 1358.413410] ? threaded_store+0x132/0x220
[ 1358.418706] threaded_store+0x132/0x220
[ 1358.423807] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.429102] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.434397] ? sysfs_kf_write+0x65/0x160
[ 1358.439597] ? sysfs_file_ops+0x140/0x140
[ 1358.444962] kernfs_fop_write_iter+0x335/0x510
[ 1358.450747] ? kernfs_ops+0xf0/0xf0
[ 1358.455525] new_sync_write+0x333/0x750
[ 1358.460629] ? __lock_acquire+0x508/0xc10
[ 1358.465914] ? new_sync_read+0x740/0x740
[ 1358.471112] ? lock_acquire.part.0+0xbc/0x260
[ 1358.476800] ? ksys_write+0x116/0x250
[ 1358.481701] vfs_write+0x657/0x9b0
[ 1358.486317] ksys_write+0x116/0x250
[ 1358.491028] ? __ia32_sys_read+0xc0/0xc0
[ 1358.496224] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.501879] ? rcu_is_watching+0x15/0xd0
[ 1358.507081] do_syscall_64+0xf3/0x650
[ 1358.511989] ? trace_hardirqs_off+0xd/0x30
[ 1358.517381] ? exc_page_fault+0xda/0xf0
[ 1358.522481] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.528949] RIP: 0033:0x7f3d2fd2722e
[ 1358.533758] RSP: 002b:00007ffdab1a2200 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.543055] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3d2fd2722e
[ 1358.551861] RDX: 0000000000000001 RSI: 000055ea67d1a8b0 RDI: 0000000000000007
[ 1358.560669] RBP: 00007ffdab1a2210 R08: 0000000000000000 R09: 0000000000000000
[ 1358.569475] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3d2fb9f390
[ 1358.578286] R13: 000055ea67d1a8b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.587100]
[ 1358.590402] INFO: task python3:5689 is blocked on a mutex likely owned by task python3:3620.
[ 1358.600671] task:python3 state:D stack:25672 pid:3620 tgid:3620 ppid:3619 task_flags:0x400100 flags:0x00080802
[ 1358.613873] Call Trace:
[ 1358.617412]
[ 1358.620562] __schedule+0xcba/0x1940
[ 1358.625373] ? io_schedule_timeout+0x140/0x140
[ 1358.631158] ? find_held_lock+0x2b/0x80
[ 1358.636261] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.642439] schedule+0xd4/0x260
[ 1358.646856] schedule_timeout+0x13f/0x290
[ 1358.652152] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.658520] ? trace_contention_end+0xb3/0x1a0
[ 1358.664305] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.669986] ? ww_mutex_lock+0x160/0x160
[ 1358.675185] msleep+0x1b/0x30
[ 1358.679308] napi_set_threaded+0x3a5/0x440
[ 1358.684702] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.690260] netif_set_threaded+0x257/0x400
[ 1358.695752] threaded_store+0x1b8/0x220
[ 1358.700857] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.706152] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.711445] ? sysfs_kf_write+0x65/0x160
[ 1358.716643] ? sysfs_file_ops+0x140/0x140
[ 1358.721936] kernfs_fop_write_iter+0x335/0x510
[ 1358.727718] ? kernfs_ops+0xf0/0xf0
[ 1358.732429] new_sync_write+0x333/0x750
[ 1358.737532] ? __lock_acquire+0x508/0xc10
[ 1358.742828] ? new_sync_read+0x740/0x740
[ 1358.748028] ? lock_acquire.part.0+0xbc/0x260
[ 1358.753715] ? ksys_write+0x116/0x250
[ 1358.758623] vfs_write+0x657/0x9b0
[ 1358.763299] ksys_write+0x116/0x250
[ 1358.768010] ? __ia32_sys_read+0xc0/0xc0
[ 1358.773207] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.778795] ? rcu_is_watching+0x15/0xd0
[ 1358.783996] do_syscall_64+0xf3/0x650
[ 1358.788902] ? trace_hardirqs_off+0xd/0x30
[ 1358.794297] ? exc_page_fault+0xda/0xf0
[ 1358.799399] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.805866] RIP: 0033:0x7f376acda22e
[ 1358.810665] RSP: 002b:00007ffd10e9d780 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.819962] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f376acda22e
[ 1358.828760] RDX: 0000000000000001 RSI: 000055b72e3508b0 RDI: 0000000000000007
[ 1358.837566] RBP: 00007ffd10e9d790 R08: 0000000000000000 R09: 0000000000000000
[ 1358.846374] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f376ab52390
[ 1358.855179] R13: 000055b72e3508b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.863994]
[ 1358.867262] \x0aShowing all locks held in the system:
[ 1358.875803] 1 lock held by khungtaskd/184:
[ 1358.881194] #0: ffffffff9c4fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.892670] 2 locks held by systemd-journal/801:
[ 1358.898721] #0: ff1100180e7372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1358.908608] #1: ffffffff9c7031a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.921422] 4 locks held by python3/3620:
[ 1358.926716] #0: ff1100012f32c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.936603] #1: ff110001633b2680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.947564] #2: ff11000122650b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.958723] #3: ff110001226d9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.968818] 4 locks held by python3/5689:
[ 1358.974113] #0: ff1100012f32c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.984003] #1: ff1100019df76880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.994956] #2: ff11000122650b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.006110] #3: ff110001226d9d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.016202] 1 lock held by systemd/7580:
[ 1359.021402]
[ 1359.023861] =============================================\x0a