[ 789.142846] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 789.145260] nipa-hw-worker: [5/44] Retrying drivers/net:napi_threaded.py
[ 789.275756] kselftest: Running tests in drivers/net
[ 989.665650] INFO: task python3:5877 blocked for more than 122 seconds.
[ 989.673881] Not tainted 7.1.0-rc1-unbo-g45ed429acae8 #1
[ 989.681715] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.691306] task:python3 state:D stack:25672 pid:5877 tgid:5877 ppid:5876 task_flags:0x400100 flags:0x00080000
[ 989.704512] Call Trace:
[ 989.708052]
[ 989.711205] __schedule+0xcba/0x1940
[ 989.716024] ? io_schedule_timeout+0x140/0x140
[ 989.721808] ? find_held_lock+0x2b/0x80
[ 989.726916] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.732802] schedule+0xd4/0x260
[ 989.737222] schedule_preempt_disabled+0x18/0x30
[ 989.743192] __mutex_lock+0x6a3/0x2000
[ 989.748196] ? threaded_store+0x132/0x220
[ 989.753497] ? ww_mutex_lock+0x160/0x160
[ 989.758695] ? selinux_inode_free_security+0x330/0x330
[ 989.765258] ? cap_capable+0x1d6/0x3e0
[ 989.770264] ? threaded_store+0x132/0x220
[ 989.775560] threaded_store+0x132/0x220
[ 989.780663] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.785954] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.791256] ? sysfs_kf_write+0x65/0x160
[ 989.796454] ? sysfs_file_ops+0x140/0x140
[ 989.801750] kernfs_fop_write_iter+0x335/0x510
[ 989.807537] ? kernfs_ops+0xf0/0xf0
[ 989.812247] new_sync_write+0x333/0x750
[ 989.817349] ? __lock_acquire+0x508/0xc10
[ 989.822647] ? new_sync_read+0x740/0x740
[ 989.827849] ? lock_acquire.part.0+0xbc/0x260
[ 989.833534] ? ksys_write+0x116/0x250
[ 989.838447] vfs_write+0x657/0x9b0
[ 989.843062] ksys_write+0x116/0x250
[ 989.847774] ? __ia32_sys_read+0xc0/0xc0
[ 989.852964] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.858556] ? rcu_is_watching+0x15/0xd0
[ 989.863759] do_syscall_64+0xf3/0x650
[ 989.868667] ? trace_hardirqs_off+0xd/0x30
[ 989.874062] ? exc_page_fault+0xda/0xf0
[ 989.879164] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.885633] RIP: 0033:0x7f9d89b5622e
[ 989.890446] RSP: 002b:00007fff54019820 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.899744] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9d89b5622e
[ 989.908552] RDX: 0000000000000001 RSI: 000055ec3f569a10 RDI: 0000000000000007
[ 989.917360] RBP: 00007fff54019830 R08: 0000000000000000 R09: 0000000000000000
[ 989.926170] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9d899ce390
[ 989.934979] R13: 000055ec3f569a10 R14: 0000000000000007 R15: 0000000000000003
[ 989.943793]
[ 989.947097] INFO: task python3:5877 is blocked on a mutex likely owned by task python3:3798.
[ 989.957371] task:python3 state:D stack:25672 pid:3798 tgid:3798 ppid:3797 task_flags:0x400100 flags:0x00080802
[ 989.970574] Call Trace:
[ 989.974113]
[ 989.977263] __schedule+0xcba/0x1940
[ 989.982076] ? io_schedule_timeout+0x140/0x140
[ 989.987863] ? find_held_lock+0x2b/0x80
[ 989.992969] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.999149] schedule+0xd4/0x260
[ 990.003566] schedule_timeout+0x13f/0x290
[ 990.008865] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.015233] ? trace_contention_end+0xb3/0x1a0
[ 990.021017] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.026702] ? ww_mutex_lock+0x160/0x160
[ 990.031913] msleep+0x1b/0x30
[ 990.036038] napi_set_threaded+0x3a5/0x440
[ 990.041432] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.046927] netif_set_threaded+0x257/0x400
[ 990.052422] threaded_store+0x1b8/0x220
[ 990.057526] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.062824] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.068122] ? sysfs_kf_write+0x65/0x160
[ 990.073314] ? sysfs_file_ops+0x140/0x140
[ 990.078609] kernfs_fop_write_iter+0x335/0x510
[ 990.084394] ? kernfs_ops+0xf0/0xf0
[ 990.089106] new_sync_write+0x333/0x750
[ 990.094209] ? __lock_acquire+0x508/0xc10
[ 990.099495] ? new_sync_read+0x740/0x740
[ 990.104695] ? lock_acquire.part.0+0xbc/0x260
[ 990.110384] ? ksys_write+0x116/0x250
[ 990.115294] vfs_write+0x657/0x9b0
[ 990.119908] ksys_write+0x116/0x250
[ 990.124624] ? __ia32_sys_read+0xc0/0xc0
[ 990.129824] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.135405] ? rcu_is_watching+0x15/0xd0
[ 990.140604] do_syscall_64+0xf3/0x650
[ 990.145510] ? trace_hardirqs_off+0xd/0x30
[ 990.150906] ? exc_page_fault+0xda/0xf0
[ 990.156006] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.162473] RIP: 0033:0x7fec0e98822e
[ 990.167283] RSP: 002b:00007ffe1b295c10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.176580] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fec0e98822e
[ 990.185400] RDX: 0000000000000001 RSI: 000055c738493a10 RDI: 0000000000000007
[ 990.194211] RBP: 00007ffe1b295c20 R08: 0000000000000000 R09: 0000000000000000
[ 990.203018] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fec0e800390
[ 990.211825] R13: 000055c738493a10 R14: 0000000000000007 R15: 0000000000000003
[ 990.220638]
[ 990.223900] \x0aShowing all locks held in the system:
[ 990.232442] 1 lock held by khungtaskd/184:
[ 990.237826] #0: ffffffff972fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.249304] 2 locks held by systemd-journal/802:
[ 990.255284] #0: ff1100180e2b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.265173] #1: ffffffff97503120 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.278000] 4 locks held by python3/3798:
[ 990.283295] #0: ff110001307a13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.293186] #1: ff1100011fb0ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.304147] #2: ff11000124760b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.315297] #3: ff11000112001d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.325398] 4 locks held by python3/5877:
[ 990.330695] #0: ff110001307a13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.340586] #1: ff110001bfd05680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.351548] #2: ff11000124760b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.362703] #3: ff11000112001d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.372794]
[ 990.375261] =============================================\x0a
[ 1112.547992] INFO: task python3:5877 blocked for more than 245 seconds.
[ 1112.556141] Not tainted 7.1.0-rc1-unbo-g45ed429acae8 #1
[ 1112.563391] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.572982] task:python3 state:D stack:25672 pid:5877 tgid:5877 ppid:5876 task_flags:0x400100 flags:0x00080000
[ 1112.586190] Call Trace:
[ 1112.589734]
[ 1112.592885] __schedule+0xcba/0x1940
[ 1112.597703] ? io_schedule_timeout+0x140/0x140
[ 1112.603490] ? find_held_lock+0x2b/0x80
[ 1112.608598] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.614483] schedule+0xd4/0x260
[ 1112.618903] schedule_preempt_disabled+0x18/0x30
[ 1112.624884] __mutex_lock+0x6a3/0x2000
[ 1112.629892] ? threaded_store+0x132/0x220
[ 1112.635191] ? ww_mutex_lock+0x160/0x160
[ 1112.640389] ? selinux_inode_free_security+0x330/0x330
[ 1112.646959] ? cap_capable+0x1d6/0x3e0
[ 1112.651969] ? threaded_store+0x132/0x220
[ 1112.657269] threaded_store+0x132/0x220
[ 1112.662373] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.667671] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.672968] ? sysfs_kf_write+0x65/0x160
[ 1112.678169] ? sysfs_file_ops+0x140/0x140
[ 1112.683466] kernfs_fop_write_iter+0x335/0x510
[ 1112.689244] ? kernfs_ops+0xf0/0xf0
[ 1112.693956] new_sync_write+0x333/0x750
[ 1112.699059] ? __lock_acquire+0x508/0xc10
[ 1112.704357] ? new_sync_read+0x740/0x740
[ 1112.709557] ? lock_acquire.part.0+0xbc/0x260
[ 1112.715234] ? ksys_write+0x116/0x250
[ 1112.720146] vfs_write+0x657/0x9b0
[ 1112.724763] ksys_write+0x116/0x250
[ 1112.729475] ? __ia32_sys_read+0xc0/0xc0
[ 1112.734676] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.740267] ? rcu_is_watching+0x15/0xd0
[ 1112.745471] do_syscall_64+0xf3/0x650
[ 1112.750381] ? trace_hardirqs_off+0xd/0x30
[ 1112.755777] ? exc_page_fault+0xda/0xf0
[ 1112.760869] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.767340] RIP: 0033:0x7f9d89b5622e
[ 1112.772148] RSP: 002b:00007fff54019820 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.781448] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9d89b5622e
[ 1112.790258] RDX: 0000000000000001 RSI: 000055ec3f569a10 RDI: 0000000000000007
[ 1112.799068] RBP: 00007fff54019830 R08: 0000000000000000 R09: 0000000000000000
[ 1112.807876] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9d899ce390
[ 1112.816684] R13: 000055ec3f569a10 R14: 0000000000000007 R15: 0000000000000003
[ 1112.825489]
[ 1112.828775] INFO: task python3:5877 is blocked on a mutex likely owned by task python3:3798.
[ 1112.839050] task:python3 state:D stack:25672 pid:3798 tgid:3798 ppid:3797 task_flags:0x400100 flags:0x00080802
[ 1112.852244] Call Trace:
[ 1112.855783]
[ 1112.858935] __schedule+0xcba/0x1940
[ 1112.863747] ? io_schedule_timeout+0x140/0x140
[ 1112.869531] ? find_held_lock+0x2b/0x80
[ 1112.874635] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.880813] schedule+0xd4/0x260
[ 1112.885232] schedule_timeout+0x13f/0x290
[ 1112.890532] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.896901] ? trace_contention_end+0xb3/0x1a0
[ 1112.902688] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.908380] ? ww_mutex_lock+0x160/0x160
[ 1112.913579] msleep+0x1b/0x30
[ 1112.917708] napi_set_threaded+0x3a5/0x440
[ 1112.923105] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.928602] netif_set_threaded+0x257/0x400
[ 1112.934097] threaded_store+0x1b8/0x220
[ 1112.939201] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.944498] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.949797] ? sysfs_kf_write+0x65/0x160
[ 1112.954997] ? sysfs_file_ops+0x140/0x140
[ 1112.960292] kernfs_fop_write_iter+0x335/0x510
[ 1112.966079] ? kernfs_ops+0xf0/0xf0
[ 1112.970790] new_sync_write+0x333/0x750
[ 1112.975892] ? __lock_acquire+0x508/0xc10
[ 1112.981192] ? new_sync_read+0x740/0x740
[ 1112.986394] ? lock_acquire.part.0+0xbc/0x260
[ 1112.992079] ? ksys_write+0x116/0x250
[ 1112.996993] vfs_write+0x657/0x9b0
[ 1113.001609] ksys_write+0x116/0x250
[ 1113.006322] ? __ia32_sys_read+0xc0/0xc0
[ 1113.011523] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.017112] ? rcu_is_watching+0x15/0xd0
[ 1113.022315] do_syscall_64+0xf3/0x650
[ 1113.027223] ? trace_hardirqs_off+0xd/0x30
[ 1113.032617] ? exc_page_fault+0xda/0xf0
[ 1113.037722] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.044188] RIP: 0033:0x7fec0e98822e
[ 1113.048995] RSP: 002b:00007ffe1b295c10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.058291] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fec0e98822e
[ 1113.067092] RDX: 0000000000000001 RSI: 000055c738493a10 RDI: 0000000000000007
[ 1113.075903] RBP: 00007ffe1b295c20 R08: 0000000000000000 R09: 0000000000000000
[ 1113.084712] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fec0e800390
[ 1113.093521] R13: 000055c738493a10 R14: 0000000000000007 R15: 0000000000000003
[ 1113.102335]
[ 1113.105598] \x0aShowing all locks held in the system:
[ 1113.114135] 1 lock held by khungtaskd/184:
[ 1113.119530] #0: ffffffff972fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.131010] 4 locks held by python3/3798:
[ 1113.136305] #0: ff110001307a13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.146197] #1: ff1100011fb0ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.157161] #2: ff11000124760b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.168317] #3: ff11000112001d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.178403] 4 locks held by python3/5877:
[ 1113.183699] #0: ff110001307a13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.193588] #1: ff110001bfd05680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.204541] #2: ff11000124760b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.215692] #3: ff11000112001d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.225784]
[ 1113.228251] =============================================\x0a
[ 1235.428358] INFO: task python3:5877 blocked for more than 368 seconds.
[ 1235.436508] Not tainted 7.1.0-rc1-unbo-g45ed429acae8 #1
[ 1235.443759] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.453350] task:python3 state:D stack:25672 pid:5877 tgid:5877 ppid:5876 task_flags:0x400100 flags:0x00080002
[ 1235.466562] Call Trace:
[ 1235.470104]
[ 1235.473254] __schedule+0xcba/0x1940
[ 1235.478071] ? io_schedule_timeout+0x140/0x140
[ 1235.483856] ? find_held_lock+0x2b/0x80
[ 1235.488965] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.494849] schedule+0xd4/0x260
[ 1235.499270] schedule_preempt_disabled+0x18/0x30
[ 1235.505250] __mutex_lock+0x6a3/0x2000
[ 1235.510257] ? threaded_store+0x132/0x220
[ 1235.515559] ? ww_mutex_lock+0x160/0x160
[ 1235.520760] ? selinux_inode_free_security+0x330/0x330
[ 1235.527329] ? cap_capable+0x1d6/0x3e0
[ 1235.532337] ? threaded_store+0x132/0x220
[ 1235.537636] threaded_store+0x132/0x220
[ 1235.542741] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.548039] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.553341] ? sysfs_kf_write+0x65/0x160
[ 1235.558542] ? sysfs_file_ops+0x140/0x140
[ 1235.563838] kernfs_fop_write_iter+0x335/0x510
[ 1235.569624] ? kernfs_ops+0xf0/0xf0
[ 1235.574336] new_sync_write+0x333/0x750
[ 1235.579440] ? __lock_acquire+0x508/0xc10
[ 1235.584739] ? new_sync_read+0x740/0x740
[ 1235.589940] ? lock_acquire.part.0+0xbc/0x260
[ 1235.595616] ? ksys_write+0x116/0x250
[ 1235.600526] vfs_write+0x657/0x9b0
[ 1235.605142] ksys_write+0x116/0x250
[ 1235.609853] ? __ia32_sys_read+0xc0/0xc0
[ 1235.615053] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.620645] ? rcu_is_watching+0x15/0xd0
[ 1235.625848] do_syscall_64+0xf3/0x650
[ 1235.630757] ? trace_hardirqs_off+0xd/0x30
[ 1235.636152] ? exc_page_fault+0xda/0xf0
[ 1235.641254] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.647724] RIP: 0033:0x7f9d89b5622e
[ 1235.652534] RSP: 002b:00007fff54019820 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.661825] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9d89b5622e
[ 1235.670634] RDX: 0000000000000001 RSI: 000055ec3f569a10 RDI: 0000000000000007
[ 1235.679444] RBP: 00007fff54019830 R08: 0000000000000000 R09: 0000000000000000
[ 1235.688255] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9d899ce390
[ 1235.697063] R13: 000055ec3f569a10 R14: 0000000000000007 R15: 0000000000000003
[ 1235.705877]
[ 1235.709158] INFO: task python3:5877 is blocked on a mutex likely owned by task python3:3798.
[ 1235.719431] task:python3 state:D stack:25672 pid:3798 tgid:3798 ppid:3797 task_flags:0x400100 flags:0x00080802
[ 1235.732634] Call Trace:
[ 1235.736172]
[ 1235.739325] __schedule+0xcba/0x1940
[ 1235.744127] ? io_schedule_timeout+0x140/0x140
[ 1235.749911] ? find_held_lock+0x2b/0x80
[ 1235.755014] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.761199] schedule+0xd4/0x260
[ 1235.765609] schedule_timeout+0x13f/0x290
[ 1235.770906] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.777275] ? trace_contention_end+0xb3/0x1a0
[ 1235.783062] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.788753] ? ww_mutex_lock+0x160/0x160
[ 1235.793953] msleep+0x1b/0x30
[ 1235.798068] napi_set_threaded+0x3a5/0x440
[ 1235.803465] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.808962] netif_set_threaded+0x257/0x400
[ 1235.814456] threaded_store+0x1b8/0x220
[ 1235.819561] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.824859] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.830147] ? sysfs_kf_write+0x65/0x160
[ 1235.835348] ? sysfs_file_ops+0x140/0x140
[ 1235.840644] kernfs_fop_write_iter+0x335/0x510
[ 1235.846427] ? kernfs_ops+0xf0/0xf0
[ 1235.851141] new_sync_write+0x333/0x750
[ 1235.856243] ? __lock_acquire+0x508/0xc10
[ 1235.861541] ? new_sync_read+0x740/0x740
[ 1235.866741] ? lock_acquire.part.0+0xbc/0x260
[ 1235.872417] ? ksys_write+0x116/0x250
[ 1235.877326] vfs_write+0x657/0x9b0
[ 1235.881942] ksys_write+0x116/0x250
[ 1235.886655] ? __ia32_sys_read+0xc0/0xc0
[ 1235.891855] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.897445] ? rcu_is_watching+0x15/0xd0
[ 1235.902638] do_syscall_64+0xf3/0x650
[ 1235.907542] ? trace_hardirqs_off+0xd/0x30
[ 1235.912936] ? exc_page_fault+0xda/0xf0
[ 1235.918037] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.924505] RIP: 0033:0x7fec0e98822e
[ 1235.929305] RSP: 002b:00007ffe1b295c10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.938602] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fec0e98822e
[ 1235.947412] RDX: 0000000000000001 RSI: 000055c738493a10 RDI: 0000000000000007
[ 1235.956222] RBP: 00007ffe1b295c20 R08: 0000000000000000 R09: 0000000000000000
[ 1235.965032] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fec0e800390
[ 1235.973840] R13: 000055c738493a10 R14: 0000000000000007 R15: 0000000000000003
[ 1235.982654]
[ 1235.985921] \x0aShowing all locks held in the system:
[ 1235.994462] 1 lock held by khungtaskd/184:
[ 1235.999853] #0: ffffffff972fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.011335] 4 locks held by python3/3798:
[ 1236.016631] #0: ff110001307a13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.026522] #1: ff1100011fb0ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.037486] #2: ff11000124760b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.048643] #3: ff11000112001d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.058727] 4 locks held by python3/5877:
[ 1236.064024] #0: ff110001307a13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.073912] #1: ff110001bfd05680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.084873] #2: ff11000124760b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.096031] #3: ff11000112001d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.106127]
[ 1236.108595] =============================================\x0a
[ 1358.310690] INFO: task python3:5877 blocked for more than 491 seconds.
[ 1358.318836] Not tainted 7.1.0-rc1-unbo-g45ed429acae8 #1
[ 1358.326086] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.335677] task:python3 state:D stack:25672 pid:5877 tgid:5877 ppid:5876 task_flags:0x400100 flags:0x00080002
[ 1358.348883] Call Trace:
[ 1358.352421]
[ 1358.355572] __schedule+0xcba/0x1940
[ 1358.360390] ? io_schedule_timeout+0x140/0x140
[ 1358.366175] ? find_held_lock+0x2b/0x80
[ 1358.371281] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.377166] schedule+0xd4/0x260
[ 1358.381582] schedule_preempt_disabled+0x18/0x30
[ 1358.387562] __mutex_lock+0x6a3/0x2000
[ 1358.392564] ? threaded_store+0x132/0x220
[ 1358.397862] ? ww_mutex_lock+0x160/0x160
[ 1358.403060] ? selinux_inode_free_security+0x330/0x330
[ 1358.409628] ? cap_capable+0x1d6/0x3e0
[ 1358.414635] ? threaded_store+0x132/0x220
[ 1358.419932] threaded_store+0x132/0x220
[ 1358.425035] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.430333] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.435631] ? sysfs_kf_write+0x65/0x160
[ 1358.440834] ? sysfs_file_ops+0x140/0x140
[ 1358.446128] kernfs_fop_write_iter+0x335/0x510
[ 1358.451910] ? kernfs_ops+0xf0/0xf0
[ 1358.456619] new_sync_write+0x333/0x750
[ 1358.461723] ? __lock_acquire+0x508/0xc10
[ 1358.467021] ? new_sync_read+0x740/0x740
[ 1358.472222] ? lock_acquire.part.0+0xbc/0x260
[ 1358.477907] ? ksys_write+0x116/0x250
[ 1358.482818] vfs_write+0x657/0x9b0
[ 1358.487433] ksys_write+0x116/0x250
[ 1358.492134] ? __ia32_sys_read+0xc0/0xc0
[ 1358.497331] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.502917] ? rcu_is_watching+0x15/0xd0
[ 1358.508118] do_syscall_64+0xf3/0x650
[ 1358.513026] ? trace_hardirqs_off+0xd/0x30
[ 1358.518420] ? exc_page_fault+0xda/0xf0
[ 1358.523521] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.529991] RIP: 0033:0x7f9d89b5622e
[ 1358.534801] RSP: 002b:00007fff54019820 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.544090] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f9d89b5622e
[ 1358.552886] RDX: 0000000000000001 RSI: 000055ec3f569a10 RDI: 0000000000000007
[ 1358.561692] RBP: 00007fff54019830 R08: 0000000000000000 R09: 0000000000000000
[ 1358.570498] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9d899ce390
[ 1358.579305] R13: 000055ec3f569a10 R14: 0000000000000007 R15: 0000000000000003
[ 1358.588119]
[ 1358.591387] INFO: task python3:5877 is blocked on a mutex likely owned by task python3:3798.
[ 1358.601657] task:python3 state:D stack:25672 pid:3798 tgid:3798 ppid:3797 task_flags:0x400100 flags:0x00080802
[ 1358.614859] Call Trace:
[ 1358.618396]
[ 1358.621544] __schedule+0xcba/0x1940
[ 1358.626353] ? io_schedule_timeout+0x140/0x140
[ 1358.632138] ? find_held_lock+0x2b/0x80
[ 1358.637241] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.643409] schedule+0xd4/0x260
[ 1358.647827] schedule_timeout+0x13f/0x290
[ 1358.653124] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.659493] ? trace_contention_end+0xb3/0x1a0
[ 1358.665275] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.670963] ? ww_mutex_lock+0x160/0x160
[ 1358.676164] msleep+0x1b/0x30
[ 1358.680288] napi_set_threaded+0x3a5/0x440
[ 1358.685683] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.691176] netif_set_threaded+0x257/0x400
[ 1358.696666] threaded_store+0x1b8/0x220
[ 1358.701766] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.707062] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.712356] ? sysfs_kf_write+0x65/0x160
[ 1358.717553] ? sysfs_file_ops+0x140/0x140
[ 1358.722846] kernfs_fop_write_iter+0x335/0x510
[ 1358.728629] ? kernfs_ops+0xf0/0xf0
[ 1358.733341] new_sync_write+0x333/0x750
[ 1358.738440] ? __lock_acquire+0x508/0xc10
[ 1358.743736] ? new_sync_read+0x740/0x740
[ 1358.748934] ? lock_acquire.part.0+0xbc/0x260
[ 1358.754621] ? ksys_write+0x116/0x250
[ 1358.759523] vfs_write+0x657/0x9b0
[ 1358.764137] ksys_write+0x116/0x250
[ 1358.768847] ? __ia32_sys_read+0xc0/0xc0
[ 1358.774047] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.779633] ? rcu_is_watching+0x15/0xd0
[ 1358.784832] do_syscall_64+0xf3/0x650
[ 1358.789738] ? trace_hardirqs_off+0xd/0x30
[ 1358.795130] ? exc_page_fault+0xda/0xf0
[ 1358.800229] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.806694] RIP: 0033:0x7fec0e98822e
[ 1358.811500] RSP: 002b:00007ffe1b295c10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.820796] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fec0e98822e
[ 1358.829603] RDX: 0000000000000001 RSI: 000055c738493a10 RDI: 0000000000000007
[ 1358.838402] RBP: 00007ffe1b295c20 R08: 0000000000000000 R09: 0000000000000000
[ 1358.847207] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fec0e800390
[ 1358.856014] R13: 000055c738493a10 R14: 0000000000000007 R15: 0000000000000003
[ 1358.864825]
[ 1358.868096] \x0aShowing all locks held in the system:
[ 1358.876631] 1 lock held by khungtaskd/184:
[ 1358.882024] #0: ffffffff972fdee0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.893501] 4 locks held by python3/3798:
[ 1358.898793] #0: ff110001307a13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.908683] #1: ff1100011fb0ca80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.919641] #2: ff11000124760b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.930794] #3: ff11000112001d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.940882] 4 locks held by python3/5877:
[ 1358.946177] #0: ff110001307a13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.956065] #1: ff110001bfd05680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.967025] #2: ff11000124760b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.978185] #3: ff11000112001d60 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.988277]
[ 1358.990743] =============================================\x0a