[ 789.019709] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 789.022937] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 789.175780] kselftest: Running tests in drivers/net
[ 989.661627] INFO: task python3:5828 blocked for more than 122 seconds.
[ 989.669865] Not tainted 7.1.0-rc2-bawb-gbd4b102d97d1 #1
[ 989.677803] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.687390] task:python3 state:D stack:25672 pid:5828 tgid:5828 ppid:5827 task_flags:0x400100 flags:0x00080000
[ 989.700595] Call Trace:
[ 989.704135]
[ 989.707282] __schedule+0xcba/0x1940
[ 989.712097] ? io_schedule_timeout+0x140/0x140
[ 989.717872] ? find_held_lock+0x2b/0x80
[ 989.722976] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.728860] schedule+0xd4/0x260
[ 989.733276] schedule_preempt_disabled+0x18/0x30
[ 989.739256] __mutex_lock+0x6a3/0x2000
[ 989.744249] ? threaded_store+0x132/0x220
[ 989.749547] ? ww_mutex_lock+0x160/0x160
[ 989.754743] ? selinux_inode_free_security+0x330/0x330
[ 989.761313] ? cap_capable+0x1d6/0x3e0
[ 989.766322] ? threaded_store+0x132/0x220
[ 989.771618] threaded_store+0x132/0x220
[ 989.776719] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.782020] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.787320] ? sysfs_kf_write+0x65/0x160
[ 989.792519] ? sysfs_file_ops+0x140/0x140
[ 989.797812] kernfs_fop_write_iter+0x335/0x510
[ 989.803595] ? kernfs_ops+0xf0/0xf0
[ 989.808307] new_sync_write+0x333/0x750
[ 989.813410] ? __lock_acquire+0x508/0xc10
[ 989.818705] ? new_sync_read+0x740/0x740
[ 989.823903] ? lock_acquire.part.0+0xbc/0x260
[ 989.829590] ? ksys_write+0x116/0x250
[ 989.834499] vfs_write+0x657/0x9b0
[ 989.839112] ksys_write+0x116/0x250
[ 989.843825] ? __ia32_sys_read+0xc0/0xc0
[ 989.849024] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.854612] ? rcu_is_watching+0x15/0xd0
[ 989.859812] do_syscall_64+0xf3/0x650
[ 989.864716] ? trace_hardirqs_off+0xd/0x30
[ 989.870109] ? exc_page_fault+0xda/0xf0
[ 989.875208] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.881673] RIP: 0033:0x7f908188322e
[ 989.886481] RSP: 002b:00007ffce9964aa0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.895776] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f908188322e
[ 989.904582] RDX: 0000000000000001 RSI: 000055e3fb739fe0 RDI: 0000000000000007
[ 989.913388] RBP: 00007ffce9964ab0 R08: 0000000000000000 R09: 0000000000000000
[ 989.922195] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f90816fb390
[ 989.931000] R13: 000055e3fb739fe0 R14: 0000000000000007 R15: 0000000000000003
[ 989.939823]
[ 989.943120] INFO: task python3:5828 is blocked on a mutex likely owned by task python3:3768.
[ 989.953390] task:python3 state:D stack:25672 pid:3768 tgid:3768 ppid:3767 task_flags:0x400100 flags:0x00080802
[ 989.966590] Call Trace:
[ 989.970130]
[ 989.973278] __schedule+0xcba/0x1940
[ 989.978087] ? io_schedule_timeout+0x140/0x140
[ 989.983871] ? find_held_lock+0x2b/0x80
[ 989.988973] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.995150] schedule+0xd4/0x260
[ 989.999568] schedule_timeout+0x13f/0x290
[ 990.004861] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.011227] ? trace_contention_end+0xb3/0x1a0
[ 990.017009] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.022699] ? ww_mutex_lock+0x160/0x160
[ 990.027895] msleep+0x1b/0x30
[ 990.032018] napi_set_threaded+0x3a5/0x440
[ 990.037414] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.042908] netif_set_threaded+0x257/0x400
[ 990.048399] threaded_store+0x1b8/0x220
[ 990.053501] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.058797] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.064094] ? sysfs_kf_write+0x65/0x160
[ 990.069295] ? sysfs_file_ops+0x140/0x140
[ 990.074582] kernfs_fop_write_iter+0x335/0x510
[ 990.080367] ? kernfs_ops+0xf0/0xf0
[ 990.085069] new_sync_write+0x333/0x750
[ 990.090172] ? __lock_acquire+0x508/0xc10
[ 990.095463] ? new_sync_read+0x740/0x740
[ 990.100662] ? lock_acquire.part.0+0xbc/0x260
[ 990.106346] ? ksys_write+0x116/0x250
[ 990.111255] vfs_write+0x657/0x9b0
[ 990.115869] ksys_write+0x116/0x250
[ 990.120581] ? __ia32_sys_read+0xc0/0xc0
[ 990.125779] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.131368] ? rcu_is_watching+0x15/0xd0
[ 990.136568] do_syscall_64+0xf3/0x650
[ 990.141474] ? trace_hardirqs_off+0xd/0x30
[ 990.146866] ? exc_page_fault+0xda/0xf0
[ 990.151965] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.158432] RIP: 0033:0x7ff616b3c22e
[ 990.163238] RSP: 002b:00007fff9bf91590 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.172532] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff616b3c22e
[ 990.181340] RDX: 0000000000000001 RSI: 000055b0029b8fe0 RDI: 0000000000000007
[ 990.190141] RBP: 00007fff9bf915a0 R08: 0000000000000000 R09: 0000000000000000
[ 990.198948] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff6169b4390
[ 990.207755] R13: 000055b0029b8fe0 R14: 0000000000000007 R15: 0000000000000003
[ 990.216567]
[ 990.219826] \x0aShowing all locks held in the system:
[ 990.228365] 1 lock held by khungtaskd/186:
[ 990.233758] #0: ffffffff87afdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.245231] 3 locks held by systemd-journal/806:
[ 990.251207] #0: ff1100180e1372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.261096] #1: ffffffff87d032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.273911] #2: ff110001a7a878e0 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.285473] 4 locks held by python3/3768:
[ 990.290767] #0: ff110001305b13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.300656] #1: ff110001761e1a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.311614] #2: ff1100012396cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.322769] #3: ff11000123a49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.332867] 4 locks held by python3/5828:
[ 990.338160] #0: ff110001305b13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.348044] #1: ff11000108c86280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.359007] #2: ff1100012396cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.370164] #3: ff11000123a49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.380241]
[ 990.382707] =============================================\x0a
[ 1112.541767] INFO: task python3:5828 blocked for more than 245 seconds.
[ 1112.549918] Not tainted 7.1.0-rc2-bawb-gbd4b102d97d1 #1
[ 1112.557170] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.566758] task:python3 state:D stack:25672 pid:5828 tgid:5828 ppid:5827 task_flags:0x400100 flags:0x00080000
[ 1112.579962] Call Trace:
[ 1112.583503]
[ 1112.586655] __schedule+0xcba/0x1940
[ 1112.591473] ? io_schedule_timeout+0x140/0x140
[ 1112.597259] ? find_held_lock+0x2b/0x80
[ 1112.602363] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.608248] schedule+0xd4/0x260
[ 1112.612665] schedule_preempt_disabled+0x18/0x30
[ 1112.618643] __mutex_lock+0x6a3/0x2000
[ 1112.623647] ? threaded_store+0x132/0x220
[ 1112.628947] ? ww_mutex_lock+0x160/0x160
[ 1112.634138] ? selinux_inode_free_security+0x330/0x330
[ 1112.640709] ? cap_capable+0x1d6/0x3e0
[ 1112.645719] ? threaded_store+0x132/0x220
[ 1112.651017] threaded_store+0x132/0x220
[ 1112.656109] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.661407] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.666707] ? sysfs_kf_write+0x65/0x160
[ 1112.671912] ? sysfs_file_ops+0x140/0x140
[ 1112.677209] kernfs_fop_write_iter+0x335/0x510
[ 1112.682983] ? kernfs_ops+0xf0/0xf0
[ 1112.687696] new_sync_write+0x333/0x750
[ 1112.692802] ? __lock_acquire+0x508/0xc10
[ 1112.698099] ? new_sync_read+0x740/0x740
[ 1112.703293] ? lock_acquire.part.0+0xbc/0x260
[ 1112.708981] ? ksys_write+0x116/0x250
[ 1112.713891] vfs_write+0x657/0x9b0
[ 1112.718509] ksys_write+0x116/0x250
[ 1112.723223] ? __ia32_sys_read+0xc0/0xc0
[ 1112.728421] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.734009] ? rcu_is_watching+0x15/0xd0
[ 1112.739211] do_syscall_64+0xf3/0x650
[ 1112.744117] ? trace_hardirqs_off+0xd/0x30
[ 1112.749513] ? exc_page_fault+0xda/0xf0
[ 1112.754616] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.761083] RIP: 0033:0x7f908188322e
[ 1112.765896] RSP: 002b:00007ffce9964aa0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.775195] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f908188322e
[ 1112.784006] RDX: 0000000000000001 RSI: 000055e3fb739fe0 RDI: 0000000000000007
[ 1112.792812] RBP: 00007ffce9964ab0 R08: 0000000000000000 R09: 0000000000000000
[ 1112.801624] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f90816fb390
[ 1112.810433] R13: 000055e3fb739fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.819247]
[ 1112.822529] INFO: task python3:5828 is blocked on a mutex likely owned by task python3:3768.
[ 1112.832800] task:python3 state:D stack:25672 pid:3768 tgid:3768 ppid:3767 task_flags:0x400100 flags:0x00080802
[ 1112.846005] Call Trace:
[ 1112.849543]
[ 1112.852696] __schedule+0xcba/0x1940
[ 1112.857505] ? io_schedule_timeout+0x140/0x140
[ 1112.863289] ? find_held_lock+0x2b/0x80
[ 1112.868395] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.874573] schedule+0xd4/0x260
[ 1112.878992] schedule_timeout+0x13f/0x290
[ 1112.884289] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.890650] ? trace_contention_end+0xb3/0x1a0
[ 1112.896426] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.902118] ? ww_mutex_lock+0x160/0x160
[ 1112.907320] msleep+0x1b/0x30
[ 1112.911446] napi_set_threaded+0x3a5/0x440
[ 1112.916845] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.922340] netif_set_threaded+0x257/0x400
[ 1112.927835] threaded_store+0x1b8/0x220
[ 1112.932937] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.938235] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.943530] ? sysfs_kf_write+0x65/0x160
[ 1112.948731] ? sysfs_file_ops+0x140/0x140
[ 1112.954019] kernfs_fop_write_iter+0x335/0x510
[ 1112.959804] ? kernfs_ops+0xf0/0xf0
[ 1112.964506] new_sync_write+0x333/0x750
[ 1112.969612] ? __lock_acquire+0x508/0xc10
[ 1112.974908] ? new_sync_read+0x740/0x740
[ 1112.980111] ? lock_acquire.part.0+0xbc/0x260
[ 1112.985798] ? ksys_write+0x116/0x250
[ 1112.990709] vfs_write+0x657/0x9b0
[ 1112.995326] ksys_write+0x116/0x250
[ 1113.000040] ? __ia32_sys_read+0xc0/0xc0
[ 1113.005242] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.010831] ? rcu_is_watching+0x15/0xd0
[ 1113.016030] do_syscall_64+0xf3/0x650
[ 1113.020938] ? trace_hardirqs_off+0xd/0x30
[ 1113.026330] ? exc_page_fault+0xda/0xf0
[ 1113.031432] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.037902] RIP: 0033:0x7ff616b3c22e
[ 1113.042713] RSP: 002b:00007fff9bf91590 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.052010] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff616b3c22e
[ 1113.060816] RDX: 0000000000000001 RSI: 000055b0029b8fe0 RDI: 0000000000000007
[ 1113.069625] RBP: 00007fff9bf915a0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.078435] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff6169b4390
[ 1113.087244] R13: 000055b0029b8fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.096059]
[ 1113.099319] \x0aShowing all locks held in the system:
[ 1113.107857] 1 lock held by khungtaskd/186:
[ 1113.113249] #0: ffffffff87afdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.124732] 4 locks held by python3/3768:
[ 1113.130028] #0: ff110001305b13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.139921] #1: ff110001761e1a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.150882] #2: ff1100012396cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.162039] #3: ff11000123a49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.172134] 4 locks held by python3/5828:
[ 1113.177432] #0: ff110001305b13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.187313] #1: ff11000108c86280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.198266] #2: ff1100012396cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.209423] #3: ff11000123a49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.219514]
[ 1113.221982] =============================================\x0a
[ 1235.422936] INFO: task python3:5828 blocked for more than 368 seconds.
[ 1235.431085] Not tainted 7.1.0-rc2-bawb-gbd4b102d97d1 #1
[ 1235.438338] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.447929] task:python3 state:D stack:25672 pid:5828 tgid:5828 ppid:5827 task_flags:0x400100 flags:0x00080002
[ 1235.461136] Call Trace:
[ 1235.464674]
[ 1235.467822] __schedule+0xcba/0x1940
[ 1235.472636] ? io_schedule_timeout+0x140/0x140
[ 1235.478422] ? find_held_lock+0x2b/0x80
[ 1235.483525] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.489408] schedule+0xd4/0x260
[ 1235.493815] schedule_preempt_disabled+0x18/0x30
[ 1235.499792] __mutex_lock+0x6a3/0x2000
[ 1235.504795] ? threaded_store+0x132/0x220
[ 1235.510094] ? ww_mutex_lock+0x160/0x160
[ 1235.515292] ? selinux_inode_free_security+0x330/0x330
[ 1235.521862] ? cap_capable+0x1d6/0x3e0
[ 1235.526872] ? threaded_store+0x132/0x220
[ 1235.532166] threaded_store+0x132/0x220
[ 1235.537268] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.542566] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.547864] ? sysfs_kf_write+0x65/0x160
[ 1235.553060] ? sysfs_file_ops+0x140/0x140
[ 1235.558353] kernfs_fop_write_iter+0x335/0x510
[ 1235.564134] ? kernfs_ops+0xf0/0xf0
[ 1235.568843] new_sync_write+0x333/0x750
[ 1235.573943] ? __lock_acquire+0x508/0xc10
[ 1235.579240] ? new_sync_read+0x740/0x740
[ 1235.584438] ? lock_acquire.part.0+0xbc/0x260
[ 1235.590124] ? ksys_write+0x116/0x250
[ 1235.595035] vfs_write+0x657/0x9b0
[ 1235.599647] ksys_write+0x116/0x250
[ 1235.604356] ? __ia32_sys_read+0xc0/0xc0
[ 1235.609553] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.615141] ? rcu_is_watching+0x15/0xd0
[ 1235.620342] do_syscall_64+0xf3/0x650
[ 1235.625247] ? trace_hardirqs_off+0xd/0x30
[ 1235.630639] ? exc_page_fault+0xda/0xf0
[ 1235.635741] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.642208] RIP: 0033:0x7f908188322e
[ 1235.647007] RSP: 002b:00007ffce9964aa0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.656305] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f908188322e
[ 1235.665112] RDX: 0000000000000001 RSI: 000055e3fb739fe0 RDI: 0000000000000007
[ 1235.673917] RBP: 00007ffce9964ab0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.682725] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f90816fb390
[ 1235.691522] R13: 000055e3fb739fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.700333]
[ 1235.703649] INFO: task python3:5828 is blocked on a mutex likely owned by task python3:3768.
[ 1235.713920] task:python3 state:D stack:25672 pid:3768 tgid:3768 ppid:3767 task_flags:0x400100 flags:0x00080802
[ 1235.727121] Call Trace:
[ 1235.730659]
[ 1235.733807] __schedule+0xcba/0x1940
[ 1235.738616] ? io_schedule_timeout+0x140/0x140
[ 1235.744402] ? find_held_lock+0x2b/0x80
[ 1235.749504] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.755672] schedule+0xd4/0x260
[ 1235.760091] schedule_timeout+0x13f/0x290
[ 1235.765389] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.771759] ? trace_contention_end+0xb3/0x1a0
[ 1235.777544] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.783233] ? ww_mutex_lock+0x160/0x160
[ 1235.788430] msleep+0x1b/0x30
[ 1235.792552] napi_set_threaded+0x3a5/0x440
[ 1235.797948] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.803443] netif_set_threaded+0x257/0x400
[ 1235.808937] threaded_store+0x1b8/0x220
[ 1235.814040] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.819326] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.824621] ? sysfs_kf_write+0x65/0x160
[ 1235.829821] ? sysfs_file_ops+0x140/0x140
[ 1235.835107] kernfs_fop_write_iter+0x335/0x510
[ 1235.840891] ? kernfs_ops+0xf0/0xf0
[ 1235.845599] new_sync_write+0x333/0x750
[ 1235.850699] ? __lock_acquire+0x508/0xc10
[ 1235.855995] ? new_sync_read+0x740/0x740
[ 1235.861192] ? lock_acquire.part.0+0xbc/0x260
[ 1235.866877] ? ksys_write+0x116/0x250
[ 1235.871788] vfs_write+0x657/0x9b0
[ 1235.876404] ksys_write+0x116/0x250
[ 1235.881106] ? __ia32_sys_read+0xc0/0xc0
[ 1235.886305] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.891894] ? rcu_is_watching+0x15/0xd0
[ 1235.897092] do_syscall_64+0xf3/0x650
[ 1235.901998] ? trace_hardirqs_off+0xd/0x30
[ 1235.907384] ? exc_page_fault+0xda/0xf0
[ 1235.912483] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.918950] RIP: 0033:0x7ff616b3c22e
[ 1235.923748] RSP: 002b:00007fff9bf91590 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.933044] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff616b3c22e
[ 1235.941848] RDX: 0000000000000001 RSI: 000055b0029b8fe0 RDI: 0000000000000007
[ 1235.950657] RBP: 00007fff9bf915a0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.959462] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff6169b4390
[ 1235.968269] R13: 000055b0029b8fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.977082]
[ 1235.980349] \x0aShowing all locks held in the system:
[ 1235.988890] 1 lock held by khungtaskd/186:
[ 1235.994284] #0: ffffffff87afdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.005770] 4 locks held by python3/3768:
[ 1236.011066] #0: ff110001305b13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.020957] #1: ff110001761e1a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.031916] #2: ff1100012396cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.043071] #3: ff11000123a49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.053172] 4 locks held by python3/5828:
[ 1236.058465] #0: ff110001305b13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.068353] #1: ff11000108c86280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.079312] #2: ff1100012396cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.090470] #3: ff11000123a49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.100560]
[ 1236.103025] =============================================\x0a
[ 1358.305118] INFO: task python3:5828 blocked for more than 491 seconds.
[ 1358.313263] Not tainted 7.1.0-rc2-bawb-gbd4b102d97d1 #1
[ 1358.320514] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.330103] task:python3 state:D stack:25672 pid:5828 tgid:5828 ppid:5827 task_flags:0x400100 flags:0x00080002
[ 1358.343313] Call Trace:
[ 1358.346854]
[ 1358.350008] __schedule+0xcba/0x1940
[ 1358.354823] ? io_schedule_timeout+0x140/0x140
[ 1358.360611] ? find_held_lock+0x2b/0x80
[ 1358.365719] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.371602] schedule+0xd4/0x260
[ 1358.376011] schedule_preempt_disabled+0x18/0x30
[ 1358.381989] __mutex_lock+0x6a3/0x2000
[ 1358.386992] ? threaded_store+0x132/0x220
[ 1358.392292] ? ww_mutex_lock+0x160/0x160
[ 1358.397483] ? selinux_inode_free_security+0x330/0x330
[ 1358.404052] ? cap_capable+0x1d6/0x3e0
[ 1358.409063] ? threaded_store+0x132/0x220
[ 1358.414363] threaded_store+0x132/0x220
[ 1358.419465] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.424758] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.430059] ? sysfs_kf_write+0x65/0x160
[ 1358.435257] ? sysfs_file_ops+0x140/0x140
[ 1358.440551] kernfs_fop_write_iter+0x335/0x510
[ 1358.446335] ? kernfs_ops+0xf0/0xf0
[ 1358.451049] new_sync_write+0x333/0x750
[ 1358.456154] ? __lock_acquire+0x508/0xc10
[ 1358.461450] ? new_sync_read+0x740/0x740
[ 1358.466654] ? lock_acquire.part.0+0xbc/0x260
[ 1358.472342] ? ksys_write+0x116/0x250
[ 1358.477253] vfs_write+0x657/0x9b0
[ 1358.481868] ksys_write+0x116/0x250
[ 1358.486581] ? __ia32_sys_read+0xc0/0xc0
[ 1358.491780] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.497371] ? rcu_is_watching+0x15/0xd0
[ 1358.502573] do_syscall_64+0xf3/0x650
[ 1358.507477] ? trace_hardirqs_off+0xd/0x30
[ 1358.512874] ? exc_page_fault+0xda/0xf0
[ 1358.517970] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.524437] RIP: 0033:0x7f908188322e
[ 1358.529249] RSP: 002b:00007ffce9964aa0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.538550] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f908188322e
[ 1358.547360] RDX: 0000000000000001 RSI: 000055e3fb739fe0 RDI: 0000000000000007
[ 1358.556166] RBP: 00007ffce9964ab0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.564977] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f90816fb390
[ 1358.573788] R13: 000055e3fb739fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.582602]
[ 1358.585898] INFO: task python3:5828 is blocked on a mutex likely owned by task python3:3768.
[ 1358.596169] task:python3 state:D stack:25672 pid:3768 tgid:3768 ppid:3767 task_flags:0x400100 flags:0x00080802
[ 1358.609373] Call Trace:
[ 1358.612912]
[ 1358.616065] __schedule+0xcba/0x1940
[ 1358.620878] ? io_schedule_timeout+0x140/0x140
[ 1358.626664] ? find_held_lock+0x2b/0x80
[ 1358.631768] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.637946] schedule+0xd4/0x260
[ 1358.642365] schedule_timeout+0x13f/0x290
[ 1358.647654] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.654023] ? trace_contention_end+0xb3/0x1a0
[ 1358.659807] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.665499] ? ww_mutex_lock+0x160/0x160
[ 1358.670699] msleep+0x1b/0x30
[ 1358.674825] napi_set_threaded+0x3a5/0x440
[ 1358.680220] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.685714] netif_set_threaded+0x257/0x400
[ 1358.691210] threaded_store+0x1b8/0x220
[ 1358.696313] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.701601] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.706895] ? sysfs_kf_write+0x65/0x160
[ 1358.712096] ? sysfs_file_ops+0x140/0x140
[ 1358.717393] kernfs_fop_write_iter+0x335/0x510
[ 1358.723176] ? kernfs_ops+0xf0/0xf0
[ 1358.727889] new_sync_write+0x333/0x750
[ 1358.732983] ? __lock_acquire+0x508/0xc10
[ 1358.738269] ? new_sync_read+0x740/0x740
[ 1358.743472] ? lock_acquire.part.0+0xbc/0x260
[ 1358.749158] ? ksys_write+0x116/0x250
[ 1358.754068] vfs_write+0x657/0x9b0
[ 1358.758682] ksys_write+0x116/0x250
[ 1358.763395] ? __ia32_sys_read+0xc0/0xc0
[ 1358.768593] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.774185] ? rcu_is_watching+0x15/0xd0
[ 1358.779384] do_syscall_64+0xf3/0x650
[ 1358.784290] ? trace_hardirqs_off+0xd/0x30
[ 1358.789685] ? exc_page_fault+0xda/0xf0
[ 1358.794788] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.801256] RIP: 0033:0x7ff616b3c22e
[ 1358.806067] RSP: 002b:00007fff9bf91590 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.815365] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007ff616b3c22e
[ 1358.824176] RDX: 0000000000000001 RSI: 000055b0029b8fe0 RDI: 0000000000000007
[ 1358.832984] RBP: 00007fff9bf915a0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.841792] R10: 0000000000000000 R11: 0000000000000202 R12: 00007ff6169b4390
[ 1358.850601] R13: 000055b0029b8fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.859416]
[ 1358.862683] \x0aShowing all locks held in the system:
[ 1358.871227] 1 lock held by khungtaskd/186:
[ 1358.876619] #0: ffffffff87afdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.888105] 4 locks held by python3/3768:
[ 1358.893403] #0: ff110001305b13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.903295] #1: ff110001761e1a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.914256] #2: ff1100012396cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.925412] #3: ff11000123a49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.935509] 4 locks held by python3/5828:
[ 1358.940805] #0: ff110001305b13e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.950696] #1: ff11000108c86280 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.961658] #2: ff1100012396cb50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.972816] #3: ff11000123a49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.982910]
[ 1358.985379] =============================================\x0a