[ 791.564907] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 791.568079] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 791.696011] kselftest: Running tests in drivers/net
[ 989.677862] INFO: task python3:5864 blocked for more than 122 seconds.
[ 989.686099] Not tainted 7.1.0-rc5-shpa-g158415862a4b #1
[ 989.693973] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.703564] task:python3 state:D stack:25672 pid:5864 tgid:5864 ppid:5863 task_flags:0x400100 flags:0x00080000
[ 989.716769] Call Trace:
[ 989.720306]
[ 989.723456] __schedule+0xcc3/0x19c0
[ 989.728272] ? io_schedule_timeout+0x140/0x140
[ 989.734054] ? find_held_lock+0x2b/0x80
[ 989.739157] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.745040] schedule+0xd8/0x260
[ 989.749449] schedule_preempt_disabled+0x18/0x30
[ 989.755428] __mutex_lock+0x6af/0x2010
[ 989.760433] ? threaded_store+0x132/0x220
[ 989.765731] ? ww_mutex_lock+0x160/0x160
[ 989.770928] ? selinux_inode_free_security+0x330/0x330
[ 989.777499] ? cap_capable+0x1d6/0x3e0
[ 989.782508] ? threaded_store+0x132/0x220
[ 989.787804] threaded_store+0x132/0x220
[ 989.792903] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.798199] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.803498] ? sysfs_kf_write+0x65/0x160
[ 989.808700] ? sysfs_file_ops+0x140/0x140
[ 989.813995] kernfs_fop_write_iter+0x335/0x510
[ 989.819781] ? kernfs_ops+0xf0/0xf0
[ 989.824481] new_sync_write+0x333/0x750
[ 989.829582] ? __lock_acquire+0x508/0xc10
[ 989.834875] ? new_sync_read+0x740/0x740
[ 989.840075] ? lock_acquire.part.0+0xbc/0x260
[ 989.845752] ? ksys_write+0x116/0x250
[ 989.850660] vfs_write+0x657/0x9b0
[ 989.855275] ksys_write+0x116/0x250
[ 989.859987] ? __ia32_sys_read+0xc0/0xc0
[ 989.865183] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.870769] ? rcu_is_watching+0x15/0xd0
[ 989.875969] do_syscall_64+0xf3/0x650
[ 989.880873] ? trace_hardirqs_off+0xd/0x30
[ 989.886268] ? exc_page_fault+0xda/0xf0
[ 989.891369] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.897837] RIP: 0033:0x7f83cb45e22e
[ 989.902646] RSP: 002b:00007ffc08f92350 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.911935] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f83cb45e22e
[ 989.920741] RDX: 0000000000000001 RSI: 00005585f81206b0 RDI: 0000000000000007
[ 989.929548] RBP: 00007ffc08f92360 R08: 0000000000000000 R09: 0000000000000000
[ 989.938353] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83cb2d6390
[ 989.947161] R13: 00005585f81206b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.955980]
[ 989.959309] INFO: task python3:5864 is blocked on a mutex likely owned by task python3:3822.
[ 989.969582] task:python3 state:D stack:25672 pid:3822 tgid:3822 ppid:3821 task_flags:0x400100 flags:0x00080802
[ 989.982786] Call Trace:
[ 989.986321]
[ 989.989471] __schedule+0xcc3/0x19c0
[ 989.994281] ? io_schedule_timeout+0x140/0x140
[ 990.000054] ? find_held_lock+0x2b/0x80
[ 990.005157] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.011335] schedule+0xd8/0x260
[ 990.015750] schedule_timeout+0x13f/0x290
[ 990.021045] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.027413] ? trace_contention_end+0xb3/0x1a0
[ 990.033198] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.038880] ? ww_mutex_lock+0x160/0x160
[ 990.044079] msleep+0x1b/0x30
[ 990.048204] napi_set_threaded+0x3a5/0x440
[ 990.053599] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.059091] netif_set_threaded+0x257/0x400
[ 990.064583] threaded_store+0x1b8/0x220
[ 990.069685] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.074984] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.080281] ? sysfs_kf_write+0x65/0x160
[ 990.085481] ? sysfs_file_ops+0x140/0x140
[ 990.090775] kernfs_fop_write_iter+0x335/0x510
[ 990.096561] ? kernfs_ops+0xf0/0xf0
[ 990.101270] new_sync_write+0x333/0x750
[ 990.106371] ? __lock_acquire+0x508/0xc10
[ 990.111664] ? new_sync_read+0x740/0x740
[ 990.116865] ? lock_acquire.part.0+0xbc/0x260
[ 990.122550] ? ksys_write+0x116/0x250
[ 990.127460] vfs_write+0x657/0x9b0
[ 990.132074] ksys_write+0x116/0x250
[ 990.136786] ? __ia32_sys_read+0xc0/0xc0
[ 990.141986] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.147576] ? rcu_is_watching+0x15/0xd0
[ 990.152777] do_syscall_64+0xf3/0x650
[ 990.157684] ? trace_hardirqs_off+0xd/0x30
[ 990.163078] ? exc_page_fault+0xda/0xf0
[ 990.168180] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.174643] RIP: 0033:0x7fa11697d22e
[ 990.179449] RSP: 002b:00007ffcbafec4b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.188752] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa11697d22e
[ 990.197560] RDX: 0000000000000001 RSI: 00005652725396b0 RDI: 0000000000000007
[ 990.206370] RBP: 00007ffcbafec4c0 R08: 0000000000000000 R09: 0000000000000000
[ 990.215173] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa1167f5390
[ 990.223981] R13: 00005652725396b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.232795]
[ 990.236050] \x0aShowing all locks held in the system:
[ 990.244591] 1 lock held by khungtaskd/184:
[ 990.249981] #0: ffffffffad8fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.261464] 4 locks held by python3/3822:
[ 990.266758] #0: ff1100013098c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.276645] #1: ff1100017c135c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.287604] #2: ff1100012308ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.298759] #3: ff110001231a1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.308861] 4 locks held by python3/5864:
[ 990.314153] #0: ff1100013098c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.324042] #1: ff110001060b9480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.335003] #2: ff1100012308ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.346161] #3: ff110001231a1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.356249]
[ 990.358716] =============================================\x0a
[ 1112.558196] INFO: task python3:5864 blocked for more than 245 seconds.
[ 1112.566334] Not tainted 7.1.0-rc5-shpa-g158415862a4b #1
[ 1112.573585] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.583174] task:python3 state:D stack:25672 pid:5864 tgid:5864 ppid:5863 task_flags:0x400100 flags:0x00080000
[ 1112.596371] Call Trace:
[ 1112.599912]
[ 1112.603062] __schedule+0xcc3/0x19c0
[ 1112.607878] ? io_schedule_timeout+0x140/0x140
[ 1112.613665] ? find_held_lock+0x2b/0x80
[ 1112.618770] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.624647] schedule+0xd8/0x260
[ 1112.629066] schedule_preempt_disabled+0x18/0x30
[ 1112.635045] __mutex_lock+0x6af/0x2010
[ 1112.640050] ? threaded_store+0x132/0x220
[ 1112.645350] ? ww_mutex_lock+0x160/0x160
[ 1112.650543] ? selinux_inode_free_security+0x330/0x330
[ 1112.657115] ? cap_capable+0x1d6/0x3e0
[ 1112.662130] ? threaded_store+0x132/0x220
[ 1112.667440] threaded_store+0x132/0x220
[ 1112.672545] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.677845] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.683143] ? sysfs_kf_write+0x65/0x160
[ 1112.688336] ? sysfs_file_ops+0x140/0x140
[ 1112.693635] kernfs_fop_write_iter+0x335/0x510
[ 1112.699417] ? kernfs_ops+0xf0/0xf0
[ 1112.704131] new_sync_write+0x333/0x750
[ 1112.709233] ? __lock_acquire+0x508/0xc10
[ 1112.714530] ? new_sync_read+0x740/0x740
[ 1112.719730] ? lock_acquire.part.0+0xbc/0x260
[ 1112.725418] ? ksys_write+0x116/0x250
[ 1112.730329] vfs_write+0x657/0x9b0
[ 1112.734948] ksys_write+0x116/0x250
[ 1112.739661] ? __ia32_sys_read+0xc0/0xc0
[ 1112.744860] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.750451] ? rcu_is_watching+0x15/0xd0
[ 1112.755653] do_syscall_64+0xf3/0x650
[ 1112.760558] ? trace_hardirqs_off+0xd/0x30
[ 1112.765955] ? exc_page_fault+0xda/0xf0
[ 1112.771058] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.777525] RIP: 0033:0x7f83cb45e22e
[ 1112.782337] RSP: 002b:00007ffc08f92350 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.791637] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f83cb45e22e
[ 1112.800447] RDX: 0000000000000001 RSI: 00005585f81206b0 RDI: 0000000000000007
[ 1112.809258] RBP: 00007ffc08f92360 R08: 0000000000000000 R09: 0000000000000000
[ 1112.818065] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83cb2d6390
[ 1112.826875] R13: 00005585f81206b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.835691]
[ 1112.838972] INFO: task python3:5864 is blocked on a mutex likely owned by task python3:3822.
[ 1112.849243] task:python3 state:D stack:25672 pid:3822 tgid:3822 ppid:3821 task_flags:0x400100 flags:0x00080802
[ 1112.862448] Call Trace:
[ 1112.865986]
[ 1112.869139] __schedule+0xcc3/0x19c0
[ 1112.873951] ? io_schedule_timeout+0x140/0x140
[ 1112.879737] ? find_held_lock+0x2b/0x80
[ 1112.884840] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.891016] schedule+0xd8/0x260
[ 1112.895436] schedule_timeout+0x13f/0x290
[ 1112.900725] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.907087] ? trace_contention_end+0xb3/0x1a0
[ 1112.912866] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.918554] ? ww_mutex_lock+0x160/0x160
[ 1112.923747] msleep+0x1b/0x30
[ 1112.927874] napi_set_threaded+0x3a5/0x440
[ 1112.933270] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.938764] netif_set_threaded+0x257/0x400
[ 1112.944259] threaded_store+0x1b8/0x220
[ 1112.949360] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.954660] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.959954] ? sysfs_kf_write+0x65/0x160
[ 1112.965155] ? sysfs_file_ops+0x140/0x140
[ 1112.970453] kernfs_fop_write_iter+0x335/0x510
[ 1112.976232] ? kernfs_ops+0xf0/0xf0
[ 1112.980944] new_sync_write+0x333/0x750
[ 1112.986049] ? __lock_acquire+0x508/0xc10
[ 1112.991345] ? new_sync_read+0x740/0x740
[ 1112.996547] ? lock_acquire.part.0+0xbc/0x260
[ 1113.002235] ? ksys_write+0x116/0x250
[ 1113.007145] vfs_write+0x657/0x9b0
[ 1113.011760] ksys_write+0x116/0x250
[ 1113.016474] ? __ia32_sys_read+0xc0/0xc0
[ 1113.021672] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.027260] ? rcu_is_watching+0x15/0xd0
[ 1113.032460] do_syscall_64+0xf3/0x650
[ 1113.037361] ? trace_hardirqs_off+0xd/0x30
[ 1113.042755] ? exc_page_fault+0xda/0xf0
[ 1113.047849] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.054314] RIP: 0033:0x7fa11697d22e
[ 1113.059125] RSP: 002b:00007ffcbafec4b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.068424] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa11697d22e
[ 1113.077232] RDX: 0000000000000001 RSI: 00005652725396b0 RDI: 0000000000000007
[ 1113.086038] RBP: 00007ffcbafec4c0 R08: 0000000000000000 R09: 0000000000000000
[ 1113.094845] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa1167f5390
[ 1113.103647] R13: 00005652725396b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.112461]
[ 1113.115724] \x0aShowing all locks held in the system:
[ 1113.124265] 1 lock held by khungtaskd/184:
[ 1113.129658] #0: ffffffffad8fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.141141] 4 locks held by python3/3822:
[ 1113.146436] #0: ff1100013098c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.156328] #1: ff1100017c135c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.167291] #2: ff1100012308ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.178450] #3: ff110001231a1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.188544] 4 locks held by python3/5864:
[ 1113.193841] #0: ff1100013098c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.203733] #1: ff110001060b9480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.214695] #2: ff1100012308ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.225851] #3: ff110001231a1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.235941]
[ 1113.238409] =============================================\x0a
[ 1235.440528] INFO: task python3:5864 blocked for more than 368 seconds.
[ 1235.448675] Not tainted 7.1.0-rc5-shpa-g158415862a4b #1
[ 1235.455926] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.465517] task:python3 state:D stack:25672 pid:5864 tgid:5864 ppid:5863 task_flags:0x400100 flags:0x00080002
[ 1235.478723] Call Trace:
[ 1235.482265]
[ 1235.485420] __schedule+0xcc3/0x19c0
[ 1235.490237] ? io_schedule_timeout+0x140/0x140
[ 1235.496026] ? find_held_lock+0x2b/0x80
[ 1235.501130] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.507006] schedule+0xd8/0x260
[ 1235.511424] schedule_preempt_disabled+0x18/0x30
[ 1235.517403] __mutex_lock+0x6af/0x2010
[ 1235.522409] ? threaded_store+0x132/0x220
[ 1235.527708] ? ww_mutex_lock+0x160/0x160
[ 1235.532899] ? selinux_inode_free_security+0x330/0x330
[ 1235.539471] ? cap_capable+0x1d6/0x3e0
[ 1235.544481] ? threaded_store+0x132/0x220
[ 1235.549781] threaded_store+0x132/0x220
[ 1235.554882] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.560181] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.565482] ? sysfs_kf_write+0x65/0x160
[ 1235.570685] ? sysfs_file_ops+0x140/0x140
[ 1235.575980] kernfs_fop_write_iter+0x335/0x510
[ 1235.581764] ? kernfs_ops+0xf0/0xf0
[ 1235.586477] new_sync_write+0x333/0x750
[ 1235.591581] ? __lock_acquire+0x508/0xc10
[ 1235.596878] ? new_sync_read+0x740/0x740
[ 1235.602081] ? lock_acquire.part.0+0xbc/0x260
[ 1235.607769] ? ksys_write+0x116/0x250
[ 1235.612678] vfs_write+0x657/0x9b0
[ 1235.617296] ksys_write+0x116/0x250
[ 1235.622009] ? __ia32_sys_read+0xc0/0xc0
[ 1235.627198] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.632789] ? rcu_is_watching+0x15/0xd0
[ 1235.637990] do_syscall_64+0xf3/0x650
[ 1235.642895] ? trace_hardirqs_off+0xd/0x30
[ 1235.648292] ? exc_page_fault+0xda/0xf0
[ 1235.653395] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.659862] RIP: 0033:0x7f83cb45e22e
[ 1235.664664] RSP: 002b:00007ffc08f92350 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.673964] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f83cb45e22e
[ 1235.682774] RDX: 0000000000000001 RSI: 00005585f81206b0 RDI: 0000000000000007
[ 1235.691580] RBP: 00007ffc08f92360 R08: 0000000000000000 R09: 0000000000000000
[ 1235.700391] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83cb2d6390
[ 1235.709202] R13: 00005585f81206b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.718019]
[ 1235.721299] INFO: task python3:5864 is blocked on a mutex likely owned by task python3:3822.
[ 1235.731572] task:python3 state:D stack:25672 pid:3822 tgid:3822 ppid:3821 task_flags:0x400100 flags:0x00080802
[ 1235.744773] Call Trace:
[ 1235.748312]
[ 1235.751465] __schedule+0xcc3/0x19c0
[ 1235.756277] ? io_schedule_timeout+0x140/0x140
[ 1235.762065] ? find_held_lock+0x2b/0x80
[ 1235.767171] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.773349] schedule+0xd8/0x260
[ 1235.777774] schedule_timeout+0x13f/0x290
[ 1235.783071] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.789433] ? trace_contention_end+0xb3/0x1a0
[ 1235.795216] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.800909] ? ww_mutex_lock+0x160/0x160
[ 1235.806110] msleep+0x1b/0x30
[ 1235.810236] napi_set_threaded+0x3a5/0x440
[ 1235.815635] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.821132] netif_set_threaded+0x257/0x400
[ 1235.826626] threaded_store+0x1b8/0x220
[ 1235.831728] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.837026] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.842326] ? sysfs_kf_write+0x65/0x160
[ 1235.847526] ? sysfs_file_ops+0x140/0x140
[ 1235.852824] kernfs_fop_write_iter+0x335/0x510
[ 1235.858610] ? kernfs_ops+0xf0/0xf0
[ 1235.863323] new_sync_write+0x333/0x750
[ 1235.868418] ? __lock_acquire+0x508/0xc10
[ 1235.873714] ? new_sync_read+0x740/0x740
[ 1235.878916] ? lock_acquire.part.0+0xbc/0x260
[ 1235.884603] ? ksys_write+0x116/0x250
[ 1235.889502] vfs_write+0x657/0x9b0
[ 1235.894120] ksys_write+0x116/0x250
[ 1235.898833] ? __ia32_sys_read+0xc0/0xc0
[ 1235.904026] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.909617] ? rcu_is_watching+0x15/0xd0
[ 1235.914816] do_syscall_64+0xf3/0x650
[ 1235.919725] ? trace_hardirqs_off+0xd/0x30
[ 1235.925120] ? exc_page_fault+0xda/0xf0
[ 1235.930222] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.936691] RIP: 0033:0x7fa11697d22e
[ 1235.941501] RSP: 002b:00007ffcbafec4b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.950798] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa11697d22e
[ 1235.959598] RDX: 0000000000000001 RSI: 00005652725396b0 RDI: 0000000000000007
[ 1235.968409] RBP: 00007ffcbafec4c0 R08: 0000000000000000 R09: 0000000000000000
[ 1235.977219] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa1167f5390
[ 1235.986028] R13: 00005652725396b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.994842]
[ 1235.998109] \x0aShowing all locks held in the system:
[ 1236.006649] 1 lock held by khungtaskd/184:
[ 1236.012042] #0: ffffffffad8fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.023517] 2 locks held by systemd-journal/806:
[ 1236.029498] #0: ff1100180e5372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.039386] #1: ffffffffadb02c20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.052213] 4 locks held by python3/3822:
[ 1236.057510] #0: ff1100013098c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.067392] #1: ff1100017c135c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.078347] #2: ff1100012308ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.089507] #3: ff110001231a1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.099604] 4 locks held by python3/5864:
[ 1236.104900] #0: ff1100013098c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.114791] #1: ff110001060b9480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.125755] #2: ff1100012308ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.136913] #3: ff110001231a1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.147004]
[ 1236.149470] =============================================\x0a
[ 1358.321848] INFO: task python3:5864 blocked for more than 491 seconds.
[ 1358.329999] Not tainted 7.1.0-rc5-shpa-g158415862a4b #1
[ 1358.337251] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.346841] task:python3 state:D stack:25672 pid:5864 tgid:5864 ppid:5863 task_flags:0x400100 flags:0x00080002
[ 1358.360047] Call Trace:
[ 1358.363588]
[ 1358.366738] __schedule+0xcc3/0x19c0
[ 1358.371558] ? io_schedule_timeout+0x140/0x140
[ 1358.377346] ? find_held_lock+0x2b/0x80
[ 1358.382452] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.388338] schedule+0xd8/0x260
[ 1358.392757] schedule_preempt_disabled+0x18/0x30
[ 1358.398735] __mutex_lock+0x6af/0x2010
[ 1358.403739] ? threaded_store+0x132/0x220
[ 1358.409039] ? ww_mutex_lock+0x160/0x160
[ 1358.414239] ? selinux_inode_free_security+0x330/0x330
[ 1358.420810] ? cap_capable+0x1d6/0x3e0
[ 1358.425821] ? threaded_store+0x132/0x220
[ 1358.431119] threaded_store+0x132/0x220
[ 1358.436222] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.441524] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.446823] ? sysfs_kf_write+0x65/0x160
[ 1358.452026] ? sysfs_file_ops+0x140/0x140
[ 1358.457323] kernfs_fop_write_iter+0x335/0x510
[ 1358.463102] ? kernfs_ops+0xf0/0xf0
[ 1358.467814] new_sync_write+0x333/0x750
[ 1358.472920] ? __lock_acquire+0x508/0xc10
[ 1358.478216] ? new_sync_read+0x740/0x740
[ 1358.483419] ? lock_acquire.part.0+0xbc/0x260
[ 1358.489106] ? ksys_write+0x116/0x250
[ 1358.494016] vfs_write+0x657/0x9b0
[ 1358.498634] ksys_write+0x116/0x250
[ 1358.503349] ? __ia32_sys_read+0xc0/0xc0
[ 1358.508550] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.514141] ? rcu_is_watching+0x15/0xd0
[ 1358.519343] do_syscall_64+0xf3/0x650
[ 1358.524252] ? trace_hardirqs_off+0xd/0x30
[ 1358.529648] ? exc_page_fault+0xda/0xf0
[ 1358.534751] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.541222] RIP: 0033:0x7f83cb45e22e
[ 1358.546033] RSP: 002b:00007ffc08f92350 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.555332] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f83cb45e22e
[ 1358.564141] RDX: 0000000000000001 RSI: 00005585f81206b0 RDI: 0000000000000007
[ 1358.572942] RBP: 00007ffc08f92360 R08: 0000000000000000 R09: 0000000000000000
[ 1358.581752] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f83cb2d6390
[ 1358.590562] R13: 00005585f81206b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.599374]
[ 1358.602670] INFO: task python3:5864 is blocked on a mutex likely owned by task python3:3822.
[ 1358.612947] task:python3 state:D stack:25672 pid:3822 tgid:3822 ppid:3821 task_flags:0x400100 flags:0x00080802
[ 1358.626149] Call Trace:
[ 1358.629691]
[ 1358.632844] __schedule+0xcc3/0x19c0
[ 1358.637657] ? io_schedule_timeout+0x140/0x140
[ 1358.643443] ? find_held_lock+0x2b/0x80
[ 1358.648547] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.654727] schedule+0xd8/0x260
[ 1358.659145] schedule_timeout+0x13f/0x290
[ 1358.664442] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.670810] ? trace_contention_end+0xb3/0x1a0
[ 1358.676598] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.682289] ? ww_mutex_lock+0x160/0x160
[ 1358.687488] msleep+0x1b/0x30
[ 1358.691613] napi_set_threaded+0x3a5/0x440
[ 1358.697010] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.702508] netif_set_threaded+0x257/0x400
[ 1358.708000] threaded_store+0x1b8/0x220
[ 1358.713096] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.718393] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.723695] ? sysfs_kf_write+0x65/0x160
[ 1358.728895] ? sysfs_file_ops+0x140/0x140
[ 1358.734192] kernfs_fop_write_iter+0x335/0x510
[ 1358.739978] ? kernfs_ops+0xf0/0xf0
[ 1358.744694] new_sync_write+0x333/0x750
[ 1358.749798] ? __lock_acquire+0x508/0xc10
[ 1358.755096] ? new_sync_read+0x740/0x740
[ 1358.760296] ? lock_acquire.part.0+0xbc/0x260
[ 1358.765976] ? ksys_write+0x116/0x250
[ 1358.770886] vfs_write+0x657/0x9b0
[ 1358.775502] ksys_write+0x116/0x250
[ 1358.780214] ? __ia32_sys_read+0xc0/0xc0
[ 1358.785406] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.790988] ? rcu_is_watching+0x15/0xd0
[ 1358.796191] do_syscall_64+0xf3/0x650
[ 1358.801100] ? trace_hardirqs_off+0xd/0x30
[ 1358.806494] ? exc_page_fault+0xda/0xf0
[ 1358.811595] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.818062] RIP: 0033:0x7fa11697d22e
[ 1358.822871] RSP: 002b:00007ffcbafec4b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.832160] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa11697d22e
[ 1358.840973] RDX: 0000000000000001 RSI: 00005652725396b0 RDI: 0000000000000007
[ 1358.849782] RBP: 00007ffcbafec4c0 R08: 0000000000000000 R09: 0000000000000000
[ 1358.858592] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa1167f5390
[ 1358.867401] R13: 00005652725396b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.876204]
[ 1358.879473] \x0aShowing all locks held in the system:
[ 1358.888013] 1 lock held by khungtaskd/184:
[ 1358.893409] #0: ffffffffad8fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.904896] 4 locks held by python3/3822:
[ 1358.910192] #0: ff1100013098c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.920084] #1: ff1100017c135c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.931044] #2: ff1100012308ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.942199] #3: ff110001231a1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.952293] 4 locks held by python3/5864:
[ 1358.957589] #0: ff1100013098c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.967478] #1: ff110001060b9480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.978438] #2: ff1100012308ab50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.989596] #3: ff110001231a1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.999696]
[ 1359.002162] =============================================\x0a