[ 781.208961] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 781.211922] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 781.339189] kselftest: Running tests in drivers/net
[ 989.681739] INFO: task python3:5691 blocked for more than 122 seconds.
[ 989.689971] Not tainted 7.1.0-rc2-izpd-g50ebd7b3c8a3 #1
[ 989.697945] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.707536] task:python3 state:D stack:25672 pid:5691 tgid:5691 ppid:5690 task_flags:0x400100 flags:0x00080000
[ 989.720745] Call Trace:
[ 989.724285]
[ 989.727439] __schedule+0xcba/0x1940
[ 989.732257] ? io_schedule_timeout+0x140/0x140
[ 989.738042] ? find_held_lock+0x2b/0x80
[ 989.743149] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.749032] schedule+0xd4/0x260
[ 989.753444] schedule_preempt_disabled+0x18/0x30
[ 989.759424] __mutex_lock+0x6a3/0x2000
[ 989.764430] ? threaded_store+0x132/0x220
[ 989.769731] ? ww_mutex_lock+0x160/0x160
[ 989.774931] ? selinux_inode_free_security+0x330/0x330
[ 989.781500] ? cap_capable+0x1d6/0x3e0
[ 989.786507] ? threaded_store+0x132/0x220
[ 989.791804] threaded_store+0x132/0x220
[ 989.796904] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.802204] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.807507] ? sysfs_kf_write+0x65/0x160
[ 989.812707] ? sysfs_file_ops+0x140/0x140
[ 989.818003] kernfs_fop_write_iter+0x335/0x510
[ 989.823790] ? kernfs_ops+0xf0/0xf0
[ 989.828501] new_sync_write+0x333/0x750
[ 989.833605] ? __lock_acquire+0x508/0xc10
[ 989.838892] ? new_sync_read+0x740/0x740
[ 989.844094] ? lock_acquire.part.0+0xbc/0x260
[ 989.849781] ? ksys_write+0x116/0x250
[ 989.854690] vfs_write+0x657/0x9b0
[ 989.859306] ksys_write+0x116/0x250
[ 989.864019] ? __ia32_sys_read+0xc0/0xc0
[ 989.869210] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.874792] ? rcu_is_watching+0x15/0xd0
[ 989.879992] do_syscall_64+0xf3/0x650
[ 989.884892] ? trace_hardirqs_off+0xd/0x30
[ 989.890287] ? exc_page_fault+0xda/0xf0
[ 989.895389] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.901859] RIP: 0033:0x7f15829cf22e
[ 989.906670] RSP: 002b:00007ffda5b15300 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.915967] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f15829cf22e
[ 989.924777] RDX: 0000000000000001 RSI: 0000555f8d89ffe0 RDI: 0000000000000007
[ 989.933587] RBP: 00007ffda5b15310 R08: 0000000000000000 R09: 0000000000000000
[ 989.942397] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1582847390
[ 989.951204] R13: 0000555f8d89ffe0 R14: 0000000000000007 R15: 0000000000000003
[ 989.960018]
[ 989.963314] INFO: task python3:5691 is blocked on a mutex likely owned by task python3:3646.
[ 989.973589] task:python3 state:D stack:25672 pid:3646 tgid:3646 ppid:3645 task_flags:0x400100 flags:0x00080802
[ 989.986792] Call Trace:
[ 989.990330]
[ 989.993480] __schedule+0xcba/0x1940
[ 989.998293] ? io_schedule_timeout+0x140/0x140
[ 990.004076] ? find_held_lock+0x2b/0x80
[ 990.009180] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.015359] schedule+0xd4/0x260
[ 990.019776] schedule_timeout+0x13f/0x290
[ 990.025073] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.031442] ? trace_contention_end+0xb3/0x1a0
[ 990.037228] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.042920] ? ww_mutex_lock+0x160/0x160
[ 990.048120] msleep+0x1b/0x30
[ 990.052247] napi_set_threaded+0x3a5/0x440
[ 990.057644] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.063140] netif_set_threaded+0x257/0x400
[ 990.068633] threaded_store+0x1b8/0x220
[ 990.073728] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.079024] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.084323] ? sysfs_kf_write+0x65/0x160
[ 990.089522] ? sysfs_file_ops+0x140/0x140
[ 990.094817] kernfs_fop_write_iter+0x335/0x510
[ 990.100603] ? kernfs_ops+0xf0/0xf0
[ 990.105313] new_sync_write+0x333/0x750
[ 990.110415] ? __lock_acquire+0x508/0xc10
[ 990.115714] ? new_sync_read+0x740/0x740
[ 990.120914] ? lock_acquire.part.0+0xbc/0x260
[ 990.126600] ? ksys_write+0x116/0x250
[ 990.131509] vfs_write+0x657/0x9b0
[ 990.136125] ksys_write+0x116/0x250
[ 990.140839] ? __ia32_sys_read+0xc0/0xc0
[ 990.146040] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.151630] ? rcu_is_watching+0x15/0xd0
[ 990.156824] do_syscall_64+0xf3/0x650
[ 990.161732] ? trace_hardirqs_off+0xd/0x30
[ 990.167127] ? exc_page_fault+0xda/0xf0
[ 990.172227] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.178696] RIP: 0033:0x7f45f670222e
[ 990.183504] RSP: 002b:00007fff1fe04530 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.192801] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f45f670222e
[ 990.201609] RDX: 0000000000000001 RSI: 0000558e4ebf9fe0 RDI: 0000000000000007
[ 990.210409] RBP: 00007fff1fe04540 R08: 0000000000000000 R09: 0000000000000000
[ 990.219217] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f45f657a390
[ 990.228015] R13: 0000558e4ebf9fe0 R14: 0000000000000007 R15: 0000000000000003
[ 990.236828]
[ 990.240089] \x0aShowing all locks held in the system:
[ 990.248630] 1 lock held by khungtaskd/185:
[ 990.254022] #0: ffffffffa0efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.265498] 2 locks held by systemd-journal/803:
[ 990.271476] #0: ff1100180dcb72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.281367] #1: ffffffffa11032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.294193] 4 locks held by python3/3646:
[ 990.299488] #0: ff110001302cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.309379] #1: ff1100014de96e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.320342] #2: ff110017d90a4b50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.331498] #3: ff110017d9109d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.341597] 4 locks held by python3/5691:
[ 990.346883] #0: ff110001302cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.356773] #1: ff110001b6b83880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.367737] #2: ff110017d90a4b50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.378894] #3: ff110017d9109d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.388980]
[ 990.391445] =============================================\x0a
[ 1112.562949] INFO: task python3:5691 blocked for more than 245 seconds.
[ 1112.571094] Not tainted 7.1.0-rc2-izpd-g50ebd7b3c8a3 #1
[ 1112.578347] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.587956] task:python3 state:D stack:25672 pid:5691 tgid:5691 ppid:5690 task_flags:0x400100 flags:0x00080000
[ 1112.601184] Call Trace:
[ 1112.604734]
[ 1112.607892] __schedule+0xcba/0x1940
[ 1112.612713] ? io_schedule_timeout+0x140/0x140
[ 1112.618502] ? find_held_lock+0x2b/0x80
[ 1112.623610] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.629505] schedule+0xd4/0x260
[ 1112.633928] schedule_preempt_disabled+0x18/0x30
[ 1112.639912] __mutex_lock+0x6a3/0x2000
[ 1112.644919] ? threaded_store+0x132/0x220
[ 1112.650225] ? ww_mutex_lock+0x160/0x160
[ 1112.655429] ? selinux_inode_free_security+0x330/0x330
[ 1112.662009] ? cap_capable+0x1d6/0x3e0
[ 1112.667021] ? threaded_store+0x132/0x220
[ 1112.672320] threaded_store+0x132/0x220
[ 1112.677423] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.682720] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.688025] ? sysfs_kf_write+0x65/0x160
[ 1112.693233] ? sysfs_file_ops+0x140/0x140
[ 1112.698525] kernfs_fop_write_iter+0x335/0x510
[ 1112.704314] ? kernfs_ops+0xf0/0xf0
[ 1112.709029] new_sync_write+0x333/0x750
[ 1112.714135] ? __lock_acquire+0x508/0xc10
[ 1112.719434] ? new_sync_read+0x740/0x740
[ 1112.724644] ? lock_acquire.part.0+0xbc/0x260
[ 1112.730335] ? ksys_write+0x116/0x250
[ 1112.735252] vfs_write+0x657/0x9b0
[ 1112.739873] ksys_write+0x116/0x250
[ 1112.744591] ? __ia32_sys_read+0xc0/0xc0
[ 1112.749796] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.755392] ? rcu_is_watching+0x15/0xd0
[ 1112.760587] do_syscall_64+0xf3/0x650
[ 1112.765496] ? trace_hardirqs_off+0xd/0x30
[ 1112.770893] ? exc_page_fault+0xda/0xf0
[ 1112.776002] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.782473] RIP: 0033:0x7f15829cf22e
[ 1112.787287] RSP: 002b:00007ffda5b15300 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.796588] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f15829cf22e
[ 1112.805403] RDX: 0000000000000001 RSI: 0000555f8d89ffe0 RDI: 0000000000000007
[ 1112.814214] RBP: 00007ffda5b15310 R08: 0000000000000000 R09: 0000000000000000
[ 1112.823029] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1582847390
[ 1112.831831] R13: 0000555f8d89ffe0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.840657]
[ 1112.843991] INFO: task python3:5691 is blocked on a mutex likely owned by task python3:3646.
[ 1112.854270] task:python3 state:D stack:25672 pid:3646 tgid:3646 ppid:3645 task_flags:0x400100 flags:0x00080802
[ 1112.867479] Call Trace:
[ 1112.871022]
[ 1112.874173] __schedule+0xcba/0x1940
[ 1112.878990] ? io_schedule_timeout+0x140/0x140
[ 1112.884776] ? find_held_lock+0x2b/0x80
[ 1112.889877] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.896049] schedule+0xd4/0x260
[ 1112.900469] schedule_timeout+0x13f/0x290
[ 1112.905769] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.912142] ? trace_contention_end+0xb3/0x1a0
[ 1112.917929] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.923624] ? ww_mutex_lock+0x160/0x160
[ 1112.928829] msleep+0x1b/0x30
[ 1112.932960] napi_set_threaded+0x3a5/0x440
[ 1112.938359] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.943861] netif_set_threaded+0x257/0x400
[ 1112.949359] threaded_store+0x1b8/0x220
[ 1112.954467] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.959767] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.965068] ? sysfs_kf_write+0x65/0x160
[ 1112.970271] ? sysfs_file_ops+0x140/0x140
[ 1112.975571] kernfs_fop_write_iter+0x335/0x510
[ 1112.981357] ? kernfs_ops+0xf0/0xf0
[ 1112.986073] new_sync_write+0x333/0x750
[ 1112.991179] ? __lock_acquire+0x508/0xc10
[ 1112.996480] ? new_sync_read+0x740/0x740
[ 1113.001682] ? lock_acquire.part.0+0xbc/0x260
[ 1113.007373] ? ksys_write+0x116/0x250
[ 1113.012285] vfs_write+0x657/0x9b0
[ 1113.016909] ksys_write+0x116/0x250
[ 1113.021625] ? __ia32_sys_read+0xc0/0xc0
[ 1113.026829] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.032423] ? rcu_is_watching+0x15/0xd0
[ 1113.037627] do_syscall_64+0xf3/0x650
[ 1113.042538] ? trace_hardirqs_off+0xd/0x30
[ 1113.047935] ? exc_page_fault+0xda/0xf0
[ 1113.053039] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.059512] RIP: 0033:0x7f45f670222e
[ 1113.064322] RSP: 002b:00007fff1fe04530 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.073628] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f45f670222e
[ 1113.082439] RDX: 0000000000000001 RSI: 0000558e4ebf9fe0 RDI: 0000000000000007
[ 1113.091251] RBP: 00007fff1fe04540 R08: 0000000000000000 R09: 0000000000000000
[ 1113.100063] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f45f657a390
[ 1113.108876] R13: 0000558e4ebf9fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.117691]
[ 1113.120958] \x0aShowing all locks held in the system:
[ 1113.129502] 1 lock held by khungtaskd/185:
[ 1113.134900] #0: ffffffffa0efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.146404] 4 locks held by python3/3646:
[ 1113.151702] #0: ff110001302cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.161601] #1: ff1100014de96e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.172570] #2: ff110017d90a4b50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.183734] #3: ff110017d9109d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.193841] 4 locks held by python3/5691:
[ 1113.199138] #0: ff110001302cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.209038] #1: ff110001b6b83880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.220007] #2: ff110017d90a4b50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.231171] #3: ff110017d9109d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.241269]
[ 1113.243739] =============================================\x0a
[ 1235.443121] INFO: task python3:5691 blocked for more than 368 seconds.
[ 1235.451269] Not tainted 7.1.0-rc2-izpd-g50ebd7b3c8a3 #1
[ 1235.458509] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.468100] task:python3 state:D stack:25672 pid:5691 tgid:5691 ppid:5690 task_flags:0x400100 flags:0x00080002
[ 1235.481307] Call Trace:
[ 1235.484848]
[ 1235.487997] __schedule+0xcba/0x1940
[ 1235.492816] ? io_schedule_timeout+0x140/0x140
[ 1235.498603] ? find_held_lock+0x2b/0x80
[ 1235.503710] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.509595] schedule+0xd4/0x260
[ 1235.514016] schedule_preempt_disabled+0x18/0x30
[ 1235.519997] __mutex_lock+0x6a3/0x2000
[ 1235.525001] ? threaded_store+0x132/0x220
[ 1235.530298] ? ww_mutex_lock+0x160/0x160
[ 1235.535498] ? selinux_inode_free_security+0x330/0x330
[ 1235.542068] ? cap_capable+0x1d6/0x3e0
[ 1235.547078] ? threaded_store+0x132/0x220
[ 1235.552377] threaded_store+0x132/0x220
[ 1235.557476] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.562774] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.568071] ? sysfs_kf_write+0x65/0x160
[ 1235.573272] ? sysfs_file_ops+0x140/0x140
[ 1235.578568] kernfs_fop_write_iter+0x335/0x510
[ 1235.584355] ? kernfs_ops+0xf0/0xf0
[ 1235.589066] new_sync_write+0x333/0x750
[ 1235.594171] ? __lock_acquire+0x508/0xc10
[ 1235.599466] ? new_sync_read+0x740/0x740
[ 1235.604668] ? lock_acquire.part.0+0xbc/0x260
[ 1235.610356] ? ksys_write+0x116/0x250
[ 1235.615260] vfs_write+0x657/0x9b0
[ 1235.619877] ksys_write+0x116/0x250
[ 1235.624590] ? __ia32_sys_read+0xc0/0xc0
[ 1235.629787] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.635378] ? rcu_is_watching+0x15/0xd0
[ 1235.640579] do_syscall_64+0xf3/0x650
[ 1235.645483] ? trace_hardirqs_off+0xd/0x30
[ 1235.650879] ? exc_page_fault+0xda/0xf0
[ 1235.655981] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.662451] RIP: 0033:0x7f15829cf22e
[ 1235.667262] RSP: 002b:00007ffda5b15300 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.676550] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f15829cf22e
[ 1235.685352] RDX: 0000000000000001 RSI: 0000555f8d89ffe0 RDI: 0000000000000007
[ 1235.694160] RBP: 00007ffda5b15310 R08: 0000000000000000 R09: 0000000000000000
[ 1235.702970] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1582847390
[ 1235.711780] R13: 0000555f8d89ffe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.720593]
[ 1235.723882] INFO: task python3:5691 is blocked on a mutex likely owned by task python3:3646.
[ 1235.734155] task:python3 state:D stack:25672 pid:3646 tgid:3646 ppid:3645 task_flags:0x400100 flags:0x00080802
[ 1235.747356] Call Trace:
[ 1235.750894]
[ 1235.754046] __schedule+0xcba/0x1940
[ 1235.758857] ? io_schedule_timeout+0x140/0x140
[ 1235.764643] ? find_held_lock+0x2b/0x80
[ 1235.769748] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.775923] schedule+0xd4/0x260
[ 1235.780342] schedule_timeout+0x13f/0x290
[ 1235.785630] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.792000] ? trace_contention_end+0xb3/0x1a0
[ 1235.797778] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.803469] ? ww_mutex_lock+0x160/0x160
[ 1235.808671] msleep+0x1b/0x30
[ 1235.812796] napi_set_threaded+0x3a5/0x440
[ 1235.818195] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.823687] netif_set_threaded+0x257/0x400
[ 1235.829174] threaded_store+0x1b8/0x220
[ 1235.834274] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.839572] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.844858] ? sysfs_kf_write+0x65/0x160
[ 1235.850058] ? sysfs_file_ops+0x140/0x140
[ 1235.855355] kernfs_fop_write_iter+0x335/0x510
[ 1235.861137] ? kernfs_ops+0xf0/0xf0
[ 1235.865848] new_sync_write+0x333/0x750
[ 1235.870956] ? __lock_acquire+0x508/0xc10
[ 1235.876251] ? new_sync_read+0x740/0x740
[ 1235.881453] ? lock_acquire.part.0+0xbc/0x260
[ 1235.887140] ? ksys_write+0x116/0x250
[ 1235.892050] vfs_write+0x657/0x9b0
[ 1235.896667] ksys_write+0x116/0x250
[ 1235.901382] ? __ia32_sys_read+0xc0/0xc0
[ 1235.906580] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.912170] ? rcu_is_watching+0x15/0xd0
[ 1235.917368] do_syscall_64+0xf3/0x650
[ 1235.922278] ? trace_hardirqs_off+0xd/0x30
[ 1235.927672] ? exc_page_fault+0xda/0xf0
[ 1235.932775] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.939234] RIP: 0033:0x7f45f670222e
[ 1235.944034] RSP: 002b:00007fff1fe04530 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.953322] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f45f670222e
[ 1235.962134] RDX: 0000000000000001 RSI: 0000558e4ebf9fe0 RDI: 0000000000000007
[ 1235.970945] RBP: 00007fff1fe04540 R08: 0000000000000000 R09: 0000000000000000
[ 1235.979756] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f45f657a390
[ 1235.988564] R13: 0000558e4ebf9fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.997378]
[ 1236.000643] \x0aShowing all locks held in the system:
[ 1236.009183] 1 lock held by khungtaskd/185:
[ 1236.014574] #0: ffffffffa0efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.026058] 4 locks held by python3/3646:
[ 1236.031347] #0: ff110001302cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.041239] #1: ff1100014de96e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.052199] #2: ff110017d90a4b50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.063354] #3: ff110017d9109d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.073447] 4 locks held by python3/5691:
[ 1236.078743] #0: ff110001302cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.088633] #1: ff110001b6b83880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.099593] #2: ff110017d90a4b50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.110750] #3: ff110017d9109d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.120841]
[ 1236.123308] =============================================\x0a
[ 1358.324256] INFO: task python3:5691 blocked for more than 491 seconds.
[ 1358.332403] Not tainted 7.1.0-rc2-izpd-g50ebd7b3c8a3 #1
[ 1358.339643] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.349231] task:python3 state:D stack:25672 pid:5691 tgid:5691 ppid:5690 task_flags:0x400100 flags:0x00080002
[ 1358.362440] Call Trace:
[ 1358.365980]
[ 1358.369134] __schedule+0xcba/0x1940
[ 1358.373949] ? io_schedule_timeout+0x140/0x140
[ 1358.379735] ? find_held_lock+0x2b/0x80
[ 1358.384842] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.390727] schedule+0xd4/0x260
[ 1358.395145] schedule_preempt_disabled+0x18/0x30
[ 1358.401126] __mutex_lock+0x6a3/0x2000
[ 1358.406129] ? threaded_store+0x132/0x220
[ 1358.411428] ? ww_mutex_lock+0x160/0x160
[ 1358.416618] ? selinux_inode_free_security+0x330/0x330
[ 1358.423189] ? cap_capable+0x1d6/0x3e0
[ 1358.428198] ? threaded_store+0x132/0x220
[ 1358.433495] threaded_store+0x132/0x220
[ 1358.438591] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.443891] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.449190] ? sysfs_kf_write+0x65/0x160
[ 1358.454384] ? sysfs_file_ops+0x140/0x140
[ 1358.459682] kernfs_fop_write_iter+0x335/0x510
[ 1358.465469] ? kernfs_ops+0xf0/0xf0
[ 1358.470181] new_sync_write+0x333/0x750
[ 1358.475282] ? __lock_acquire+0x508/0xc10
[ 1358.480579] ? new_sync_read+0x740/0x740
[ 1358.485783] ? lock_acquire.part.0+0xbc/0x260
[ 1358.491470] ? ksys_write+0x116/0x250
[ 1358.496379] vfs_write+0x657/0x9b0
[ 1358.500997] ksys_write+0x116/0x250
[ 1358.505709] ? __ia32_sys_read+0xc0/0xc0
[ 1358.510898] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.516489] ? rcu_is_watching+0x15/0xd0
[ 1358.521690] do_syscall_64+0xf3/0x650
[ 1358.526596] ? trace_hardirqs_off+0xd/0x30
[ 1358.531992] ? exc_page_fault+0xda/0xf0
[ 1358.537099] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.543569] RIP: 0033:0x7f15829cf22e
[ 1358.548381] RSP: 002b:00007ffda5b15300 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.557680] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f15829cf22e
[ 1358.566489] RDX: 0000000000000001 RSI: 0000555f8d89ffe0 RDI: 0000000000000007
[ 1358.575298] RBP: 00007ffda5b15310 R08: 0000000000000000 R09: 0000000000000000
[ 1358.584108] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1582847390
[ 1358.592918] R13: 0000555f8d89ffe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.601731]
[ 1358.605000] INFO: task python3:5691 is blocked on a mutex likely owned by task python3:3646.
[ 1358.615275] task:python3 state:D stack:25672 pid:3646 tgid:3646 ppid:3645 task_flags:0x400100 flags:0x00080802
[ 1358.628477] Call Trace:
[ 1358.632015]
[ 1358.635168] __schedule+0xcba/0x1940
[ 1358.639981] ? io_schedule_timeout+0x140/0x140
[ 1358.645766] ? find_held_lock+0x2b/0x80
[ 1358.650862] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.657038] schedule+0xd4/0x260
[ 1358.661457] schedule_timeout+0x13f/0x290
[ 1358.666756] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.673126] ? trace_contention_end+0xb3/0x1a0
[ 1358.678905] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.684597] ? ww_mutex_lock+0x160/0x160
[ 1358.689799] msleep+0x1b/0x30
[ 1358.693924] napi_set_threaded+0x3a5/0x440
[ 1358.699318] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.704812] netif_set_threaded+0x257/0x400
[ 1358.710307] threaded_store+0x1b8/0x220
[ 1358.715409] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.720707] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.726001] ? sysfs_kf_write+0x65/0x160
[ 1358.731202] ? sysfs_file_ops+0x140/0x140
[ 1358.736489] kernfs_fop_write_iter+0x335/0x510
[ 1358.742272] ? kernfs_ops+0xf0/0xf0
[ 1358.746984] new_sync_write+0x333/0x750
[ 1358.752088] ? __lock_acquire+0x508/0xc10
[ 1358.757385] ? new_sync_read+0x740/0x740
[ 1358.762588] ? lock_acquire.part.0+0xbc/0x260
[ 1358.768274] ? ksys_write+0x116/0x250
[ 1358.773185] vfs_write+0x657/0x9b0
[ 1358.777802] ksys_write+0x116/0x250
[ 1358.782517] ? __ia32_sys_read+0xc0/0xc0
[ 1358.787718] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.793309] ? rcu_is_watching+0x15/0xd0
[ 1358.798508] do_syscall_64+0xf3/0x650
[ 1358.803417] ? trace_hardirqs_off+0xd/0x30
[ 1358.808812] ? exc_page_fault+0xda/0xf0
[ 1358.813913] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.820381] RIP: 0033:0x7f45f670222e
[ 1358.825189] RSP: 002b:00007fff1fe04530 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.834487] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f45f670222e
[ 1358.843295] RDX: 0000000000000001 RSI: 0000558e4ebf9fe0 RDI: 0000000000000007
[ 1358.852107] RBP: 00007fff1fe04540 R08: 0000000000000000 R09: 0000000000000000
[ 1358.860918] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f45f657a390
[ 1358.869725] R13: 0000558e4ebf9fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.878531]
[ 1358.881799] \x0aShowing all locks held in the system:
[ 1358.890338] 1 lock held by khungtaskd/185:
[ 1358.895729] #0: ffffffffa0efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.907211] 4 locks held by python3/3646:
[ 1358.912508] #0: ff110001302cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.922399] #1: ff1100014de96e80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.933360] #2: ff110017d90a4b50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.944516] #3: ff110017d9109d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.954608] 4 locks held by python3/5691:
[ 1358.959904] #0: ff110001302cc3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.969793] #1: ff110001b6b83880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.980747] #2: ff110017d90a4b50 (kn->active#159){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.991908] #3: ff110017d9109d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.002000]
[ 1359.004468] =============================================\x0a