[ 781.412514] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 781.415007] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 781.566001] kselftest: Running tests in drivers/net
[ 989.682441] INFO: task python3:5694 blocked for more than 122 seconds.
[ 989.690675] Not tainted 7.1.0-rc2-lpew-g9b05cb55ebd9 #1
[ 989.698624] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.708218] task:python3 state:D stack:25672 pid:5694 tgid:5694 ppid:5693 task_flags:0x400100 flags:0x00080000
[ 989.721426] Call Trace:
[ 989.724965]
[ 989.728117] __schedule+0xcba/0x1940
[ 989.732937] ? io_schedule_timeout+0x140/0x140
[ 989.738723] ? find_held_lock+0x2b/0x80
[ 989.743830] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.749715] schedule+0xd4/0x260
[ 989.754134] schedule_preempt_disabled+0x18/0x30
[ 989.760116] __mutex_lock+0x6a3/0x2000
[ 989.765123] ? threaded_store+0x132/0x220
[ 989.770421] ? ww_mutex_lock+0x160/0x160
[ 989.775621] ? selinux_inode_free_security+0x330/0x330
[ 989.782191] ? cap_capable+0x1d6/0x3e0
[ 989.787198] ? threaded_store+0x132/0x220
[ 989.792497] threaded_store+0x132/0x220
[ 989.797600] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.802889] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.808189] ? sysfs_kf_write+0x65/0x160
[ 989.813391] ? sysfs_file_ops+0x140/0x140
[ 989.818686] kernfs_fop_write_iter+0x335/0x510
[ 989.824473] ? kernfs_ops+0xf0/0xf0
[ 989.829183] new_sync_write+0x333/0x750
[ 989.834286] ? __lock_acquire+0x508/0xc10
[ 989.839583] ? new_sync_read+0x740/0x740
[ 989.844783] ? lock_acquire.part.0+0xbc/0x260
[ 989.850471] ? ksys_write+0x116/0x250
[ 989.855372] vfs_write+0x657/0x9b0
[ 989.859988] ksys_write+0x116/0x250
[ 989.864701] ? __ia32_sys_read+0xc0/0xc0
[ 989.869899] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.875490] ? rcu_is_watching+0x15/0xd0
[ 989.880694] do_syscall_64+0xf3/0x650
[ 989.885604] ? trace_hardirqs_off+0xd/0x30
[ 989.891001] ? exc_page_fault+0xda/0xf0
[ 989.896094] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.902563] RIP: 0033:0x7f7f83ef422e
[ 989.907375] RSP: 002b:00007ffd050eff80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.916672] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f7f83ef422e
[ 989.925479] RDX: 0000000000000001 RSI: 00005625f7ab7fe0 RDI: 0000000000000007
[ 989.934290] RBP: 00007ffd050eff90 R08: 0000000000000000 R09: 0000000000000000
[ 989.943100] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f7f83d6c390
[ 989.951910] R13: 00005625f7ab7fe0 R14: 0000000000000007 R15: 0000000000000003
[ 989.960735]
[ 989.964017] INFO: task python3:5694 is blocked on a mutex likely owned by task python3:3630.
[ 989.974293] task:python3 state:D stack:25672 pid:3630 tgid:3630 ppid:3629 task_flags:0x400100 flags:0x00080802
[ 989.987496] Call Trace:
[ 989.991036]
[ 989.994186] __schedule+0xcba/0x1940
[ 989.999000] ? io_schedule_timeout+0x140/0x140
[ 990.004783] ? find_held_lock+0x2b/0x80
[ 990.009886] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.016064] schedule+0xd4/0x260
[ 990.020481] schedule_timeout+0x13f/0x290
[ 990.025778] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.032147] ? trace_contention_end+0xb3/0x1a0
[ 990.037933] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.043616] ? ww_mutex_lock+0x160/0x160
[ 990.048817] msleep+0x1b/0x30
[ 990.052942] napi_set_threaded+0x3a5/0x440
[ 990.058339] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.063827] netif_set_threaded+0x257/0x400
[ 990.069319] threaded_store+0x1b8/0x220
[ 990.074419] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.079716] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.085011] ? sysfs_kf_write+0x65/0x160
[ 990.090209] ? sysfs_file_ops+0x140/0x140
[ 990.095506] kernfs_fop_write_iter+0x335/0x510
[ 990.101295] ? kernfs_ops+0xf0/0xf0
[ 990.106006] new_sync_write+0x333/0x750
[ 990.111098] ? __lock_acquire+0x508/0xc10
[ 990.116397] ? new_sync_read+0x740/0x740
[ 990.121598] ? lock_acquire.part.0+0xbc/0x260
[ 990.127286] ? ksys_write+0x116/0x250
[ 990.132198] vfs_write+0x657/0x9b0
[ 990.136814] ksys_write+0x116/0x250
[ 990.141527] ? __ia32_sys_read+0xc0/0xc0
[ 990.146720] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.152309] ? rcu_is_watching+0x15/0xd0
[ 990.157508] do_syscall_64+0xf3/0x650
[ 990.162412] ? trace_hardirqs_off+0xd/0x30
[ 990.167807] ? exc_page_fault+0xda/0xf0
[ 990.172909] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.179377] RIP: 0033:0x7f998a04c22e
[ 990.184184] RSP: 002b:00007ffc5d62b430 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.193481] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f998a04c22e
[ 990.202288] RDX: 0000000000000001 RSI: 000055edc5092fe0 RDI: 0000000000000007
[ 990.211098] RBP: 00007ffc5d62b440 R08: 0000000000000000 R09: 0000000000000000
[ 990.219906] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9989ec4390
[ 990.228706] R13: 000055edc5092fe0 R14: 0000000000000007 R15: 0000000000000003
[ 990.237520]
[ 990.240778] \x0aShowing all locks held in the system:
[ 990.249318] 1 lock held by khungtaskd/185:
[ 990.254711] #0: ffffffffb86fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.266186] 2 locks held by systemd-journal/805:
[ 990.272156] #0: ff1100180e2b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.282043] #1: ffffffffb89032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.294869] 4 locks held by python3/3630:
[ 990.300166] #0: ff110001304643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.310058] #1: ff1100015f5fc480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.321021] #2: ff11000123b88b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.332186] #3: ff11000123bd1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.342297] 4 locks held by python3/5694:
[ 990.347593] #0: ff110001304643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.357480] #1: ff110001abc6b880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.368443] #2: ff11000123b88b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.379601] #3: ff11000123bd1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.389690]
[ 990.392157] =============================================\x0a
[ 1112.563668] INFO: task python3:5694 blocked for more than 245 seconds.
[ 1112.571817] Not tainted 7.1.0-rc2-lpew-g9b05cb55ebd9 #1
[ 1112.579067] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.588659] task:python3 state:D stack:25672 pid:5694 tgid:5694 ppid:5693 task_flags:0x400100 flags:0x00080000
[ 1112.601866] Call Trace:
[ 1112.605406]
[ 1112.608558] __schedule+0xcba/0x1940
[ 1112.613377] ? io_schedule_timeout+0x140/0x140
[ 1112.619163] ? find_held_lock+0x2b/0x80
[ 1112.624271] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.630159] schedule+0xd4/0x260
[ 1112.634581] schedule_preempt_disabled+0x18/0x30
[ 1112.640561] __mutex_lock+0x6a3/0x2000
[ 1112.645568] ? threaded_store+0x132/0x220
[ 1112.650869] ? ww_mutex_lock+0x160/0x160
[ 1112.656070] ? selinux_inode_free_security+0x330/0x330
[ 1112.662643] ? cap_capable+0x1d6/0x3e0
[ 1112.667651] ? threaded_store+0x132/0x220
[ 1112.672947] threaded_store+0x132/0x220
[ 1112.678050] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.683347] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.688650] ? sysfs_kf_write+0x65/0x160
[ 1112.693853] ? sysfs_file_ops+0x140/0x140
[ 1112.699148] kernfs_fop_write_iter+0x335/0x510
[ 1112.704935] ? kernfs_ops+0xf0/0xf0
[ 1112.709645] new_sync_write+0x333/0x750
[ 1112.714749] ? __lock_acquire+0x508/0xc10
[ 1112.720049] ? new_sync_read+0x740/0x740
[ 1112.725249] ? lock_acquire.part.0+0xbc/0x260
[ 1112.730935] ? ksys_write+0x116/0x250
[ 1112.735848] vfs_write+0x657/0x9b0
[ 1112.740463] ksys_write+0x116/0x250
[ 1112.745176] ? __ia32_sys_read+0xc0/0xc0
[ 1112.750376] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.755965] ? rcu_is_watching+0x15/0xd0
[ 1112.761170] do_syscall_64+0xf3/0x650
[ 1112.766077] ? trace_hardirqs_off+0xd/0x30
[ 1112.771475] ? exc_page_fault+0xda/0xf0
[ 1112.776577] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.783046] RIP: 0033:0x7f7f83ef422e
[ 1112.787854] RSP: 002b:00007ffd050eff80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.797151] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f7f83ef422e
[ 1112.805950] RDX: 0000000000000001 RSI: 00005625f7ab7fe0 RDI: 0000000000000007
[ 1112.814758] RBP: 00007ffd050eff90 R08: 0000000000000000 R09: 0000000000000000
[ 1112.823567] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f7f83d6c390
[ 1112.832376] R13: 00005625f7ab7fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.841190]
[ 1112.844462] INFO: task python3:5694 is blocked on a mutex likely owned by task python3:3630.
[ 1112.854736] task:python3 state:D stack:25672 pid:3630 tgid:3630 ppid:3629 task_flags:0x400100 flags:0x00080802
[ 1112.867939] Call Trace:
[ 1112.871479]
[ 1112.874631] __schedule+0xcba/0x1940
[ 1112.879442] ? io_schedule_timeout+0x140/0x140
[ 1112.885230] ? find_held_lock+0x2b/0x80
[ 1112.890334] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.896518] schedule+0xd4/0x260
[ 1112.900938] schedule_timeout+0x13f/0x290
[ 1112.906234] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.912603] ? trace_contention_end+0xb3/0x1a0
[ 1112.918388] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.924078] ? ww_mutex_lock+0x160/0x160
[ 1112.929277] msleep+0x1b/0x30
[ 1112.933402] napi_set_threaded+0x3a5/0x440
[ 1112.938799] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.944295] netif_set_threaded+0x257/0x400
[ 1112.949790] threaded_store+0x1b8/0x220
[ 1112.954894] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.960190] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.965487] ? sysfs_kf_write+0x65/0x160
[ 1112.970689] ? sysfs_file_ops+0x140/0x140
[ 1112.975987] kernfs_fop_write_iter+0x335/0x510
[ 1112.981772] ? kernfs_ops+0xf0/0xf0
[ 1112.986484] new_sync_write+0x333/0x750
[ 1112.991577] ? __lock_acquire+0x508/0xc10
[ 1112.996867] ? new_sync_read+0x740/0x740
[ 1113.002058] ? lock_acquire.part.0+0xbc/0x260
[ 1113.007744] ? ksys_write+0x116/0x250
[ 1113.012656] vfs_write+0x657/0x9b0
[ 1113.017273] ksys_write+0x116/0x250
[ 1113.021986] ? __ia32_sys_read+0xc0/0xc0
[ 1113.027186] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.032776] ? rcu_is_watching+0x15/0xd0
[ 1113.037968] do_syscall_64+0xf3/0x650
[ 1113.042875] ? trace_hardirqs_off+0xd/0x30
[ 1113.048268] ? exc_page_fault+0xda/0xf0
[ 1113.053372] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.059838] RIP: 0033:0x7f998a04c22e
[ 1113.064644] RSP: 002b:00007ffc5d62b430 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.073940] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f998a04c22e
[ 1113.082750] RDX: 0000000000000001 RSI: 000055edc5092fe0 RDI: 0000000000000007
[ 1113.091559] RBP: 00007ffc5d62b440 R08: 0000000000000000 R09: 0000000000000000
[ 1113.100367] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9989ec4390
[ 1113.109174] R13: 000055edc5092fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.117986]
[ 1113.121249] \x0aShowing all locks held in the system:
[ 1113.129788] 1 lock held by khungtaskd/185:
[ 1113.135182] #0: ffffffffb86fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.146663] 4 locks held by python3/3630:
[ 1113.151960] #0: ff110001304643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.161853] #1: ff1100015f5fc480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.172815] #2: ff11000123b88b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.183962] #3: ff11000123bd1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.194056] 4 locks held by python3/5694:
[ 1113.199350] #0: ff110001304643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.209240] #1: ff110001abc6b880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.220200] #2: ff11000123b88b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.231357] #3: ff11000123bd1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.241446]
[ 1113.243914] =============================================\x0a
[ 1235.443874] INFO: task python3:5694 blocked for more than 368 seconds.
[ 1235.452024] Not tainted 7.1.0-rc2-lpew-g9b05cb55ebd9 #1
[ 1235.459273] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.468864] task:python3 state:D stack:25672 pid:5694 tgid:5694 ppid:5693 task_flags:0x400100 flags:0x00080002
[ 1235.482070] Call Trace:
[ 1235.485608]
[ 1235.488758] __schedule+0xcba/0x1940
[ 1235.493575] ? io_schedule_timeout+0x140/0x140
[ 1235.499359] ? find_held_lock+0x2b/0x80
[ 1235.504456] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.510343] schedule+0xd4/0x260
[ 1235.514759] schedule_preempt_disabled+0x18/0x30
[ 1235.520739] __mutex_lock+0x6a3/0x2000
[ 1235.525741] ? threaded_store+0x132/0x220
[ 1235.531041] ? ww_mutex_lock+0x160/0x160
[ 1235.536239] ? selinux_inode_free_security+0x330/0x330
[ 1235.542807] ? cap_capable+0x1d6/0x3e0
[ 1235.547815] ? threaded_store+0x132/0x220
[ 1235.553113] threaded_store+0x132/0x220
[ 1235.558214] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.563508] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.568803] ? sysfs_kf_write+0x65/0x160
[ 1235.574003] ? sysfs_file_ops+0x140/0x140
[ 1235.579298] kernfs_fop_write_iter+0x335/0x510
[ 1235.585083] ? kernfs_ops+0xf0/0xf0
[ 1235.589784] new_sync_write+0x333/0x750
[ 1235.594887] ? __lock_acquire+0x508/0xc10
[ 1235.600182] ? new_sync_read+0x740/0x740
[ 1235.605384] ? lock_acquire.part.0+0xbc/0x260
[ 1235.611069] ? ksys_write+0x116/0x250
[ 1235.615977] vfs_write+0x657/0x9b0
[ 1235.620584] ksys_write+0x116/0x250
[ 1235.625295] ? __ia32_sys_read+0xc0/0xc0
[ 1235.630492] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.636081] ? rcu_is_watching+0x15/0xd0
[ 1235.641284] do_syscall_64+0xf3/0x650
[ 1235.646188] ? trace_hardirqs_off+0xd/0x30
[ 1235.651583] ? exc_page_fault+0xda/0xf0
[ 1235.656683] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.663152] RIP: 0033:0x7f7f83ef422e
[ 1235.667961] RSP: 002b:00007ffd050eff80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.677258] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f7f83ef422e
[ 1235.686064] RDX: 0000000000000001 RSI: 00005625f7ab7fe0 RDI: 0000000000000007
[ 1235.694869] RBP: 00007ffd050eff90 R08: 0000000000000000 R09: 0000000000000000
[ 1235.703673] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f7f83d6c390
[ 1235.712480] R13: 00005625f7ab7fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.721290]
[ 1235.724574] INFO: task python3:5694 is blocked on a mutex likely owned by task python3:3630.
[ 1235.734844] task:python3 state:D stack:25672 pid:3630 tgid:3630 ppid:3629 task_flags:0x400100 flags:0x00080802
[ 1235.748046] Call Trace:
[ 1235.751584]
[ 1235.754733] __schedule+0xcba/0x1940
[ 1235.759544] ? io_schedule_timeout+0x140/0x140
[ 1235.765319] ? find_held_lock+0x2b/0x80
[ 1235.770422] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.776599] schedule+0xd4/0x260
[ 1235.781016] schedule_timeout+0x13f/0x290
[ 1235.786312] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.792682] ? trace_contention_end+0xb3/0x1a0
[ 1235.798455] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.804142] ? ww_mutex_lock+0x160/0x160
[ 1235.809342] msleep+0x1b/0x30
[ 1235.813459] napi_set_threaded+0x3a5/0x440
[ 1235.818853] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.824345] netif_set_threaded+0x257/0x400
[ 1235.829837] threaded_store+0x1b8/0x220
[ 1235.834935] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.840230] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.845526] ? sysfs_kf_write+0x65/0x160
[ 1235.850726] ? sysfs_file_ops+0x140/0x140
[ 1235.856010] kernfs_fop_write_iter+0x335/0x510
[ 1235.861792] ? kernfs_ops+0xf0/0xf0
[ 1235.866503] new_sync_write+0x333/0x750
[ 1235.871603] ? __lock_acquire+0x508/0xc10
[ 1235.876900] ? new_sync_read+0x740/0x740
[ 1235.882098] ? lock_acquire.part.0+0xbc/0x260
[ 1235.887785] ? ksys_write+0x116/0x250
[ 1235.892693] vfs_write+0x657/0x9b0
[ 1235.897305] ksys_write+0x116/0x250
[ 1235.902014] ? __ia32_sys_read+0xc0/0xc0
[ 1235.907213] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.912799] ? rcu_is_watching+0x15/0xd0
[ 1235.917998] do_syscall_64+0xf3/0x650
[ 1235.922905] ? trace_hardirqs_off+0xd/0x30
[ 1235.928296] ? exc_page_fault+0xda/0xf0
[ 1235.933396] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.939862] RIP: 0033:0x7f998a04c22e
[ 1235.944667] RSP: 002b:00007ffc5d62b430 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.953961] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f998a04c22e
[ 1235.962767] RDX: 0000000000000001 RSI: 000055edc5092fe0 RDI: 0000000000000007
[ 1235.971575] RBP: 00007ffc5d62b440 R08: 0000000000000000 R09: 0000000000000000
[ 1235.980384] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9989ec4390
[ 1235.989189] R13: 000055edc5092fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.998001]
[ 1236.001268] \x0aShowing all locks held in the system:
[ 1236.009806] 1 lock held by khungtaskd/185:
[ 1236.015199] #0: ffffffffb86fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.026680] 4 locks held by python3/3630:
[ 1236.031975] #0: ff110001304643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.041866] #1: ff1100015f5fc480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.052829] #2: ff11000123b88b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.063984] #3: ff11000123bd1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.074080] 4 locks held by python3/5694:
[ 1236.079373] #0: ff110001304643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.089261] #1: ff110001abc6b880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.100221] #2: ff11000123b88b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.111380] #3: ff11000123bd1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.121471]
[ 1236.123938] =============================================\x0a
[ 1358.326091] INFO: task python3:5694 blocked for more than 491 seconds.
[ 1358.334237] Not tainted 7.1.0-rc2-lpew-g9b05cb55ebd9 #1
[ 1358.341487] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.351078] task:python3 state:D stack:25672 pid:5694 tgid:5694 ppid:5693 task_flags:0x400100 flags:0x00080002
[ 1358.364287] Call Trace:
[ 1358.367827]
[ 1358.370976] __schedule+0xcba/0x1940
[ 1358.375793] ? io_schedule_timeout+0x140/0x140
[ 1358.381580] ? find_held_lock+0x2b/0x80
[ 1358.386690] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.392574] schedule+0xd4/0x260
[ 1358.396991] schedule_preempt_disabled+0x18/0x30
[ 1358.402972] __mutex_lock+0x6a3/0x2000
[ 1358.407980] ? threaded_store+0x132/0x220
[ 1358.413279] ? ww_mutex_lock+0x160/0x160
[ 1358.418469] ? selinux_inode_free_security+0x330/0x330
[ 1358.425030] ? cap_capable+0x1d6/0x3e0
[ 1358.430039] ? threaded_store+0x132/0x220
[ 1358.435337] threaded_store+0x132/0x220
[ 1358.440441] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.445739] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.451044] ? sysfs_kf_write+0x65/0x160
[ 1358.456245] ? sysfs_file_ops+0x140/0x140
[ 1358.461540] kernfs_fop_write_iter+0x335/0x510
[ 1358.467327] ? kernfs_ops+0xf0/0xf0
[ 1358.472041] new_sync_write+0x333/0x750
[ 1358.477145] ? __lock_acquire+0x508/0xc10
[ 1358.482445] ? new_sync_read+0x740/0x740
[ 1358.487646] ? lock_acquire.part.0+0xbc/0x260
[ 1358.493331] ? ksys_write+0x116/0x250
[ 1358.498241] vfs_write+0x657/0x9b0
[ 1358.502856] ksys_write+0x116/0x250
[ 1358.507569] ? __ia32_sys_read+0xc0/0xc0
[ 1358.512762] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.518354] ? rcu_is_watching+0x15/0xd0
[ 1358.523558] do_syscall_64+0xf3/0x650
[ 1358.528465] ? trace_hardirqs_off+0xd/0x30
[ 1358.533851] ? exc_page_fault+0xda/0xf0
[ 1358.538953] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.545424] RIP: 0033:0x7f7f83ef422e
[ 1358.550235] RSP: 002b:00007ffd050eff80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.559534] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f7f83ef422e
[ 1358.568344] RDX: 0000000000000001 RSI: 00005625f7ab7fe0 RDI: 0000000000000007
[ 1358.577154] RBP: 00007ffd050eff90 R08: 0000000000000000 R09: 0000000000000000
[ 1358.585963] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f7f83d6c390
[ 1358.594773] R13: 00005625f7ab7fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.603587]
[ 1358.606906] INFO: task python3:5694 is blocked on a mutex likely owned by task python3:3630.
[ 1358.617188] task:python3 state:D stack:25672 pid:3630 tgid:3630 ppid:3629 task_flags:0x400100 flags:0x00080802
[ 1358.630393] Call Trace:
[ 1358.633930]
[ 1358.637086] __schedule+0xcba/0x1940
[ 1358.641897] ? io_schedule_timeout+0x140/0x140
[ 1358.647683] ? find_held_lock+0x2b/0x80
[ 1358.652790] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.658969] schedule+0xd4/0x260
[ 1358.663390] schedule_timeout+0x13f/0x290
[ 1358.668758] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.675129] ? trace_contention_end+0xb3/0x1a0
[ 1358.680912] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.686601] ? ww_mutex_lock+0x160/0x160
[ 1358.691803] msleep+0x1b/0x30
[ 1358.695928] napi_set_threaded+0x3a5/0x440
[ 1358.701328] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.706822] netif_set_threaded+0x257/0x400
[ 1358.712317] threaded_store+0x1b8/0x220
[ 1358.717423] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.722721] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.728017] ? sysfs_kf_write+0x65/0x160
[ 1358.733216] ? sysfs_file_ops+0x140/0x140
[ 1358.738513] kernfs_fop_write_iter+0x335/0x510
[ 1358.744292] ? kernfs_ops+0xf0/0xf0
[ 1358.749003] new_sync_write+0x333/0x750
[ 1358.754100] ? __lock_acquire+0x508/0xc10
[ 1358.759398] ? new_sync_read+0x740/0x740
[ 1358.764663] ? lock_acquire.part.0+0xbc/0x260
[ 1358.770348] ? ksys_write+0x116/0x250
[ 1358.775262] vfs_write+0x657/0x9b0
[ 1358.779881] ksys_write+0x116/0x250
[ 1358.784593] ? __ia32_sys_read+0xc0/0xc0
[ 1358.789857] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.795445] ? rcu_is_watching+0x15/0xd0
[ 1358.800647] do_syscall_64+0xf3/0x650
[ 1358.805631] ? trace_hardirqs_off+0xd/0x30
[ 1358.811026] ? exc_page_fault+0xda/0xf0
[ 1358.816132] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.822601] RIP: 0033:0x7f998a04c22e
[ 1358.827412] RSP: 002b:00007ffc5d62b430 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.836710] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f998a04c22e
[ 1358.845525] RDX: 0000000000000001 RSI: 000055edc5092fe0 RDI: 0000000000000007
[ 1358.854337] RBP: 00007ffc5d62b440 R08: 0000000000000000 R09: 0000000000000000
[ 1358.854341] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f9989ec4390
[ 1358.854342] R13: 000055edc5092fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.854349]
[ 1358.854376] \x0aShowing all locks held in the system:
[ 1358.892622] 1 lock held by khungtaskd/185:
[ 1358.898018] #0: ffffffffb86fdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.909504] 4 locks held by python3/3630:
[ 1358.914803] #0: ff110001304643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.924694] #1: ff1100015f5fc480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.935659] #2: ff11000123b88b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.946814] #3: ff11000123bd1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.956906] 4 locks held by python3/5694:
[ 1358.962203] #0: ff110001304643e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.972094] #1: ff110001abc6b880 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.983056] #2: ff11000123b88b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.994215] #3: ff11000123bd1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.004305] 5 locks held by (systemd-user-)/7541:
[ 1359.010370] #0: ff1100013055c3e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1359.020261] #1: ff11000200ce7a80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.031223] #2: ffffffffb8769ce0 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1359.041894] #3: ffffffffb8568970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650
[ 1359.053538] #4: ffffffffb8769a50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650
[ 1359.065961]
[ 1359.068427] =============================================\x0a