[ 778.602903] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 778.605353] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 778.756177] kselftest: Running tests in drivers/net
[ 989.643828] INFO: task python3:5666 blocked for more than 122 seconds.
[ 989.652063] Not tainted 7.1.0-rc2-axza-g2dee1e3ea030 #1
[ 989.659949] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.669538] task:python3 state:D stack:25672 pid:5666 tgid:5666 ppid:5665 task_flags:0x400100 flags:0x00080000
[ 989.682744] Call Trace:
[ 989.686283]
[ 989.689434] __schedule+0xcba/0x1940
[ 989.694251] ? io_schedule_timeout+0x140/0x140
[ 989.700039] ? find_held_lock+0x2b/0x80
[ 989.705145] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.711031] schedule+0xd4/0x260
[ 989.715450] schedule_preempt_disabled+0x18/0x30
[ 989.721433] __mutex_lock+0x6a3/0x2000
[ 989.726438] ? threaded_store+0x132/0x220
[ 989.731737] ? ww_mutex_lock+0x160/0x160
[ 989.736925] ? selinux_inode_free_security+0x330/0x330
[ 989.743497] ? cap_capable+0x1d6/0x3e0
[ 989.748511] ? threaded_store+0x132/0x220
[ 989.753810] threaded_store+0x132/0x220
[ 989.758913] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.764208] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.769508] ? sysfs_kf_write+0x65/0x160
[ 989.774709] ? sysfs_file_ops+0x140/0x140
[ 989.780008] kernfs_fop_write_iter+0x335/0x510
[ 989.785793] ? kernfs_ops+0xf0/0xf0
[ 989.790498] new_sync_write+0x333/0x750
[ 989.795603] ? __lock_acquire+0x508/0xc10
[ 989.800901] ? new_sync_read+0x740/0x740
[ 989.806104] ? lock_acquire.part.0+0xbc/0x260
[ 989.811793] ? ksys_write+0x116/0x250
[ 989.816705] vfs_write+0x657/0x9b0
[ 989.821319] ksys_write+0x116/0x250
[ 989.826030] ? __ia32_sys_read+0xc0/0xc0
[ 989.831229] ? rcu_is_watching+0x15/0xd0
[ 989.836421] ? rcu_is_watching+0x15/0xd0
[ 989.841620] do_syscall_64+0xf3/0x650
[ 989.846518] ? irq_exit_rcu+0x1a/0x30
[ 989.851419] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.857886] RIP: 0033:0x7f1693cf722e
[ 989.862686] RSP: 002b:00007ffd3eb02df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.871993] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1693cf722e
[ 989.880801] RDX: 0000000000000001 RSI: 000055c21fa86fe0 RDI: 0000000000000007
[ 989.889607] RBP: 00007ffd3eb02e00 R08: 0000000000000000 R09: 0000000000000000
[ 989.898413] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1693b6f390
[ 989.907222] R13: 000055c21fa86fe0 R14: 0000000000000007 R15: 0000000000000003
[ 989.916037]
[ 989.919320] INFO: task python3:5666 is blocked on a mutex likely owned by task python3:3616.
[ 989.929591] task:python3 state:D stack:25576 pid:3616 tgid:3616 ppid:3615 task_flags:0x400100 flags:0x00080802
[ 989.942796] Call Trace:
[ 989.946337]
[ 989.949485] __schedule+0xcba/0x1940
[ 989.954298] ? io_schedule_timeout+0x140/0x140
[ 989.960085] ? find_held_lock+0x2b/0x80
[ 989.965186] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.971366] schedule+0xd4/0x260
[ 989.975785] schedule_timeout+0x13f/0x290
[ 989.981085] ? hrtimer_nanosleep_restart+0x270/0x270
[ 989.987456] ? trace_contention_end+0xb3/0x1a0
[ 989.993245] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 989.998934] ? ww_mutex_lock+0x160/0x160
[ 990.004136] msleep+0x1b/0x30
[ 990.008263] napi_set_threaded+0x3a5/0x440
[ 990.013661] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.019156] netif_set_threaded+0x257/0x400
[ 990.024656] threaded_store+0x1b8/0x220
[ 990.029756] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.035056] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.040352] ? sysfs_kf_write+0x65/0x160
[ 990.045552] ? sysfs_file_ops+0x140/0x140
[ 990.050840] kernfs_fop_write_iter+0x335/0x510
[ 990.056623] ? kernfs_ops+0xf0/0xf0
[ 990.061336] new_sync_write+0x333/0x750
[ 990.066431] ? __lock_acquire+0x508/0xc10
[ 990.071727] ? new_sync_read+0x740/0x740
[ 990.076926] ? lock_acquire.part.0+0xbc/0x260
[ 990.082615] ? ksys_write+0x116/0x250
[ 990.087525] vfs_write+0x657/0x9b0
[ 990.092142] ksys_write+0x116/0x250
[ 990.096856] ? __ia32_sys_read+0xc0/0xc0
[ 990.102056] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.107648] ? rcu_is_watching+0x15/0xd0
[ 990.112852] do_syscall_64+0xf3/0x650
[ 990.117758] ? trace_hardirqs_off+0xd/0x30
[ 990.123155] ? exc_page_fault+0xda/0xf0
[ 990.128258] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.134724] RIP: 0033:0x7f92d5e2322e
[ 990.139534] RSP: 002b:00007ffe397c6d60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.148831] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f92d5e2322e
[ 990.157631] RDX: 0000000000000001 RSI: 0000562aa57f7fe0 RDI: 0000000000000007
[ 990.166438] RBP: 00007ffe397c6d70 R08: 0000000000000000 R09: 0000000000000000
[ 990.175240] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f92d5c9b390
[ 990.184050] R13: 0000562aa57f7fe0 R14: 0000000000000007 R15: 0000000000000003
[ 990.192862]
[ 990.196120] \x0aShowing all locks held in the system:
[ 990.204664] 1 lock held by khungtaskd/185:
[ 990.210056] #0: ffffffff97efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.221531] 2 locks held by systemd-journal/804:
[ 990.227512] #0: ff1100180db372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 990.237402] #1: ffffffff981032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.250230] 4 locks held by python3/3616:
[ 990.255524] #0: ff110001307c43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.265414] #1: ff1100014508d080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.276378] #2: ff11000123e64b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.287538] #3: ff11000123e41d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.297631] 4 locks held by python3/5666:
[ 990.302929] #0: ff110001307c43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.312820] #1: ff110001af5d1480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.323785] #2: ff11000123e64b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.334943] #3: ff11000123e41d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.345033]
[ 990.347499] =============================================\x0a
[ 1112.525250] INFO: task python3:5666 blocked for more than 245 seconds.
[ 1112.533400] Not tainted 7.1.0-rc2-axza-g2dee1e3ea030 #1
[ 1112.540653] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.540656] task:python3 state:D stack:25672 pid:5666 tgid:5666 ppid:5665 task_flags:0x400100 flags:0x00080000
[ 1112.540664] Call Trace:
[ 1112.540666]
[ 1112.540670] __schedule+0xcba/0x1940
[ 1112.540682] ? io_schedule_timeout+0x140/0x140
[ 1112.580793] ? find_held_lock+0x2b/0x80
[ 1112.585897] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.591783] schedule+0xd4/0x260
[ 1112.596200] schedule_preempt_disabled+0x18/0x30
[ 1112.602178] __mutex_lock+0x6a3/0x2000
[ 1112.607182] ? threaded_store+0x132/0x220
[ 1112.612481] ? ww_mutex_lock+0x160/0x160
[ 1112.617678] ? selinux_inode_free_security+0x330/0x330
[ 1112.624248] ? cap_capable+0x1d6/0x3e0
[ 1112.629253] ? threaded_store+0x132/0x220
[ 1112.634547] threaded_store+0x132/0x220
[ 1112.639649] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.644935] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.650236] ? sysfs_kf_write+0x65/0x160
[ 1112.655434] ? sysfs_file_ops+0x140/0x140
[ 1112.660728] kernfs_fop_write_iter+0x335/0x510
[ 1112.666513] ? kernfs_ops+0xf0/0xf0
[ 1112.671221] new_sync_write+0x333/0x750
[ 1112.676323] ? __lock_acquire+0x508/0xc10
[ 1112.681617] ? new_sync_read+0x740/0x740
[ 1112.686815] ? lock_acquire.part.0+0xbc/0x260
[ 1112.692500] ? ksys_write+0x116/0x250
[ 1112.697413] vfs_write+0x657/0x9b0
[ 1112.702027] ksys_write+0x116/0x250
[ 1112.706738] ? __ia32_sys_read+0xc0/0xc0
[ 1112.711938] ? rcu_is_watching+0x15/0xd0
[ 1112.717137] ? rcu_is_watching+0x15/0xd0
[ 1112.722334] do_syscall_64+0xf3/0x650
[ 1112.727241] ? irq_exit_rcu+0x1a/0x30
[ 1112.732149] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.738616] RIP: 0033:0x7f1693cf722e
[ 1112.743424] RSP: 002b:00007ffd3eb02df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.752721] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1693cf722e
[ 1112.761519] RDX: 0000000000000001 RSI: 000055c21fa86fe0 RDI: 0000000000000007
[ 1112.770324] RBP: 00007ffd3eb02e00 R08: 0000000000000000 R09: 0000000000000000
[ 1112.779133] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1693b6f390
[ 1112.787939] R13: 000055c21fa86fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.796753]
[ 1112.800042] INFO: task python3:5666 is blocked on a mutex likely owned by task python3:3616.
[ 1112.810317] task:python3 state:D stack:25576 pid:3616 tgid:3616 ppid:3615 task_flags:0x400100 flags:0x00080802
[ 1112.823517] Call Trace:
[ 1112.827058]
[ 1112.830207] __schedule+0xcba/0x1940
[ 1112.835017] ? io_schedule_timeout+0x140/0x140
[ 1112.840799] ? find_held_lock+0x2b/0x80
[ 1112.845899] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.852078] schedule+0xd4/0x260
[ 1112.856493] schedule_timeout+0x13f/0x290
[ 1112.861789] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.868157] ? trace_contention_end+0xb3/0x1a0
[ 1112.873942] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.879631] ? ww_mutex_lock+0x160/0x160
[ 1112.884828] msleep+0x1b/0x30
[ 1112.888951] napi_set_threaded+0x3a5/0x440
[ 1112.894347] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.899834] netif_set_threaded+0x257/0x400
[ 1112.905326] threaded_store+0x1b8/0x220
[ 1112.910430] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.915726] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.921022] ? sysfs_kf_write+0x65/0x160
[ 1112.926220] ? sysfs_file_ops+0x140/0x140
[ 1112.931514] kernfs_fop_write_iter+0x335/0x510
[ 1112.937299] ? kernfs_ops+0xf0/0xf0
[ 1112.942007] new_sync_write+0x333/0x750
[ 1112.947108] ? __lock_acquire+0x508/0xc10
[ 1112.952402] ? new_sync_read+0x740/0x740
[ 1112.957601] ? lock_acquire.part.0+0xbc/0x260
[ 1112.963286] ? ksys_write+0x116/0x250
[ 1112.968195] vfs_write+0x657/0x9b0
[ 1112.972811] ksys_write+0x116/0x250
[ 1112.977521] ? __ia32_sys_read+0xc0/0xc0
[ 1112.982720] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.988307] ? rcu_is_watching+0x15/0xd0
[ 1112.993504] do_syscall_64+0xf3/0x650
[ 1112.998407] ? trace_hardirqs_off+0xd/0x30
[ 1113.003800] ? exc_page_fault+0xda/0xf0
[ 1113.008901] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.015367] RIP: 0033:0x7f92d5e2322e
[ 1113.020176] RSP: 002b:00007ffe397c6d60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.029470] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f92d5e2322e
[ 1113.038280] RDX: 0000000000000001 RSI: 0000562aa57f7fe0 RDI: 0000000000000007
[ 1113.047087] RBP: 00007ffe397c6d70 R08: 0000000000000000 R09: 0000000000000000
[ 1113.055886] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f92d5c9b390
[ 1113.064684] R13: 0000562aa57f7fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.073497]
[ 1113.076760] \x0aShowing all locks held in the system:
[ 1113.085298] 1 lock held by khungtaskd/185:
[ 1113.090690] #0: ffffffff97efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.102171] 4 locks held by python3/3616:
[ 1113.107467] #0: ff110001307c43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.117356] #1: ff1100014508d080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.128316] #2: ff11000123e64b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.139471] #3: ff11000123e41d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.149568] 4 locks held by python3/5666:
[ 1113.154863] #0: ff110001307c43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.164750] #1: ff110001af5d1480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.175711] #2: ff11000123e64b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.186862] #3: ff11000123e41d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.196950] 5 locks held by (systemd-user-)/6718:
[ 1113.203024] #0: ff110001308ec3e8 (sb_writers#6){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.212910] #1: ff1100012f5a2080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.223869] #2: ffffffff97f69ce0 (cgroup_mutex){+.+.}-{4:4}, at: cgroup_kn_lock_live+0xe2/0x3e0
[ 1113.234537] #3: ffffffff97d68970 (cpu_hotplug_lock){++++}-{0:0}, at: cgroup_procs_write_start+0x3e5/0x650
[ 1113.246178] #4: ffffffff97f69a50 (cgroup_threadgroup_rwsem){++++}-{0:0}, at: cgroup_procs_write_start+0x3f1/0x650
[ 1113.258601]
[ 1113.261067] =============================================\x0a
[ 1235.405689] INFO: task python3:5666 blocked for more than 368 seconds.
[ 1235.413839] Not tainted 7.1.0-rc2-axza-g2dee1e3ea030 #1
[ 1235.421089] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.430679] task:python3 state:D stack:25672 pid:5666 tgid:5666 ppid:5665 task_flags:0x400100 flags:0x00080002
[ 1235.443885] Call Trace:
[ 1235.447424]
[ 1235.450575] __schedule+0xcba/0x1940
[ 1235.455393] ? io_schedule_timeout+0x140/0x140
[ 1235.461179] ? find_held_lock+0x2b/0x80
[ 1235.466284] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.472168] schedule+0xd4/0x260
[ 1235.476588] schedule_preempt_disabled+0x18/0x30
[ 1235.482560] __mutex_lock+0x6a3/0x2000
[ 1235.487553] ? threaded_store+0x132/0x220
[ 1235.492849] ? ww_mutex_lock+0x160/0x160
[ 1235.498047] ? selinux_inode_free_security+0x330/0x330
[ 1235.504606] ? cap_capable+0x1d6/0x3e0
[ 1235.509614] ? threaded_store+0x132/0x220
[ 1235.514909] threaded_store+0x132/0x220
[ 1235.520010] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.525307] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.530603] ? sysfs_kf_write+0x65/0x160
[ 1235.535804] ? sysfs_file_ops+0x140/0x140
[ 1235.541100] kernfs_fop_write_iter+0x335/0x510
[ 1235.546883] ? kernfs_ops+0xf0/0xf0
[ 1235.551593] new_sync_write+0x333/0x750
[ 1235.556697] ? __lock_acquire+0x508/0xc10
[ 1235.561992] ? new_sync_read+0x740/0x740
[ 1235.567195] ? lock_acquire.part.0+0xbc/0x260
[ 1235.572881] ? ksys_write+0x116/0x250
[ 1235.577789] vfs_write+0x657/0x9b0
[ 1235.582406] ksys_write+0x116/0x250
[ 1235.587118] ? __ia32_sys_read+0xc0/0xc0
[ 1235.592306] ? rcu_is_watching+0x15/0xd0
[ 1235.597504] ? rcu_is_watching+0x15/0xd0
[ 1235.602703] do_syscall_64+0xf3/0x650
[ 1235.607608] ? irq_exit_rcu+0x1a/0x30
[ 1235.612516] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.618987] RIP: 0033:0x7f1693cf722e
[ 1235.623796] RSP: 002b:00007ffd3eb02df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.633094] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1693cf722e
[ 1235.641903] RDX: 0000000000000001 RSI: 000055c21fa86fe0 RDI: 0000000000000007
[ 1235.650708] RBP: 00007ffd3eb02e00 R08: 0000000000000000 R09: 0000000000000000
[ 1235.659516] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1693b6f390
[ 1235.668328] R13: 000055c21fa86fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.677142]
[ 1235.680433] INFO: task python3:5666 is blocked on a mutex likely owned by task python3:3616.
[ 1235.690706] task:python3 state:D stack:25576 pid:3616 tgid:3616 ppid:3615 task_flags:0x400100 flags:0x00080802
[ 1235.703908] Call Trace:
[ 1235.707445]
[ 1235.710595] __schedule+0xcba/0x1940
[ 1235.715398] ? io_schedule_timeout+0x140/0x140
[ 1235.721182] ? find_held_lock+0x2b/0x80
[ 1235.726285] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.732462] schedule+0xd4/0x260
[ 1235.736880] schedule_timeout+0x13f/0x290
[ 1235.742176] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.748546] ? trace_contention_end+0xb3/0x1a0
[ 1235.754327] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.760018] ? ww_mutex_lock+0x160/0x160
[ 1235.765218] msleep+0x1b/0x30
[ 1235.769334] napi_set_threaded+0x3a5/0x440
[ 1235.774728] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.780221] netif_set_threaded+0x257/0x400
[ 1235.785715] threaded_store+0x1b8/0x220
[ 1235.790815] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.796114] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.801408] ? sysfs_kf_write+0x65/0x160
[ 1235.806607] ? sysfs_file_ops+0x140/0x140
[ 1235.811904] kernfs_fop_write_iter+0x335/0x510
[ 1235.817686] ? kernfs_ops+0xf0/0xf0
[ 1235.822397] new_sync_write+0x333/0x750
[ 1235.827498] ? __lock_acquire+0x508/0xc10
[ 1235.832794] ? new_sync_read+0x740/0x740
[ 1235.837993] ? lock_acquire.part.0+0xbc/0x260
[ 1235.843676] ? ksys_write+0x116/0x250
[ 1235.848586] vfs_write+0x657/0x9b0
[ 1235.853200] ksys_write+0x116/0x250
[ 1235.857912] ? __ia32_sys_read+0xc0/0xc0
[ 1235.863111] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.868697] ? rcu_is_watching+0x15/0xd0
[ 1235.873896] do_syscall_64+0xf3/0x650
[ 1235.878799] ? trace_hardirqs_off+0xd/0x30
[ 1235.884194] ? exc_page_fault+0xda/0xf0
[ 1235.889297] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.895764] RIP: 0033:0x7f92d5e2322e
[ 1235.900574] RSP: 002b:00007ffe397c6d60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.909862] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f92d5e2322e
[ 1235.918657] RDX: 0000000000000001 RSI: 0000562aa57f7fe0 RDI: 0000000000000007
[ 1235.927463] RBP: 00007ffe397c6d70 R08: 0000000000000000 R09: 0000000000000000
[ 1235.936268] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f92d5c9b390
[ 1235.945077] R13: 0000562aa57f7fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.953891]
[ 1235.957156] \x0aShowing all locks held in the system:
[ 1235.965697] 1 lock held by khungtaskd/185:
[ 1235.971089] #0: ffffffff97efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1235.982570] 4 locks held by python3/3616:
[ 1235.987862] #0: ff110001307c43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1235.997754] #1: ff1100014508d080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.008715] #2: ff11000123e64b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.019862] #3: ff11000123e41d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.029958] 4 locks held by python3/5666:
[ 1236.035250] #0: ff110001307c43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.045136] #1: ff110001af5d1480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.056098] #2: ff11000123e64b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.067257] #3: ff11000123e41d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.077345]
[ 1236.079809] =============================================\x0a
[ 1358.287119] INFO: task python3:5666 blocked for more than 491 seconds.
[ 1358.295267] Not tainted 7.1.0-rc2-axza-g2dee1e3ea030 #1
[ 1358.302518] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.312104] task:python3 state:D stack:25672 pid:5666 tgid:5666 ppid:5665 task_flags:0x400100 flags:0x00080002
[ 1358.325310] Call Trace:
[ 1358.328851]
[ 1358.332002] __schedule+0xcba/0x1940
[ 1358.336819] ? io_schedule_timeout+0x140/0x140
[ 1358.342604] ? find_held_lock+0x2b/0x80
[ 1358.347709] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.353594] schedule+0xd4/0x260
[ 1358.358010] schedule_preempt_disabled+0x18/0x30
[ 1358.363989] __mutex_lock+0x6a3/0x2000
[ 1358.368992] ? threaded_store+0x132/0x220
[ 1358.374289] ? ww_mutex_lock+0x160/0x160
[ 1358.379489] ? selinux_inode_free_security+0x330/0x330
[ 1358.386057] ? cap_capable+0x1d6/0x3e0
[ 1358.391064] ? threaded_store+0x132/0x220
[ 1358.396359] threaded_store+0x132/0x220
[ 1358.401460] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.406758] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.412054] ? sysfs_kf_write+0x65/0x160
[ 1358.417255] ? sysfs_file_ops+0x140/0x140
[ 1358.422552] kernfs_fop_write_iter+0x335/0x510
[ 1358.428332] ? kernfs_ops+0xf0/0xf0
[ 1358.433043] new_sync_write+0x333/0x750
[ 1358.438135] ? __lock_acquire+0x508/0xc10
[ 1358.443430] ? new_sync_read+0x740/0x740
[ 1358.448631] ? lock_acquire.part.0+0xbc/0x260
[ 1358.454317] ? ksys_write+0x116/0x250
[ 1358.459226] vfs_write+0x657/0x9b0
[ 1358.463842] ksys_write+0x116/0x250
[ 1358.468553] ? __ia32_sys_read+0xc0/0xc0
[ 1358.473750] ? rcu_is_watching+0x15/0xd0
[ 1358.478946] ? rcu_is_watching+0x15/0xd0
[ 1358.484150] do_syscall_64+0xf3/0x650
[ 1358.489047] ? irq_exit_rcu+0x1a/0x30
[ 1358.493957] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.500422] RIP: 0033:0x7f1693cf722e
[ 1358.505231] RSP: 002b:00007ffd3eb02df0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.514521] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f1693cf722e
[ 1358.523326] RDX: 0000000000000001 RSI: 000055c21fa86fe0 RDI: 0000000000000007
[ 1358.532130] RBP: 00007ffd3eb02e00 R08: 0000000000000000 R09: 0000000000000000
[ 1358.540936] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f1693b6f390
[ 1358.549745] R13: 000055c21fa86fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.558559]
[ 1358.561850] INFO: task python3:5666 is blocked on a mutex likely owned by task python3:3616.
[ 1358.572123] task:python3 state:D stack:25576 pid:3616 tgid:3616 ppid:3615 task_flags:0x400100 flags:0x00080802
[ 1358.585322] Call Trace:
[ 1358.588860]
[ 1358.592012] __schedule+0xcba/0x1940
[ 1358.596824] ? io_schedule_timeout+0x140/0x140
[ 1358.602609] ? find_held_lock+0x2b/0x80
[ 1358.607711] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.613887] schedule+0xd4/0x260
[ 1358.618304] schedule_timeout+0x13f/0x290
[ 1358.623600] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.629970] ? trace_contention_end+0xb3/0x1a0
[ 1358.635753] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.641443] ? ww_mutex_lock+0x160/0x160
[ 1358.646641] msleep+0x1b/0x30
[ 1358.650766] napi_set_threaded+0x3a5/0x440
[ 1358.656159] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.661652] netif_set_threaded+0x257/0x400
[ 1358.667145] threaded_store+0x1b8/0x220
[ 1358.672245] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.677542] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.682836] ? sysfs_kf_write+0x65/0x160
[ 1358.688036] ? sysfs_file_ops+0x140/0x140
[ 1358.693324] kernfs_fop_write_iter+0x335/0x510
[ 1358.699108] ? kernfs_ops+0xf0/0xf0
[ 1358.703818] new_sync_write+0x333/0x750
[ 1358.708920] ? __lock_acquire+0x508/0xc10
[ 1358.714208] ? new_sync_read+0x740/0x740
[ 1358.719404] ? lock_acquire.part.0+0xbc/0x260
[ 1358.725091] ? ksys_write+0x116/0x250
[ 1358.730001] vfs_write+0x657/0x9b0
[ 1358.734614] ksys_write+0x116/0x250
[ 1358.739323] ? __ia32_sys_read+0xc0/0xc0
[ 1358.744520] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.750107] ? rcu_is_watching+0x15/0xd0
[ 1358.755305] do_syscall_64+0xf3/0x650
[ 1358.760211] ? trace_hardirqs_off+0xd/0x30
[ 1358.765602] ? exc_page_fault+0xda/0xf0
[ 1358.770700] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.777164] RIP: 0033:0x7f92d5e2322e
[ 1358.781970] RSP: 002b:00007ffe397c6d60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.791267] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f92d5e2322e
[ 1358.800073] RDX: 0000000000000001 RSI: 0000562aa57f7fe0 RDI: 0000000000000007
[ 1358.808880] RBP: 00007ffe397c6d70 R08: 0000000000000000 R09: 0000000000000000
[ 1358.817688] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f92d5c9b390
[ 1358.826493] R13: 0000562aa57f7fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.835303]
[ 1358.838573] \x0aShowing all locks held in the system:
[ 1358.847112] 1 lock held by khungtaskd/185:
[ 1358.852505] #0: ffffffff97efdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.863980] 3 locks held by systemd-journal/804:
[ 1358.869961] #0: ff1100180e6372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1358.879851] #1: ff110001a44e6950 (&ep->lock){-.-.}-{3:3}, at: __might_fault+0x97/0x140
[ 1358.889648] #2: ff110001a7546c80 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1358.901207] 4 locks held by python3/3616:
[ 1358.906501] #0: ff110001307c43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.916390] #1: ff1100014508d080 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.927353] #2: ff11000123e64b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.938512] #3: ff11000123e41d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.948608] 4 locks held by python3/5666:
[ 1358.953903] #0: ff110001307c43e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.963794] #1: ff110001af5d1480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.974757] #2: ff11000123e64b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.985979] #3: ff11000123e41d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.996072] 1 lock held by systemd/7512:
[ 1359.001274]
[ 1359.003743] =============================================\x0a