[ 783.474909] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 783.477288] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 783.628090] kselftest: Running tests in drivers/net
[ 989.663892] INFO: task python3:5696 blocked for more than 122 seconds.
[ 989.672126] Not tainted 7.1.0-rc2-ympb-g53cf78e77f48 #1
[ 989.680052] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.689645] task:python3 state:D stack:25672 pid:5696 tgid:5696 ppid:5695 task_flags:0x400100 flags:0x00080000
[ 989.702852] Call Trace:
[ 989.706394]
[ 989.709545] __schedule+0xcba/0x1940
[ 989.714366] ? io_schedule_timeout+0x140/0x140
[ 989.720150] ? find_held_lock+0x2b/0x80
[ 989.725254] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.731133] schedule+0xd4/0x260
[ 989.735553] schedule_preempt_disabled+0x18/0x30
[ 989.741531] __mutex_lock+0x6a3/0x2000
[ 989.746538] ? threaded_store+0x132/0x220
[ 989.751841] ? ww_mutex_lock+0x160/0x160
[ 989.757039] ? selinux_inode_free_security+0x330/0x330
[ 989.763612] ? cap_capable+0x1d6/0x3e0
[ 989.768620] ? threaded_store+0x132/0x220
[ 989.773918] threaded_store+0x132/0x220
[ 989.779014] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.784315] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.789613] ? sysfs_kf_write+0x65/0x160
[ 989.794817] ? sysfs_file_ops+0x140/0x140
[ 989.800111] kernfs_fop_write_iter+0x335/0x510
[ 989.805895] ? kernfs_ops+0xf0/0xf0
[ 989.810606] new_sync_write+0x333/0x750
[ 989.815702] ? __lock_acquire+0x508/0xc10
[ 989.821001] ? new_sync_read+0x740/0x740
[ 989.826193] ? lock_acquire.part.0+0xbc/0x260
[ 989.831880] ? ksys_write+0x116/0x250
[ 989.836790] vfs_write+0x657/0x9b0
[ 989.841403] ksys_write+0x116/0x250
[ 989.846117] ? __ia32_sys_read+0xc0/0xc0
[ 989.851316] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.856908] ? rcu_is_watching+0x15/0xd0
[ 989.862111] do_syscall_64+0xf3/0x650
[ 989.867017] ? trace_hardirqs_off+0xd/0x30
[ 989.872415] ? exc_page_fault+0xda/0xf0
[ 989.877517] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.883978] RIP: 0033:0x7fe3a7a3d22e
[ 989.888790] RSP: 002b:00007ffd7161c760 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.898088] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe3a7a3d22e
[ 989.906896] RDX: 0000000000000001 RSI: 000055acad644fe0 RDI: 0000000000000007
[ 989.915694] RBP: 00007ffd7161c770 R08: 0000000000000000 R09: 0000000000000000
[ 989.924504] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe3a78b5390
[ 989.933313] R13: 000055acad644fe0 R14: 0000000000000007 R15: 0000000000000003
[ 989.942138]
[ 989.945426] INFO: task python3:5696 is blocked on a mutex likely owned by task python3:3625.
[ 989.955700] task:python3 state:D stack:25672 pid:3625 tgid:3625 ppid:3624 task_flags:0x400100 flags:0x00080802
[ 989.968901] Call Trace:
[ 989.972442]
[ 989.975594] __schedule+0xcba/0x1940
[ 989.980409] ? io_schedule_timeout+0x140/0x140
[ 989.986194] ? find_held_lock+0x2b/0x80
[ 989.991288] ? __try_to_del_timer_sync+0x155/0x1f0
[ 989.997465] schedule+0xd4/0x260
[ 990.001887] schedule_timeout+0x13f/0x290
[ 990.007183] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.013554] ? trace_contention_end+0xb3/0x1a0
[ 990.019330] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.025010] ? ww_mutex_lock+0x160/0x160
[ 990.030214] msleep+0x1b/0x30
[ 990.034340] napi_set_threaded+0x3a5/0x440
[ 990.039735] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.045231] netif_set_threaded+0x257/0x400
[ 990.050726] threaded_store+0x1b8/0x220
[ 990.055829] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.061117] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.066412] ? sysfs_kf_write+0x65/0x160
[ 990.071613] ? sysfs_file_ops+0x140/0x140
[ 990.076912] kernfs_fop_write_iter+0x335/0x510
[ 990.082695] ? kernfs_ops+0xf0/0xf0
[ 990.087407] new_sync_write+0x333/0x750
[ 990.092501] ? __lock_acquire+0x508/0xc10
[ 990.097789] ? new_sync_read+0x740/0x740
[ 990.102990] ? lock_acquire.part.0+0xbc/0x260
[ 990.108676] ? ksys_write+0x116/0x250
[ 990.113587] vfs_write+0x657/0x9b0
[ 990.118204] ksys_write+0x116/0x250
[ 990.122918] ? __ia32_sys_read+0xc0/0xc0
[ 990.128119] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.133708] ? rcu_is_watching+0x15/0xd0
[ 990.138908] do_syscall_64+0xf3/0x650
[ 990.143804] ? irq_exit_rcu+0x1a/0x30
[ 990.148713] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.155169] RIP: 0033:0x7fcb4ee3f22e
[ 990.159980] RSP: 002b:00007ffc4cc60360 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.169280] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcb4ee3f22e
[ 990.178091] RDX: 0000000000000001 RSI: 0000558144836fe0 RDI: 0000000000000007
[ 990.186901] RBP: 00007ffc4cc60370 R08: 0000000000000000 R09: 0000000000000000
[ 990.195709] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcb4ecb7390
[ 990.204518] R13: 0000558144836fe0 R14: 0000000000000007 R15: 0000000000000003
[ 990.213331]
[ 990.216587] \x0aShowing all locks held in the system:
[ 990.225126] 1 lock held by khungtaskd/185:
[ 990.230518] #0: ffffffffb1cfdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.242002] 4 locks held by python3/3625:
[ 990.247299] #0: ff1100012de3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.257188] #1: ff1100016e787480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.268145] #2: ff11000122374b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.279302] #3: ff110001223e1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.289395] 4 locks held by python3/5696:
[ 990.294692] #0: ff1100012de3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.304591] #1: ff110001ea4c2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.315566] #2: ff11000122374b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.326732] #3: ff110001223e1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.336820]
[ 990.339288] =============================================\x0a
[ 1027.017208] kworker/u130:1 (238) used greatest stack depth: 21456 bytes left
[ 1112.546125] INFO: task python3:5696 blocked for more than 245 seconds.
[ 1112.554272] Not tainted 7.1.0-rc2-ympb-g53cf78e77f48 #1
[ 1112.561522] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.571112] task:python3 state:D stack:25672 pid:5696 tgid:5696 ppid:5695 task_flags:0x400100 flags:0x00080000
[ 1112.584307] Call Trace:
[ 1112.587847]
[ 1112.591000] __schedule+0xcba/0x1940
[ 1112.595821] ? io_schedule_timeout+0x140/0x140
[ 1112.601605] ? find_held_lock+0x2b/0x80
[ 1112.606714] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.612602] schedule+0xd4/0x260
[ 1112.617021] schedule_preempt_disabled+0x18/0x30
[ 1112.622999] __mutex_lock+0x6a3/0x2000
[ 1112.628003] ? threaded_store+0x132/0x220
[ 1112.633300] ? ww_mutex_lock+0x160/0x160
[ 1112.638499] ? selinux_inode_free_security+0x330/0x330
[ 1112.645067] ? cap_capable+0x1d6/0x3e0
[ 1112.650082] ? threaded_store+0x132/0x220
[ 1112.655510] threaded_store+0x132/0x220
[ 1112.660619] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.665914] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.671214] ? sysfs_kf_write+0x65/0x160
[ 1112.676415] ? sysfs_file_ops+0x140/0x140
[ 1112.681709] kernfs_fop_write_iter+0x335/0x510
[ 1112.687493] ? kernfs_ops+0xf0/0xf0
[ 1112.692205] new_sync_write+0x333/0x750
[ 1112.697306] ? __lock_acquire+0x508/0xc10
[ 1112.702603] ? new_sync_read+0x740/0x740
[ 1112.707806] ? lock_acquire.part.0+0xbc/0x260
[ 1112.713495] ? ksys_write+0x116/0x250
[ 1112.718406] vfs_write+0x657/0x9b0
[ 1112.723021] ksys_write+0x116/0x250
[ 1112.727733] ? __ia32_sys_read+0xc0/0xc0
[ 1112.732932] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.738522] ? rcu_is_watching+0x15/0xd0
[ 1112.743724] do_syscall_64+0xf3/0x650
[ 1112.748630] ? trace_hardirqs_off+0xd/0x30
[ 1112.754028] ? exc_page_fault+0xda/0xf0
[ 1112.759133] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.765600] RIP: 0033:0x7fe3a7a3d22e
[ 1112.770409] RSP: 002b:00007ffd7161c760 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.779707] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe3a7a3d22e
[ 1112.788507] RDX: 0000000000000001 RSI: 000055acad644fe0 RDI: 0000000000000007
[ 1112.797316] RBP: 00007ffd7161c770 R08: 0000000000000000 R09: 0000000000000000
[ 1112.806124] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe3a78b5390
[ 1112.814926] R13: 000055acad644fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.823740]
[ 1112.827006] INFO: task python3:5696 is blocked on a mutex likely owned by task python3:3625.
[ 1112.837272] task:python3 state:D stack:25672 pid:3625 tgid:3625 ppid:3624 task_flags:0x400100 flags:0x00080802
[ 1112.850476] Call Trace:
[ 1112.854017]
[ 1112.857165] __schedule+0xcba/0x1940
[ 1112.861978] ? io_schedule_timeout+0x140/0x140
[ 1112.867762] ? find_held_lock+0x2b/0x80
[ 1112.872865] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.879043] schedule+0xd4/0x260
[ 1112.883461] schedule_timeout+0x13f/0x290
[ 1112.888761] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.895133] ? trace_contention_end+0xb3/0x1a0
[ 1112.900916] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.906605] ? ww_mutex_lock+0x160/0x160
[ 1112.911807] msleep+0x1b/0x30
[ 1112.915935] napi_set_threaded+0x3a5/0x440
[ 1112.921331] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.926826] netif_set_threaded+0x257/0x400
[ 1112.932320] threaded_store+0x1b8/0x220
[ 1112.937423] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.942709] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.948007] ? sysfs_kf_write+0x65/0x160
[ 1112.953207] ? sysfs_file_ops+0x140/0x140
[ 1112.958497] kernfs_fop_write_iter+0x335/0x510
[ 1112.964282] ? kernfs_ops+0xf0/0xf0
[ 1112.968983] new_sync_write+0x333/0x750
[ 1112.974085] ? __lock_acquire+0x508/0xc10
[ 1112.979375] ? new_sync_read+0x740/0x740
[ 1112.984565] ? lock_acquire.part.0+0xbc/0x260
[ 1112.990251] ? ksys_write+0x116/0x250
[ 1112.995160] vfs_write+0x657/0x9b0
[ 1112.999776] ksys_write+0x116/0x250
[ 1113.004486] ? __ia32_sys_read+0xc0/0xc0
[ 1113.009685] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.015273] ? rcu_is_watching+0x15/0xd0
[ 1113.020472] do_syscall_64+0xf3/0x650
[ 1113.025380] ? irq_exit_rcu+0x1a/0x30
[ 1113.030288] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.036755] RIP: 0033:0x7fcb4ee3f22e
[ 1113.041563] RSP: 002b:00007ffc4cc60360 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.050861] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcb4ee3f22e
[ 1113.059671] RDX: 0000000000000001 RSI: 0000558144836fe0 RDI: 0000000000000007
[ 1113.068480] RBP: 00007ffc4cc60370 R08: 0000000000000000 R09: 0000000000000000
[ 1113.077289] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcb4ecb7390
[ 1113.086098] R13: 0000558144836fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.094912]
[ 1113.098170] \x0aShowing all locks held in the system:
[ 1113.106709] 1 lock held by khungtaskd/185:
[ 1113.112102] #0: ffffffffb1cfdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.123585] 4 locks held by python3/3625:
[ 1113.128881] #0: ff1100012de3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.138772] #1: ff1100016e787480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.149733] #2: ff11000122374b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.160881] #3: ff110001223e1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.170980] 4 locks held by python3/5696:
[ 1113.176276] #0: ff1100012de3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.186168] #1: ff110001ea4c2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.197128] #2: ff11000122374b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.208287] #3: ff110001223e1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.218378]
[ 1113.220843] =============================================\x0a
[ 1235.426387] INFO: task python3:5696 blocked for more than 368 seconds.
[ 1235.434537] Not tainted 7.1.0-rc2-ympb-g53cf78e77f48 #1
[ 1235.441788] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.451380] task:python3 state:D stack:25672 pid:5696 tgid:5696 ppid:5695 task_flags:0x400100 flags:0x00080002
[ 1235.464585] Call Trace:
[ 1235.468127]
[ 1235.471277] __schedule+0xcba/0x1940
[ 1235.476094] ? io_schedule_timeout+0x140/0x140
[ 1235.481880] ? find_held_lock+0x2b/0x80
[ 1235.486985] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.492869] schedule+0xd4/0x260
[ 1235.497287] schedule_preempt_disabled+0x18/0x30
[ 1235.503266] __mutex_lock+0x6a3/0x2000
[ 1235.508270] ? threaded_store+0x132/0x220
[ 1235.513569] ? ww_mutex_lock+0x160/0x160
[ 1235.518759] ? selinux_inode_free_security+0x330/0x330
[ 1235.525328] ? cap_capable+0x1d6/0x3e0
[ 1235.530354] ? threaded_store+0x132/0x220
[ 1235.535656] threaded_store+0x132/0x220
[ 1235.540757] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.546052] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.551341] ? sysfs_kf_write+0x65/0x160
[ 1235.556540] ? sysfs_file_ops+0x140/0x140
[ 1235.561838] kernfs_fop_write_iter+0x335/0x510
[ 1235.567625] ? kernfs_ops+0xf0/0xf0
[ 1235.572337] new_sync_write+0x333/0x750
[ 1235.577441] ? __lock_acquire+0x508/0xc10
[ 1235.582740] ? new_sync_read+0x740/0x740
[ 1235.587941] ? lock_acquire.part.0+0xbc/0x260
[ 1235.593630] ? ksys_write+0x116/0x250
[ 1235.598540] vfs_write+0x657/0x9b0
[ 1235.603157] ksys_write+0x116/0x250
[ 1235.607870] ? __ia32_sys_read+0xc0/0xc0
[ 1235.613071] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.618658] ? rcu_is_watching+0x15/0xd0
[ 1235.623863] do_syscall_64+0xf3/0x650
[ 1235.628769] ? trace_hardirqs_off+0xd/0x30
[ 1235.634166] ? exc_page_fault+0xda/0xf0
[ 1235.639260] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.645729] RIP: 0033:0x7fe3a7a3d22e
[ 1235.650541] RSP: 002b:00007ffd7161c760 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.659842] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe3a7a3d22e
[ 1235.668651] RDX: 0000000000000001 RSI: 000055acad644fe0 RDI: 0000000000000007
[ 1235.677461] RBP: 00007ffd7161c770 R08: 0000000000000000 R09: 0000000000000000
[ 1235.686269] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe3a78b5390
[ 1235.695078] R13: 000055acad644fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.703893]
[ 1235.707194] INFO: task python3:5696 is blocked on a mutex likely owned by task python3:3625.
[ 1235.717468] task:python3 state:D stack:25672 pid:3625 tgid:3625 ppid:3624 task_flags:0x400100 flags:0x00080802
[ 1235.730671] Call Trace:
[ 1235.734212]
[ 1235.737364] __schedule+0xcba/0x1940
[ 1235.742178] ? io_schedule_timeout+0x140/0x140
[ 1235.747966] ? find_held_lock+0x2b/0x80
[ 1235.753070] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.759248] schedule+0xd4/0x260
[ 1235.763667] schedule_timeout+0x13f/0x290
[ 1235.768965] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.775326] ? trace_contention_end+0xb3/0x1a0
[ 1235.781112] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.786804] ? ww_mutex_lock+0x160/0x160
[ 1235.792004] msleep+0x1b/0x30
[ 1235.796121] napi_set_threaded+0x3a5/0x440
[ 1235.801516] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.807011] netif_set_threaded+0x257/0x400
[ 1235.812503] threaded_store+0x1b8/0x220
[ 1235.817606] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.822895] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.828194] ? sysfs_kf_write+0x65/0x160
[ 1235.833387] ? sysfs_file_ops+0x140/0x140
[ 1235.838685] kernfs_fop_write_iter+0x335/0x510
[ 1235.844461] ? kernfs_ops+0xf0/0xf0
[ 1235.849172] new_sync_write+0x333/0x750
[ 1235.854275] ? __lock_acquire+0x508/0xc10
[ 1235.859572] ? new_sync_read+0x740/0x740
[ 1235.864772] ? lock_acquire.part.0+0xbc/0x260
[ 1235.870451] ? ksys_write+0x116/0x250
[ 1235.875353] vfs_write+0x657/0x9b0
[ 1235.879969] ksys_write+0x116/0x250
[ 1235.884682] ? __ia32_sys_read+0xc0/0xc0
[ 1235.889882] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.895464] ? rcu_is_watching+0x15/0xd0
[ 1235.900664] do_syscall_64+0xf3/0x650
[ 1235.905570] ? irq_exit_rcu+0x1a/0x30
[ 1235.910470] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.916938] RIP: 0033:0x7fcb4ee3f22e
[ 1235.921748] RSP: 002b:00007ffc4cc60360 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.931046] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcb4ee3f22e
[ 1235.939854] RDX: 0000000000000001 RSI: 0000558144836fe0 RDI: 0000000000000007
[ 1235.948661] RBP: 00007ffc4cc60370 R08: 0000000000000000 R09: 0000000000000000
[ 1235.957460] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcb4ecb7390
[ 1235.966267] R13: 0000558144836fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.975080]
[ 1235.978345] \x0aShowing all locks held in the system:
[ 1235.986888] 1 lock held by khungtaskd/185:
[ 1235.992285] #0: ffffffffb1cfdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.003762] 3 locks held by systemd-journal/800:
[ 1236.009743] #0: ff1100180e2b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1236.019635] #1: ffffffffb1f032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1236.032454] #2: ff1100019c587f10 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1236.044015] 4 locks held by python3/3625:
[ 1236.049309] #0: ff1100012de3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.059200] #1: ff1100016e787480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.070168] #2: ff11000122374b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.081327] #3: ff110001223e1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.091429] 4 locks held by python3/5696:
[ 1236.096723] #0: ff1100012de3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.106610] #1: ff110001ea4c2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.117571] #2: ff11000122374b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.128729] #3: ff110001223e1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.138819]
[ 1236.141285] =============================================\x0a
[ 1358.308617] INFO: task python3:5696 blocked for more than 491 seconds.
[ 1358.316765] Not tainted 7.1.0-rc2-ympb-g53cf78e77f48 #1
[ 1358.324017] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.333609] task:python3 state:D stack:25672 pid:5696 tgid:5696 ppid:5695 task_flags:0x400100 flags:0x00080002
[ 1358.346816] Call Trace:
[ 1358.350356]
[ 1358.353508] __schedule+0xcba/0x1940
[ 1358.358325] ? io_schedule_timeout+0x140/0x140
[ 1358.364112] ? find_held_lock+0x2b/0x80
[ 1358.369216] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.375094] schedule+0xd4/0x260
[ 1358.379511] schedule_preempt_disabled+0x18/0x30
[ 1358.385492] __mutex_lock+0x6a3/0x2000
[ 1358.390496] ? threaded_store+0x132/0x220
[ 1358.395785] ? ww_mutex_lock+0x160/0x160
[ 1358.400985] ? selinux_inode_free_security+0x330/0x330
[ 1358.407555] ? cap_capable+0x1d6/0x3e0
[ 1358.412564] ? threaded_store+0x132/0x220
[ 1358.417861] threaded_store+0x132/0x220
[ 1358.422961] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.428259] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.433558] ? sysfs_kf_write+0x65/0x160
[ 1358.438753] ? sysfs_file_ops+0x140/0x140
[ 1358.444050] kernfs_fop_write_iter+0x335/0x510
[ 1358.449834] ? kernfs_ops+0xf0/0xf0
[ 1358.454548] new_sync_write+0x333/0x750
[ 1358.459653] ? __lock_acquire+0x508/0xc10
[ 1358.464950] ? new_sync_read+0x740/0x740
[ 1358.470144] ? lock_acquire.part.0+0xbc/0x260
[ 1358.475831] ? ksys_write+0x116/0x250
[ 1358.480741] vfs_write+0x657/0x9b0
[ 1358.485355] ksys_write+0x116/0x250
[ 1358.490069] ? __ia32_sys_read+0xc0/0xc0
[ 1358.495266] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.500854] ? rcu_is_watching+0x15/0xd0
[ 1358.506057] do_syscall_64+0xf3/0x650
[ 1358.510963] ? trace_hardirqs_off+0xd/0x30
[ 1358.516357] ? exc_page_fault+0xda/0xf0
[ 1358.521464] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.527932] RIP: 0033:0x7fe3a7a3d22e
[ 1358.532744] RSP: 002b:00007ffd7161c760 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.542045] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fe3a7a3d22e
[ 1358.550856] RDX: 0000000000000001 RSI: 000055acad644fe0 RDI: 0000000000000007
[ 1358.559664] RBP: 00007ffd7161c770 R08: 0000000000000000 R09: 0000000000000000
[ 1358.568472] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fe3a78b5390
[ 1358.577282] R13: 000055acad644fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.586097]
[ 1358.589388] INFO: task python3:5696 is blocked on a mutex likely owned by task python3:3625.
[ 1358.599659] task:python3 state:D stack:25672 pid:3625 tgid:3625 ppid:3624 task_flags:0x400100 flags:0x00080802
[ 1358.612861] Call Trace:
[ 1358.616401]
[ 1358.619554] __schedule+0xcba/0x1940
[ 1358.624364] ? io_schedule_timeout+0x140/0x140
[ 1358.630151] ? find_held_lock+0x2b/0x80
[ 1358.635257] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.641434] schedule+0xd4/0x260
[ 1358.645853] schedule_timeout+0x13f/0x290
[ 1358.651151] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.657523] ? trace_contention_end+0xb3/0x1a0
[ 1358.663309] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.669000] ? ww_mutex_lock+0x160/0x160
[ 1358.674203] msleep+0x1b/0x30
[ 1358.678329] napi_set_threaded+0x3a5/0x440
[ 1358.683724] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.689217] netif_set_threaded+0x257/0x400
[ 1358.694710] threaded_store+0x1b8/0x220
[ 1358.699813] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.705101] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.710395] ? sysfs_kf_write+0x65/0x160
[ 1358.715597] ? sysfs_file_ops+0x140/0x140
[ 1358.720892] kernfs_fop_write_iter+0x335/0x510
[ 1358.726677] ? kernfs_ops+0xf0/0xf0
[ 1358.731389] new_sync_write+0x333/0x750
[ 1358.736493] ? __lock_acquire+0x508/0xc10
[ 1358.741788] ? new_sync_read+0x740/0x740
[ 1358.746989] ? lock_acquire.part.0+0xbc/0x260
[ 1358.752677] ? ksys_write+0x116/0x250
[ 1358.757586] vfs_write+0x657/0x9b0
[ 1358.762202] ksys_write+0x116/0x250
[ 1358.766917] ? __ia32_sys_read+0xc0/0xc0
[ 1358.772119] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.777708] ? rcu_is_watching+0x15/0xd0
[ 1358.782901] do_syscall_64+0xf3/0x650
[ 1358.787810] ? irq_exit_rcu+0x1a/0x30
[ 1358.792718] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.799188] RIP: 0033:0x7fcb4ee3f22e
[ 1358.803996] RSP: 002b:00007ffc4cc60360 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.813294] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fcb4ee3f22e
[ 1358.822105] RDX: 0000000000000001 RSI: 0000558144836fe0 RDI: 0000000000000007
[ 1358.830915] RBP: 00007ffc4cc60370 R08: 0000000000000000 R09: 0000000000000000
[ 1358.839722] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fcb4ecb7390
[ 1358.848531] R13: 0000558144836fe0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.857343]
[ 1358.860609] \x0aShowing all locks held in the system:
[ 1358.869142] 1 lock held by khungtaskd/185:
[ 1358.874534] #0: ffffffffb1cfdf60 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.886011] 3 locks held by systemd-journal/800:
[ 1358.891990] #0: ff1100180e2b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x1940
[ 1358.901878] #1: ffffffffb1f032a0 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 1358.914697] #2: ff110001c244de60 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1358.926256] 4 locks held by python3/3625:
[ 1358.931551] #0: ff1100012de3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.941441] #1: ff1100016e787480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.952405] #2: ff11000122374b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.963560] #3: ff110001223e1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.973661] 4 locks held by python3/5696:
[ 1358.978957] #0: ff1100012de3c3e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.988844] #1: ff110001ea4c2c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.999806] #2: ff11000122374b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.010964] #3: ff110001223e1d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.021052]
[ 1359.023519] =============================================\x0a