[ 787.481021] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 787.483505] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 787.643230] kselftest: Running tests in drivers/net
[ 989.701163] INFO: task python3:5775 blocked for more than 122 seconds.
[ 989.709354] Not tainted 7.1.0-rc4-erhu-g4a613c0be53a #1
[ 989.716877] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.726464] task:python3 state:D stack:25448 pid:5775 tgid:5775 ppid:5774 task_flags:0x400100 flags:0x00080000
[ 989.739670] Call Trace:
[ 989.743207]
[ 989.746356] __schedule+0xcc3/0x19c0
[ 989.751170] ? io_schedule_timeout+0x140/0x140
[ 989.756943] ? find_held_lock+0x2b/0x80
[ 989.762047] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.767931] schedule+0xd8/0x260
[ 989.772349] schedule_preempt_disabled+0x18/0x30
[ 989.778326] __mutex_lock+0x6af/0x2010
[ 989.783329] ? threaded_store+0x132/0x220
[ 989.788618] ? ww_mutex_lock+0x160/0x160
[ 989.793818] ? selinux_inode_free_security+0x330/0x330
[ 989.800388] ? cap_capable+0x1d6/0x3e0
[ 989.805393] ? threaded_store+0x132/0x220
[ 989.810677] threaded_store+0x132/0x220
[ 989.815778] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.821076] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.826376] ? sysfs_kf_write+0x65/0x160
[ 989.831575] ? sysfs_file_ops+0x140/0x140
[ 989.836867] kernfs_fop_write_iter+0x335/0x510
[ 989.842651] ? kernfs_ops+0xf0/0xf0
[ 989.847359] new_sync_write+0x333/0x750
[ 989.852460] ? __lock_acquire+0x508/0xc10
[ 989.857757] ? new_sync_read+0x740/0x740
[ 989.862955] ? lock_acquire.part.0+0xbc/0x260
[ 989.868638] ? ksys_write+0x116/0x250
[ 989.873548] vfs_write+0x657/0x9b0
[ 989.878162] ksys_write+0x116/0x250
[ 989.882873] ? __ia32_sys_read+0xc0/0xc0
[ 989.888071] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.893660] ? rcu_is_watching+0x15/0xd0
[ 989.898853] do_syscall_64+0xf3/0x650
[ 989.903758] ? trace_hardirqs_off+0xd/0x30
[ 989.909152] ? exc_page_fault+0xda/0xf0
[ 989.914252] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.920729] RIP: 0033:0x7fa8dee9022e
[ 989.925536] RSP: 002b:00007ffc966d0310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.934834] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa8dee9022e
[ 989.943641] RDX: 0000000000000001 RSI: 000055f83ce5e6b0 RDI: 0000000000000007
[ 989.952447] RBP: 00007ffc966d0320 R08: 0000000000000000 R09: 0000000000000000
[ 989.961254] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa8ded08390
[ 989.970051] R13: 000055f83ce5e6b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.978862]
[ 989.982135] INFO: task python3:5775 is blocked on a mutex likely owned by task python3:3713.
[ 989.992408] task:python3 state:D stack:25672 pid:3713 tgid:3713 ppid:3712 task_flags:0x400100 flags:0x00080802
[ 990.005608] Call Trace:
[ 990.009145]
[ 990.012296] __schedule+0xcc3/0x19c0
[ 990.017098] ? io_schedule_timeout+0x140/0x140
[ 990.022871] ? find_held_lock+0x2b/0x80
[ 990.027974] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.034150] schedule+0xd8/0x260
[ 990.038567] schedule_timeout+0x13f/0x290
[ 990.043861] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.050229] ? trace_contention_end+0xb3/0x1a0
[ 990.056013] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.061700] ? ww_mutex_lock+0x160/0x160
[ 990.066900] msleep+0x1b/0x30
[ 990.071025] napi_set_threaded+0x3a5/0x440
[ 990.076419] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.081915] netif_set_threaded+0x257/0x400
[ 990.087407] threaded_store+0x1b8/0x220
[ 990.092507] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.097803] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.103100] ? sysfs_kf_write+0x65/0x160
[ 990.108299] ? sysfs_file_ops+0x140/0x140
[ 990.113595] kernfs_fop_write_iter+0x335/0x510
[ 990.119376] ? kernfs_ops+0xf0/0xf0
[ 990.124086] new_sync_write+0x333/0x750
[ 990.129189] ? __lock_acquire+0x508/0xc10
[ 990.134483] ? new_sync_read+0x740/0x740
[ 990.139683] ? lock_acquire.part.0+0xbc/0x260
[ 990.145367] ? ksys_write+0x116/0x250
[ 990.150274] vfs_write+0x657/0x9b0
[ 990.154881] ksys_write+0x116/0x250
[ 990.159585] ? __ia32_sys_read+0xc0/0xc0
[ 990.164772] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.170358] ? rcu_is_watching+0x15/0xd0
[ 990.175557] do_syscall_64+0xf3/0x650
[ 990.180460] ? trace_hardirqs_off+0xd/0x30
[ 990.185853] ? exc_page_fault+0xda/0xf0
[ 990.190955] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.197419] RIP: 0033:0x7f22696ad22e
[ 990.202227] RSP: 002b:00007ffe7cc6d710 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.211524] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f22696ad22e
[ 990.220323] RDX: 0000000000000001 RSI: 0000564d2419a6b0 RDI: 0000000000000007
[ 990.229130] RBP: 00007ffe7cc6d720 R08: 0000000000000000 R09: 0000000000000000
[ 990.237933] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2269525390
[ 990.246737] R13: 0000564d2419a6b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.255550]
[ 990.258805] \x0aShowing all locks held in the system:
[ 990.267343] 1 lock held by khungtaskd/185:
[ 990.272735] #0: ffffffffb34fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.284208] 3 locks held by systemd-journal/800:
[ 990.290187] #0: ff1100180e6b72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.300076] #1: ffffffffb3702b20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: dput.part.0+0x2fd/0x410
[ 990.312303] #2: ff110001a6539c50 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 990.323849] 4 locks held by python3/3713:
[ 990.329144] #0: ff1100012ed693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.339031] #1: ff1100014c571480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.349995] #2: ff110001220d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.361165] #3: ff11000112171d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.371264] 4 locks held by python3/5775:
[ 990.376555] #0: ff1100012ed693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.386443] #1: ff110001ead72680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.397403] #2: ff110001220d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.408558] #3: ff11000112171d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.418644]
[ 990.421108] =============================================\x0a
[ 1112.582865] INFO: task python3:5775 blocked for more than 245 seconds.
[ 1112.591008] Not tainted 7.1.0-rc4-erhu-g4a613c0be53a #1
[ 1112.598257] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.607837] task:python3 state:D stack:25448 pid:5775 tgid:5775 ppid:5774 task_flags:0x400100 flags:0x00080000
[ 1112.621039] Call Trace:
[ 1112.624578]
[ 1112.627726] __schedule+0xcc3/0x19c0
[ 1112.632542] ? io_schedule_timeout+0x140/0x140
[ 1112.638327] ? find_held_lock+0x2b/0x80
[ 1112.643433] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.649316] schedule+0xd8/0x260
[ 1112.653731] schedule_preempt_disabled+0x18/0x30
[ 1112.659712] __mutex_lock+0x6af/0x2010
[ 1112.664708] ? threaded_store+0x132/0x220
[ 1112.670005] ? ww_mutex_lock+0x160/0x160
[ 1112.675203] ? selinux_inode_free_security+0x330/0x330
[ 1112.681762] ? cap_capable+0x1d6/0x3e0
[ 1112.686770] ? threaded_store+0x132/0x220
[ 1112.692068] threaded_store+0x132/0x220
[ 1112.697158] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.702455] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.707752] ? sysfs_kf_write+0x65/0x160
[ 1112.712949] ? sysfs_file_ops+0x140/0x140
[ 1112.718245] kernfs_fop_write_iter+0x335/0x510
[ 1112.724027] ? kernfs_ops+0xf0/0xf0
[ 1112.728738] new_sync_write+0x333/0x750
[ 1112.733830] ? __lock_acquire+0x508/0xc10
[ 1112.739126] ? new_sync_read+0x740/0x740
[ 1112.744328] ? lock_acquire.part.0+0xbc/0x260
[ 1112.750014] ? ksys_write+0x116/0x250
[ 1112.754923] vfs_write+0x657/0x9b0
[ 1112.759535] ksys_write+0x116/0x250
[ 1112.764244] ? __ia32_sys_read+0xc0/0xc0
[ 1112.769441] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.775027] ? rcu_is_watching+0x15/0xd0
[ 1112.780228] do_syscall_64+0xf3/0x650
[ 1112.785133] ? trace_hardirqs_off+0xd/0x30
[ 1112.790524] ? exc_page_fault+0xda/0xf0
[ 1112.795627] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.802092] RIP: 0033:0x7fa8dee9022e
[ 1112.806899] RSP: 002b:00007ffc966d0310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.816198] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa8dee9022e
[ 1112.825004] RDX: 0000000000000001 RSI: 000055f83ce5e6b0 RDI: 0000000000000007
[ 1112.833808] RBP: 00007ffc966d0320 R08: 0000000000000000 R09: 0000000000000000
[ 1112.842613] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa8ded08390
[ 1112.851422] R13: 000055f83ce5e6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.860232]
[ 1112.863497] INFO: task python3:5775 is blocked on a mutex likely owned by task python3:3713.
[ 1112.873767] task:python3 state:D stack:25672 pid:3713 tgid:3713 ppid:3712 task_flags:0x400100 flags:0x00080802
[ 1112.886967] Call Trace:
[ 1112.890506]
[ 1112.893653] __schedule+0xcc3/0x19c0
[ 1112.898461] ? io_schedule_timeout+0x140/0x140
[ 1112.904242] ? find_held_lock+0x2b/0x80
[ 1112.909343] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.915521] schedule+0xd8/0x260
[ 1112.919937] schedule_timeout+0x13f/0x290
[ 1112.925231] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.931598] ? trace_contention_end+0xb3/0x1a0
[ 1112.937382] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.943071] ? ww_mutex_lock+0x160/0x160
[ 1112.948267] msleep+0x1b/0x30
[ 1112.952390] napi_set_threaded+0x3a5/0x440
[ 1112.957787] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.963282] netif_set_threaded+0x257/0x400
[ 1112.968775] threaded_store+0x1b8/0x220
[ 1112.973877] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.979164] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.984461] ? sysfs_kf_write+0x65/0x160
[ 1112.989658] ? sysfs_file_ops+0x140/0x140
[ 1112.994951] kernfs_fop_write_iter+0x335/0x510
[ 1113.000736] ? kernfs_ops+0xf0/0xf0
[ 1113.005444] new_sync_write+0x333/0x750
[ 1113.010545] ? __lock_acquire+0x508/0xc10
[ 1113.015841] ? new_sync_read+0x740/0x740
[ 1113.021039] ? lock_acquire.part.0+0xbc/0x260
[ 1113.026722] ? ksys_write+0x116/0x250
[ 1113.031633] vfs_write+0x657/0x9b0
[ 1113.036248] ksys_write+0x116/0x250
[ 1113.040950] ? __ia32_sys_read+0xc0/0xc0
[ 1113.046147] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.051735] ? rcu_is_watching+0x15/0xd0
[ 1113.056932] do_syscall_64+0xf3/0x650
[ 1113.061840] ? trace_hardirqs_off+0xd/0x30
[ 1113.067224] ? exc_page_fault+0xda/0xf0
[ 1113.072325] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.078791] RIP: 0033:0x7f22696ad22e
[ 1113.083598] RSP: 002b:00007ffe7cc6d710 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.092892] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f22696ad22e
[ 1113.101700] RDX: 0000000000000001 RSI: 0000564d2419a6b0 RDI: 0000000000000007
[ 1113.110512] RBP: 00007ffe7cc6d720 R08: 0000000000000000 R09: 0000000000000000
[ 1113.119318] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2269525390
[ 1113.128126] R13: 0000564d2419a6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.136938]
[ 1113.140197] \x0aShowing all locks held in the system:
[ 1113.148736] 1 lock held by khungtaskd/185:
[ 1113.154126] #0: ffffffffb34fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.165596] 2 locks held by systemd-journal/800:
[ 1113.171573] #0: ff1100180e8372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1113.181458] #1: ffffffffb3702b20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: dput.part.0+0x2fd/0x410
[ 1113.193695] 4 locks held by python3/3713:
[ 1113.198989] #0: ff1100012ed693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.208876] #1: ff1100014c571480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.219838] #2: ff110001220d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.230994] #3: ff11000112171d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.241084] 4 locks held by python3/5775:
[ 1113.246378] #0: ff1100012ed693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.256265] #1: ff110001ead72680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.267225] #2: ff110001220d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.278381] #3: ff11000112171d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.288467]
[ 1113.290932] =============================================\x0a
[ 1235.464135] INFO: task python3:5775 blocked for more than 368 seconds.
[ 1235.472280] Not tainted 7.1.0-rc4-erhu-g4a613c0be53a #1
[ 1235.479531] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.489122] task:python3 state:D stack:25448 pid:5775 tgid:5775 ppid:5774 task_flags:0x400100 flags:0x00080002
[ 1235.502328] Call Trace:
[ 1235.505868]
[ 1235.509018] __schedule+0xcc3/0x19c0
[ 1235.513837] ? io_schedule_timeout+0x140/0x140
[ 1235.519623] ? find_held_lock+0x2b/0x80
[ 1235.524730] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.530615] schedule+0xd8/0x260
[ 1235.535032] schedule_preempt_disabled+0x18/0x30
[ 1235.541012] __mutex_lock+0x6af/0x2010
[ 1235.546015] ? threaded_store+0x132/0x220
[ 1235.551317] ? ww_mutex_lock+0x160/0x160
[ 1235.556516] ? selinux_inode_free_security+0x330/0x330
[ 1235.563085] ? cap_capable+0x1d6/0x3e0
[ 1235.568094] ? threaded_store+0x132/0x220
[ 1235.573391] threaded_store+0x132/0x220
[ 1235.578492] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.583790] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.589089] ? sysfs_kf_write+0x65/0x160
[ 1235.594292] ? sysfs_file_ops+0x140/0x140
[ 1235.599589] kernfs_fop_write_iter+0x335/0x510
[ 1235.605375] ? kernfs_ops+0xf0/0xf0
[ 1235.610086] new_sync_write+0x333/0x750
[ 1235.615192] ? __lock_acquire+0x508/0xc10
[ 1235.620491] ? new_sync_read+0x740/0x740
[ 1235.625691] ? lock_acquire.part.0+0xbc/0x260
[ 1235.631368] ? ksys_write+0x116/0x250
[ 1235.636278] vfs_write+0x657/0x9b0
[ 1235.640895] ksys_write+0x116/0x250
[ 1235.645608] ? __ia32_sys_read+0xc0/0xc0
[ 1235.650801] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.656392] ? rcu_is_watching+0x15/0xd0
[ 1235.661593] do_syscall_64+0xf3/0x650
[ 1235.666501] ? trace_hardirqs_off+0xd/0x30
[ 1235.671896] ? exc_page_fault+0xda/0xf0
[ 1235.676998] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.683469] RIP: 0033:0x7fa8dee9022e
[ 1235.688280] RSP: 002b:00007ffc966d0310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.697577] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa8dee9022e
[ 1235.706377] RDX: 0000000000000001 RSI: 000055f83ce5e6b0 RDI: 0000000000000007
[ 1235.715185] RBP: 00007ffc966d0320 R08: 0000000000000000 R09: 0000000000000000
[ 1235.723996] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa8ded08390
[ 1235.732805] R13: 000055f83ce5e6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.741620]
[ 1235.744884] INFO: task python3:5775 is blocked on a mutex likely owned by task python3:3713.
[ 1235.755159] task:python3 state:D stack:25672 pid:3713 tgid:3713 ppid:3712 task_flags:0x400100 flags:0x00080802
[ 1235.768361] Call Trace:
[ 1235.771899]
[ 1235.775050] __schedule+0xcc3/0x19c0
[ 1235.779853] ? io_schedule_timeout+0x140/0x140
[ 1235.785637] ? find_held_lock+0x2b/0x80
[ 1235.790741] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.796919] schedule+0xd8/0x260
[ 1235.801337] schedule_timeout+0x13f/0x290
[ 1235.806633] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.813002] ? trace_contention_end+0xb3/0x1a0
[ 1235.818790] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.824478] ? ww_mutex_lock+0x160/0x160
[ 1235.829679] msleep+0x1b/0x30
[ 1235.833805] napi_set_threaded+0x3a5/0x440
[ 1235.839194] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.844692] netif_set_threaded+0x257/0x400
[ 1235.850187] threaded_store+0x1b8/0x220
[ 1235.855289] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.860588] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.865886] ? sysfs_kf_write+0x65/0x160
[ 1235.871086] ? sysfs_file_ops+0x140/0x140
[ 1235.876383] kernfs_fop_write_iter+0x335/0x510
[ 1235.882165] ? kernfs_ops+0xf0/0xf0
[ 1235.886877] new_sync_write+0x333/0x750
[ 1235.891979] ? __lock_acquire+0x508/0xc10
[ 1235.897279] ? new_sync_read+0x740/0x740
[ 1235.902481] ? lock_acquire.part.0+0xbc/0x260
[ 1235.908167] ? ksys_write+0x116/0x250
[ 1235.913076] vfs_write+0x657/0x9b0
[ 1235.917694] ksys_write+0x116/0x250
[ 1235.922408] ? __ia32_sys_read+0xc0/0xc0
[ 1235.927605] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.933195] ? rcu_is_watching+0x15/0xd0
[ 1235.938389] do_syscall_64+0xf3/0x650
[ 1235.943292] ? trace_hardirqs_off+0xd/0x30
[ 1235.948685] ? exc_page_fault+0xda/0xf0
[ 1235.953788] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.960257] RIP: 0033:0x7f22696ad22e
[ 1235.965065] RSP: 002b:00007ffe7cc6d710 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.974364] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f22696ad22e
[ 1235.983174] RDX: 0000000000000001 RSI: 0000564d2419a6b0 RDI: 0000000000000007
[ 1235.991988] RBP: 00007ffe7cc6d720 R08: 0000000000000000 R09: 0000000000000000
[ 1236.000796] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2269525390
[ 1236.009595] R13: 0000564d2419a6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1236.018399]
[ 1236.021663] \x0aShowing all locks held in the system:
[ 1236.030199] 1 lock held by khungtaskd/185:
[ 1236.035592] #0: ffffffffb34fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.047061] 3 locks held by systemd-journal/800:
[ 1236.053038] #0: ff1100180e2372e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 1236.062927] #1: ffffffffb3702b20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: link_path_walk+0x9a7/0x1830
[ 1236.075547] #2: ff1100019cef4390 (ptlock_ptr(ptdesc)#2){+.+.}-{3:3}, at: pte_offset_map_lock+0x114/0x2d0
[ 1236.087106] 4 locks held by python3/3713:
[ 1236.092402] #0: ff1100012ed693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.102291] #1: ff1100014c571480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.113255] #2: ff110001220d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.124413] #3: ff11000112171d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.134507] 4 locks held by python3/5775:
[ 1236.139803] #0: ff1100012ed693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.149691] #1: ff110001ead72680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.160655] #2: ff110001220d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.171814] #3: ff11000112171d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.181904]
[ 1236.184371] =============================================\x0a
[ 1358.345721] INFO: task python3:5775 blocked for more than 491 seconds.
[ 1358.353867] Not tainted 7.1.0-rc4-erhu-g4a613c0be53a #1
[ 1358.361111] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.370706] task:python3 state:D stack:25448 pid:5775 tgid:5775 ppid:5774 task_flags:0x400100 flags:0x00080002
[ 1358.383920] Call Trace:
[ 1358.387461]
[ 1358.390618] __schedule+0xcc3/0x19c0
[ 1358.395438] ? io_schedule_timeout+0x140/0x140
[ 1358.401229] ? find_held_lock+0x2b/0x80
[ 1358.406337] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.412233] schedule+0xd8/0x260
[ 1358.416655] schedule_preempt_disabled+0x18/0x30
[ 1358.422640] __mutex_lock+0x6af/0x2010
[ 1358.427648] ? threaded_store+0x132/0x220
[ 1358.432956] ? ww_mutex_lock+0x160/0x160
[ 1358.438159] ? selinux_inode_free_security+0x330/0x330
[ 1358.444740] ? cap_capable+0x1d6/0x3e0
[ 1358.449753] ? threaded_store+0x132/0x220
[ 1358.455053] threaded_store+0x132/0x220
[ 1358.460159] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.465459] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.470765] ? sysfs_kf_write+0x65/0x160
[ 1358.475976] ? sysfs_file_ops+0x140/0x140
[ 1358.481274] kernfs_fop_write_iter+0x335/0x510
[ 1358.487062] ? kernfs_ops+0xf0/0xf0
[ 1358.491777] new_sync_write+0x333/0x750
[ 1358.496884] ? __lock_acquire+0x508/0xc10
[ 1358.502182] ? new_sync_read+0x740/0x740
[ 1358.507392] ? lock_acquire.part.0+0xbc/0x260
[ 1358.513082] ? ksys_write+0x116/0x250
[ 1358.518000] vfs_write+0x657/0x9b0
[ 1358.522621] ksys_write+0x116/0x250
[ 1358.527339] ? __ia32_sys_read+0xc0/0xc0
[ 1358.532539] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.538132] ? rcu_is_watching+0x15/0xd0
[ 1358.543340] do_syscall_64+0xf3/0x650
[ 1358.548252] ? trace_hardirqs_off+0xd/0x30
[ 1358.553651] ? exc_page_fault+0xda/0xf0
[ 1358.558760] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.565231] RIP: 0033:0x7fa8dee9022e
[ 1358.570046] RSP: 002b:00007ffc966d0310 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.579350] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007fa8dee9022e
[ 1358.588164] RDX: 0000000000000001 RSI: 000055f83ce5e6b0 RDI: 0000000000000007
[ 1358.596975] RBP: 00007ffc966d0320 R08: 0000000000000000 R09: 0000000000000000
[ 1358.605791] R10: 0000000000000000 R11: 0000000000000202 R12: 00007fa8ded08390
[ 1358.614602] R13: 000055f83ce5e6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.623425]
[ 1358.626701] INFO: task python3:5775 is blocked on a mutex likely owned by task python3:3713.
[ 1358.636973] task:python3 state:D stack:25672 pid:3713 tgid:3713 ppid:3712 task_flags:0x400100 flags:0x00080802
[ 1358.650182] Call Trace:
[ 1358.653722]
[ 1358.656875] __schedule+0xcc3/0x19c0
[ 1358.661693] ? io_schedule_timeout+0x140/0x140
[ 1358.667474] ? find_held_lock+0x2b/0x80
[ 1358.672584] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.678766] schedule+0xd8/0x260
[ 1358.683187] schedule_timeout+0x13f/0x290
[ 1358.688489] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.694862] ? trace_contention_end+0xb3/0x1a0
[ 1358.700650] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.706348] ? ww_mutex_lock+0x160/0x160
[ 1358.711548] msleep+0x1b/0x30
[ 1358.715667] napi_set_threaded+0x3a5/0x440
[ 1358.721068] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.726576] netif_set_threaded+0x257/0x400
[ 1358.732072] threaded_store+0x1b8/0x220
[ 1358.737180] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.742482] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.747783] ? sysfs_kf_write+0x65/0x160
[ 1358.752987] ? sysfs_file_ops+0x140/0x140
[ 1358.758289] kernfs_fop_write_iter+0x335/0x510
[ 1358.764075] ? kernfs_ops+0xf0/0xf0
[ 1358.768791] new_sync_write+0x333/0x750
[ 1358.773898] ? __lock_acquire+0x508/0xc10
[ 1358.779198] ? new_sync_read+0x740/0x740
[ 1358.784403] ? lock_acquire.part.0+0xbc/0x260
[ 1358.790093] ? ksys_write+0x116/0x250
[ 1358.795006] vfs_write+0x657/0x9b0
[ 1358.799627] ksys_write+0x116/0x250
[ 1358.804344] ? __ia32_sys_read+0xc0/0xc0
[ 1358.809545] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.815137] ? rcu_is_watching+0x15/0xd0
[ 1358.820341] do_syscall_64+0xf3/0x650
[ 1358.825248] ? trace_hardirqs_off+0xd/0x30
[ 1358.830647] ? exc_page_fault+0xda/0xf0
[ 1358.835751] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.842224] RIP: 0033:0x7f22696ad22e
[ 1358.847035] RSP: 002b:00007ffe7cc6d710 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.856331] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f22696ad22e
[ 1358.865143] RDX: 0000000000000001 RSI: 0000564d2419a6b0 RDI: 0000000000000007
[ 1358.873957] RBP: 00007ffe7cc6d720 R08: 0000000000000000 R09: 0000000000000000
[ 1358.882769] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2269525390
[ 1358.891583] R13: 0000564d2419a6b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.900398]
[ 1358.903674] \x0aShowing all locks held in the system:
[ 1358.912213] 1 lock held by khungtaskd/185:
[ 1358.917612] #0: ffffffffb34fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.929105] 4 locks held by python3/3713:
[ 1358.934406] #0: ff1100012ed693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.944302] #1: ff1100014c571480 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.955273] #2: ff110001220d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.966438] #3: ff11000112171d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.976540] 4 locks held by python3/5775:
[ 1358.981839] #0: ff1100012ed693e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.991738] #1: ff110001ead72680 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1359.002707] #2: ff110001220d2b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1359.013873] #3: ff11000112171d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.023973]
[ 1359.026440] =============================================\x0a