[ 791.936043] nipa-hw-worker: drivers/net:napi_threaded.py: timed out
[ 791.938693] nipa-hw-worker: [5/46] Retrying drivers/net:napi_threaded.py
[ 792.068337] kselftest: Running tests in drivers/net
[ 797.168912] kworker/u129:2 (187) used greatest stack depth: 21936 bytes left
[ 989.681688] INFO: task python3:5891 blocked for more than 122 seconds.
[ 989.689922] Not tainted 7.1.0-rc5-zdgg-gb5b3dc554bef #1
[ 989.697848] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 989.707438] task:python3 state:D stack:25672 pid:5891 tgid:5891 ppid:5890 task_flags:0x400100 flags:0x00080000
[ 989.720643] Call Trace:
[ 989.724182]
[ 989.727330] __schedule+0xcc3/0x19c0
[ 989.732148] ? io_schedule_timeout+0x140/0x140
[ 989.737933] ? find_held_lock+0x2b/0x80
[ 989.743039] ? __lock_release.isra.0+0x6b/0x1a0
[ 989.748922] schedule+0xd8/0x260
[ 989.753328] schedule_preempt_disabled+0x18/0x30
[ 989.759308] __mutex_lock+0x6af/0x2010
[ 989.764312] ? threaded_store+0x132/0x220
[ 989.769610] ? ww_mutex_lock+0x160/0x160
[ 989.774808] ? selinux_inode_free_security+0x330/0x330
[ 989.781367] ? cap_capable+0x1d6/0x3e0
[ 989.786374] ? threaded_store+0x132/0x220
[ 989.791672] threaded_store+0x132/0x220
[ 989.796774] ? xps_rxqs_store+0x2e0/0x2e0
[ 989.802071] ? sysfs_file_kobj+0xbd/0x1e0
[ 989.807368] ? sysfs_kf_write+0x65/0x160
[ 989.812566] ? sysfs_file_ops+0x140/0x140
[ 989.817862] kernfs_fop_write_iter+0x335/0x510
[ 989.823644] ? kernfs_ops+0xf0/0xf0
[ 989.828354] new_sync_write+0x333/0x750
[ 989.833458] ? __lock_acquire+0x508/0xc10
[ 989.838753] ? new_sync_read+0x740/0x740
[ 989.843954] ? lock_acquire.part.0+0xbc/0x260
[ 989.849640] ? ksys_write+0x116/0x250
[ 989.854548] vfs_write+0x657/0x9b0
[ 989.859160] ksys_write+0x116/0x250
[ 989.863873] ? __ia32_sys_read+0xc0/0xc0
[ 989.869061] ? kernfs_fop_llseek+0x160/0x1f0
[ 989.874649] ? rcu_is_watching+0x15/0xd0
[ 989.879850] do_syscall_64+0xf3/0x650
[ 989.884754] ? trace_hardirqs_off+0xd/0x30
[ 989.890150] ? exc_page_fault+0xda/0xf0
[ 989.895244] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 989.901713] RIP: 0033:0x7f2e732d122e
[ 989.906524] RSP: 002b:00007ffc1174ac10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 989.915821] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2e732d122e
[ 989.924626] RDX: 0000000000000001 RSI: 00005605bcd226b0 RDI: 0000000000000007
[ 989.933431] RBP: 00007ffc1174ac20 R08: 0000000000000000 R09: 0000000000000000
[ 989.942240] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2e73149390
[ 989.951048] R13: 00005605bcd226b0 R14: 0000000000000007 R15: 0000000000000003
[ 989.959852]
[ 989.963123] INFO: task python3:5891 is blocked on a mutex likely owned by task python3:3825.
[ 989.973394] task:python3 state:D stack:25672 pid:3825 tgid:3825 ppid:3824 task_flags:0x400100 flags:0x00080802
[ 989.986596] Call Trace:
[ 989.990135]
[ 989.993284] __schedule+0xcc3/0x19c0
[ 989.998096] ? io_schedule_timeout+0x140/0x140
[ 990.003877] ? find_held_lock+0x2b/0x80
[ 990.008978] ? __try_to_del_timer_sync+0x155/0x1f0
[ 990.015147] schedule+0xd8/0x260
[ 990.019566] schedule_timeout+0x13f/0x290
[ 990.024864] ? hrtimer_nanosleep_restart+0x270/0x270
[ 990.031235] ? trace_contention_end+0xb3/0x1a0
[ 990.037017] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 990.042706] ? ww_mutex_lock+0x160/0x160
[ 990.047903] msleep+0x1b/0x30
[ 990.052026] napi_set_threaded+0x3a5/0x440
[ 990.057421] ? napi_resume_irqs+0x1a0/0x1a0
[ 990.062914] netif_set_threaded+0x257/0x400
[ 990.068404] threaded_store+0x1b8/0x220
[ 990.073505] ? xps_rxqs_store+0x2e0/0x2e0
[ 990.078801] ? sysfs_file_kobj+0xbd/0x1e0
[ 990.084097] ? sysfs_kf_write+0x65/0x160
[ 990.089294] ? sysfs_file_ops+0x140/0x140
[ 990.094586] kernfs_fop_write_iter+0x335/0x510
[ 990.100371] ? kernfs_ops+0xf0/0xf0
[ 990.105079] new_sync_write+0x333/0x750
[ 990.110178] ? __lock_acquire+0x508/0xc10
[ 990.115474] ? new_sync_read+0x740/0x740
[ 990.120673] ? lock_acquire.part.0+0xbc/0x260
[ 990.126356] ? ksys_write+0x116/0x250
[ 990.131266] vfs_write+0x657/0x9b0
[ 990.135881] ksys_write+0x116/0x250
[ 990.140591] ? __ia32_sys_read+0xc0/0xc0
[ 990.145789] ? kernfs_fop_llseek+0x160/0x1f0
[ 990.151378] ? rcu_is_watching+0x15/0xd0
[ 990.156578] do_syscall_64+0xf3/0x650
[ 990.161484] ? trace_hardirqs_off+0xd/0x30
[ 990.166876] ? exc_page_fault+0xda/0xf0
[ 990.171976] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 990.178441] RIP: 0033:0x7f3d942d922e
[ 990.183246] RSP: 002b:00007ffd1293c210 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 990.192544] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3d942d922e
[ 990.201351] RDX: 0000000000000001 RSI: 000055f17d7f96b0 RDI: 0000000000000007
[ 990.210150] RBP: 00007ffd1293c220 R08: 0000000000000000 R09: 0000000000000000
[ 990.218955] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3d94151390
[ 990.227760] R13: 000055f17d7f96b0 R14: 0000000000000007 R15: 0000000000000003
[ 990.236571]
[ 990.239830] \x0aShowing all locks held in the system:
[ 990.248365] 1 lock held by khungtaskd/185:
[ 990.253755] #0: ffffffff8b2fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 990.265224] 2 locks held by systemd-journal/800:
[ 990.271200] #0: ff1100180dfb72e0 (&rq->__lock){-.-.}-{2:2}, at: __schedule+0x18d/0x19c0
[ 990.281086] #1: ffffffff8b502c20 (mmu_notifier_invalidate_range_start){+.+.}-{0:0}, at: fs_reclaim_acquire+0x7b/0x120
[ 990.293908] 4 locks held by python3/3825:
[ 990.299204] #0: ff110001306d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.309090] #1: ff11000179825c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.320052] #2: ff11000123c68b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.331200] #3: ff11000123c49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.341284] 4 locks held by python3/5891:
[ 990.346579] #0: ff110001306d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 990.356466] #1: ff110001f3cdfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 990.367428] #2: ff11000123c68b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 990.378584] #3: ff11000123c49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 990.388676]
[ 990.391148] =============================================\x0a
[ 1112.562878] INFO: task python3:5891 blocked for more than 245 seconds.
[ 1112.571024] Not tainted 7.1.0-rc5-zdgg-gb5b3dc554bef #1
[ 1112.578272] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1112.587855] task:python3 state:D stack:25672 pid:5891 tgid:5891 ppid:5890 task_flags:0x400100 flags:0x00080000
[ 1112.601061] Call Trace:
[ 1112.604600]
[ 1112.607754] __schedule+0xcc3/0x19c0
[ 1112.612572] ? io_schedule_timeout+0x140/0x140
[ 1112.618360] ? find_held_lock+0x2b/0x80
[ 1112.623469] ? __lock_release.isra.0+0x6b/0x1a0
[ 1112.629352] schedule+0xd8/0x260
[ 1112.633764] schedule_preempt_disabled+0x18/0x30
[ 1112.639744] __mutex_lock+0x6af/0x2010
[ 1112.644742] ? threaded_store+0x132/0x220
[ 1112.650045] ? ww_mutex_lock+0x160/0x160
[ 1112.655244] ? selinux_inode_free_security+0x330/0x330
[ 1112.661813] ? cap_capable+0x1d6/0x3e0
[ 1112.666829] ? threaded_store+0x132/0x220
[ 1112.672135] threaded_store+0x132/0x220
[ 1112.677243] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.682541] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.687842] ? sysfs_kf_write+0x65/0x160
[ 1112.693043] ? sysfs_file_ops+0x140/0x140
[ 1112.698340] kernfs_fop_write_iter+0x335/0x510
[ 1112.704126] ? kernfs_ops+0xf0/0xf0
[ 1112.708837] new_sync_write+0x333/0x750
[ 1112.713941] ? __lock_acquire+0x508/0xc10
[ 1112.719240] ? new_sync_read+0x740/0x740
[ 1112.724442] ? lock_acquire.part.0+0xbc/0x260
[ 1112.730128] ? ksys_write+0x116/0x250
[ 1112.735037] vfs_write+0x657/0x9b0
[ 1112.739654] ksys_write+0x116/0x250
[ 1112.744367] ? __ia32_sys_read+0xc0/0xc0
[ 1112.749569] ? kernfs_fop_llseek+0x160/0x1f0
[ 1112.755160] ? rcu_is_watching+0x15/0xd0
[ 1112.760363] do_syscall_64+0xf3/0x650
[ 1112.765271] ? trace_hardirqs_off+0xd/0x30
[ 1112.770666] ? exc_page_fault+0xda/0xf0
[ 1112.775761] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1112.782230] RIP: 0033:0x7f2e732d122e
[ 1112.787039] RSP: 002b:00007ffc1174ac10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1112.796331] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2e732d122e
[ 1112.805139] RDX: 0000000000000001 RSI: 00005605bcd226b0 RDI: 0000000000000007
[ 1112.813947] RBP: 00007ffc1174ac20 R08: 0000000000000000 R09: 0000000000000000
[ 1112.822756] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2e73149390
[ 1112.831564] R13: 00005605bcd226b0 R14: 0000000000000007 R15: 0000000000000003
[ 1112.840376]
[ 1112.843660] INFO: task python3:5891 is blocked on a mutex likely owned by task python3:3825.
[ 1112.853935] task:python3 state:D stack:25672 pid:3825 tgid:3825 ppid:3824 task_flags:0x400100 flags:0x00080802
[ 1112.867141] Call Trace:
[ 1112.870678]
[ 1112.873830] __schedule+0xcc3/0x19c0
[ 1112.878641] ? io_schedule_timeout+0x140/0x140
[ 1112.884426] ? find_held_lock+0x2b/0x80
[ 1112.889529] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1112.895710] schedule+0xd8/0x260
[ 1112.900128] schedule_timeout+0x13f/0x290
[ 1112.905429] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1112.911797] ? trace_contention_end+0xb3/0x1a0
[ 1112.917583] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1112.923274] ? ww_mutex_lock+0x160/0x160
[ 1112.928473] msleep+0x1b/0x30
[ 1112.932597] napi_set_threaded+0x3a5/0x440
[ 1112.937993] ? napi_resume_irqs+0x1a0/0x1a0
[ 1112.943480] netif_set_threaded+0x257/0x400
[ 1112.948973] threaded_store+0x1b8/0x220
[ 1112.954078] ? xps_rxqs_store+0x2e0/0x2e0
[ 1112.959376] ? sysfs_file_kobj+0xbd/0x1e0
[ 1112.964664] ? sysfs_kf_write+0x65/0x160
[ 1112.969864] ? sysfs_file_ops+0x140/0x140
[ 1112.975152] kernfs_fop_write_iter+0x335/0x510
[ 1112.980938] ? kernfs_ops+0xf0/0xf0
[ 1112.985648] new_sync_write+0x333/0x750
[ 1112.990751] ? __lock_acquire+0x508/0xc10
[ 1112.996045] ? new_sync_read+0x740/0x740
[ 1113.001245] ? lock_acquire.part.0+0xbc/0x260
[ 1113.006930] ? ksys_write+0x116/0x250
[ 1113.011844] vfs_write+0x657/0x9b0
[ 1113.016460] ksys_write+0x116/0x250
[ 1113.021173] ? __ia32_sys_read+0xc0/0xc0
[ 1113.026374] ? kernfs_fop_llseek+0x160/0x1f0
[ 1113.031955] ? rcu_is_watching+0x15/0xd0
[ 1113.037158] do_syscall_64+0xf3/0x650
[ 1113.042066] ? trace_hardirqs_off+0xd/0x30
[ 1113.047460] ? exc_page_fault+0xda/0xf0
[ 1113.052562] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1113.059030] RIP: 0033:0x7f3d942d922e
[ 1113.063839] RSP: 002b:00007ffd1293c210 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1113.073134] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3d942d922e
[ 1113.081942] RDX: 0000000000000001 RSI: 000055f17d7f96b0 RDI: 0000000000000007
[ 1113.090749] RBP: 00007ffd1293c220 R08: 0000000000000000 R09: 0000000000000000
[ 1113.099549] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3d94151390
[ 1113.108355] R13: 000055f17d7f96b0 R14: 0000000000000007 R15: 0000000000000003
[ 1113.117168]
[ 1113.120432] \x0aShowing all locks held in the system:
[ 1113.128969] 1 lock held by khungtaskd/185:
[ 1113.134364] #0: ffffffff8b2fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1113.145844] 4 locks held by python3/3825:
[ 1113.151140] #0: ff110001306d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.161030] #1: ff11000179825c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.171990] #2: ff11000123c68b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.183149] #3: ff11000123c49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.193245] 4 locks held by python3/5891:
[ 1113.198541] #0: ff110001306d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1113.208438] #1: ff110001f3cdfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1113.219403] #2: ff11000123c68b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1113.230563] #3: ff11000123c49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1113.240652]
[ 1113.243119] =============================================\x0a
[ 1235.445044] INFO: task python3:5891 blocked for more than 368 seconds.
[ 1235.453181] Not tainted 7.1.0-rc5-zdgg-gb5b3dc554bef #1
[ 1235.460433] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1235.470026] task:python3 state:D stack:25672 pid:5891 tgid:5891 ppid:5890 task_flags:0x400100 flags:0x00080002
[ 1235.483233] Call Trace:
[ 1235.486773]
[ 1235.489927] __schedule+0xcc3/0x19c0
[ 1235.494745] ? io_schedule_timeout+0x140/0x140
[ 1235.500530] ? find_held_lock+0x2b/0x80
[ 1235.505637] ? __lock_release.isra.0+0x6b/0x1a0
[ 1235.511522] schedule+0xd8/0x260
[ 1235.515940] schedule_preempt_disabled+0x18/0x30
[ 1235.521921] __mutex_lock+0x6af/0x2010
[ 1235.526929] ? threaded_store+0x132/0x220
[ 1235.532231] ? ww_mutex_lock+0x160/0x160
[ 1235.537430] ? selinux_inode_free_security+0x330/0x330
[ 1235.543999] ? cap_capable+0x1d6/0x3e0
[ 1235.549008] ? threaded_store+0x132/0x220
[ 1235.554305] threaded_store+0x132/0x220
[ 1235.559410] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.564710] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.570013] ? sysfs_kf_write+0x65/0x160
[ 1235.575215] ? sysfs_file_ops+0x140/0x140
[ 1235.580510] kernfs_fop_write_iter+0x335/0x510
[ 1235.586297] ? kernfs_ops+0xf0/0xf0
[ 1235.591007] new_sync_write+0x333/0x750
[ 1235.596111] ? __lock_acquire+0x508/0xc10
[ 1235.601410] ? new_sync_read+0x740/0x740
[ 1235.606611] ? lock_acquire.part.0+0xbc/0x260
[ 1235.612288] ? ksys_write+0x116/0x250
[ 1235.617201] vfs_write+0x657/0x9b0
[ 1235.621818] ksys_write+0x116/0x250
[ 1235.626531] ? __ia32_sys_read+0xc0/0xc0
[ 1235.631732] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.637322] ? rcu_is_watching+0x15/0xd0
[ 1235.642526] do_syscall_64+0xf3/0x650
[ 1235.647434] ? trace_hardirqs_off+0xd/0x30
[ 1235.652829] ? exc_page_fault+0xda/0xf0
[ 1235.657932] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.664394] RIP: 0033:0x7f2e732d122e
[ 1235.669204] RSP: 002b:00007ffc1174ac10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.678498] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2e732d122e
[ 1235.687307] RDX: 0000000000000001 RSI: 00005605bcd226b0 RDI: 0000000000000007
[ 1235.696116] RBP: 00007ffc1174ac20 R08: 0000000000000000 R09: 0000000000000000
[ 1235.704924] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2e73149390
[ 1235.713733] R13: 00005605bcd226b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.722545]
[ 1235.725819] INFO: task python3:5891 is blocked on a mutex likely owned by task python3:3825.
[ 1235.736094] task:python3 state:D stack:25672 pid:3825 tgid:3825 ppid:3824 task_flags:0x400100 flags:0x00080802
[ 1235.749296] Call Trace:
[ 1235.752833]
[ 1235.755985] __schedule+0xcc3/0x19c0
[ 1235.760796] ? io_schedule_timeout+0x140/0x140
[ 1235.766580] ? find_held_lock+0x2b/0x80
[ 1235.771686] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1235.777866] schedule+0xd8/0x260
[ 1235.782285] schedule_timeout+0x13f/0x290
[ 1235.787584] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1235.793953] ? trace_contention_end+0xb3/0x1a0
[ 1235.799739] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1235.805430] ? ww_mutex_lock+0x160/0x160
[ 1235.810629] msleep+0x1b/0x30
[ 1235.814755] napi_set_threaded+0x3a5/0x440
[ 1235.820153] ? napi_resume_irqs+0x1a0/0x1a0
[ 1235.825650] netif_set_threaded+0x257/0x400
[ 1235.831142] threaded_store+0x1b8/0x220
[ 1235.836248] ? xps_rxqs_store+0x2e0/0x2e0
[ 1235.841546] ? sysfs_file_kobj+0xbd/0x1e0
[ 1235.846835] ? sysfs_kf_write+0x65/0x160
[ 1235.852025] ? sysfs_file_ops+0x140/0x140
[ 1235.857321] kernfs_fop_write_iter+0x335/0x510
[ 1235.863107] ? kernfs_ops+0xf0/0xf0
[ 1235.867818] new_sync_write+0x333/0x750
[ 1235.872920] ? __lock_acquire+0x508/0xc10
[ 1235.878218] ? new_sync_read+0x740/0x740
[ 1235.883417] ? lock_acquire.part.0+0xbc/0x260
[ 1235.889103] ? ksys_write+0x116/0x250
[ 1235.894014] vfs_write+0x657/0x9b0
[ 1235.898630] ksys_write+0x116/0x250
[ 1235.903343] ? __ia32_sys_read+0xc0/0xc0
[ 1235.908544] ? kernfs_fop_llseek+0x160/0x1f0
[ 1235.914135] ? rcu_is_watching+0x15/0xd0
[ 1235.919337] do_syscall_64+0xf3/0x650
[ 1235.924245] ? trace_hardirqs_off+0xd/0x30
[ 1235.929631] ? exc_page_fault+0xda/0xf0
[ 1235.934724] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1235.941191] RIP: 0033:0x7f3d942d922e
[ 1235.946001] RSP: 002b:00007ffd1293c210 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1235.955297] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3d942d922e
[ 1235.964096] RDX: 0000000000000001 RSI: 000055f17d7f96b0 RDI: 0000000000000007
[ 1235.972908] RBP: 00007ffd1293c220 R08: 0000000000000000 R09: 0000000000000000
[ 1235.981716] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3d94151390
[ 1235.990524] R13: 000055f17d7f96b0 R14: 0000000000000007 R15: 0000000000000003
[ 1235.999329]
[ 1236.002595] \x0aShowing all locks held in the system:
[ 1236.011131] 1 lock held by khungtaskd/185:
[ 1236.016527] #0: ffffffff8b2fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1236.028010] 4 locks held by python3/3825:
[ 1236.033307] #0: ff110001306d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.043198] #1: ff11000179825c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.054162] #2: ff11000123c68b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.065321] #3: ff11000123c49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.075415] 4 locks held by python3/5891:
[ 1236.080710] #0: ff110001306d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1236.090598] #1: ff110001f3cdfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1236.101561] #2: ff11000123c68b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1236.112721] #3: ff11000123c49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1236.122812]
[ 1236.125279] =============================================\x0a
[ 1358.325229] INFO: task python3:5891 blocked for more than 491 seconds.
[ 1358.333367] Not tainted 7.1.0-rc5-zdgg-gb5b3dc554bef #1
[ 1358.340607] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[ 1358.350188] task:python3 state:D stack:25672 pid:5891 tgid:5891 ppid:5890 task_flags:0x400100 flags:0x00080002
[ 1358.363394] Call Trace:
[ 1358.366933]
[ 1358.370087] __schedule+0xcc3/0x19c0
[ 1358.374904] ? io_schedule_timeout+0x140/0x140
[ 1358.380688] ? find_held_lock+0x2b/0x80
[ 1358.385793] ? __lock_release.isra.0+0x6b/0x1a0
[ 1358.391675] schedule+0xd8/0x260
[ 1358.396103] schedule_preempt_disabled+0x18/0x30
[ 1358.402086] __mutex_lock+0x6af/0x2010
[ 1358.407089] ? threaded_store+0x132/0x220
[ 1358.412381] ? ww_mutex_lock+0x160/0x160
[ 1358.417578] ? selinux_inode_free_security+0x330/0x330
[ 1358.424147] ? cap_capable+0x1d6/0x3e0
[ 1358.429156] ? threaded_store+0x132/0x220
[ 1358.434452] threaded_store+0x132/0x220
[ 1358.439551] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.444849] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.450144] ? sysfs_kf_write+0x65/0x160
[ 1358.455342] ? sysfs_file_ops+0x140/0x140
[ 1358.460639] kernfs_fop_write_iter+0x335/0x510
[ 1358.466421] ? kernfs_ops+0xf0/0xf0
[ 1358.471132] new_sync_write+0x333/0x750
[ 1358.476227] ? __lock_acquire+0x508/0xc10
[ 1358.481522] ? new_sync_read+0x740/0x740
[ 1358.486722] ? lock_acquire.part.0+0xbc/0x260
[ 1358.492399] ? ksys_write+0x116/0x250
[ 1358.497309] vfs_write+0x657/0x9b0
[ 1358.501921] ksys_write+0x116/0x250
[ 1358.506633] ? __ia32_sys_read+0xc0/0xc0
[ 1358.511821] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.517408] ? rcu_is_watching+0x15/0xd0
[ 1358.522608] do_syscall_64+0xf3/0x650
[ 1358.527512] ? trace_hardirqs_off+0xd/0x30
[ 1358.532909] ? exc_page_fault+0xda/0xf0
[ 1358.538002] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.544462] RIP: 0033:0x7f2e732d122e
[ 1358.549270] RSP: 002b:00007ffc1174ac10 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.558569] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f2e732d122e
[ 1358.567376] RDX: 0000000000000001 RSI: 00005605bcd226b0 RDI: 0000000000000007
[ 1358.576183] RBP: 00007ffc1174ac20 R08: 0000000000000000 R09: 0000000000000000
[ 1358.584992] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f2e73149390
[ 1358.593800] R13: 00005605bcd226b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.602605]
[ 1358.605888] INFO: task python3:5891 is blocked on a mutex likely owned by task python3:3825.
[ 1358.616158] task:python3 state:D stack:25672 pid:3825 tgid:3825 ppid:3824 task_flags:0x400100 flags:0x00080802
[ 1358.629361] Call Trace:
[ 1358.632900]
[ 1358.636048] __schedule+0xcc3/0x19c0
[ 1358.640857] ? io_schedule_timeout+0x140/0x140
[ 1358.646637] ? find_held_lock+0x2b/0x80
[ 1358.651737] ? __try_to_del_timer_sync+0x155/0x1f0
[ 1358.657915] schedule+0xd8/0x260
[ 1358.662334] schedule_timeout+0x13f/0x290
[ 1358.667632] ? hrtimer_nanosleep_restart+0x270/0x270
[ 1358.673990] ? trace_contention_end+0xb3/0x1a0
[ 1358.679772] ? hrtimers_cpu_dying+0x3e0/0x3e0
[ 1358.685460] ? ww_mutex_lock+0x160/0x160
[ 1358.690649] msleep+0x1b/0x30
[ 1358.694774] napi_set_threaded+0x3a5/0x440
[ 1358.700168] ? napi_resume_irqs+0x1a0/0x1a0
[ 1358.705663] netif_set_threaded+0x257/0x400
[ 1358.711154] threaded_store+0x1b8/0x220
[ 1358.716256] ? xps_rxqs_store+0x2e0/0x2e0
[ 1358.721554] ? sysfs_file_kobj+0xbd/0x1e0
[ 1358.726841] ? sysfs_kf_write+0x65/0x160
[ 1358.732037] ? sysfs_file_ops+0x140/0x140
[ 1358.737332] kernfs_fop_write_iter+0x335/0x510
[ 1358.743117] ? kernfs_ops+0xf0/0xf0
[ 1358.747816] new_sync_write+0x333/0x750
[ 1358.752917] ? __lock_acquire+0x508/0xc10
[ 1358.758214] ? new_sync_read+0x740/0x740
[ 1358.763414] ? lock_acquire.part.0+0xbc/0x260
[ 1358.769098] ? ksys_write+0x116/0x250
[ 1358.774009] vfs_write+0x657/0x9b0
[ 1358.778623] ksys_write+0x116/0x250
[ 1358.783334] ? __ia32_sys_read+0xc0/0xc0
[ 1358.788534] ? kernfs_fop_llseek+0x160/0x1f0
[ 1358.794122] ? rcu_is_watching+0x15/0xd0
[ 1358.799323] do_syscall_64+0xf3/0x650
[ 1358.804230] ? trace_hardirqs_off+0xd/0x30
[ 1358.809622] ? exc_page_fault+0xda/0xf0
[ 1358.814722] entry_SYSCALL_64_after_hwframe+0x4b/0x53
[ 1358.821189] RIP: 0033:0x7f3d942d922e
[ 1358.825995] RSP: 002b:00007ffd1293c210 EFLAGS: 00000202 ORIG_RAX: 0000000000000001
[ 1358.835290] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007f3d942d922e
[ 1358.844097] RDX: 0000000000000001 RSI: 000055f17d7f96b0 RDI: 0000000000000007
[ 1358.852903] RBP: 00007ffd1293c220 R08: 0000000000000000 R09: 0000000000000000
[ 1358.861710] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f3d94151390
[ 1358.870516] R13: 000055f17d7f96b0 R14: 0000000000000007 R15: 0000000000000003
[ 1358.879327]
[ 1358.882589] \x0aShowing all locks held in the system:
[ 1358.891126] 1 lock held by khungtaskd/185:
[ 1358.896519] #0: ffffffff8b2fdde0 (rcu_read_lock){....}-{1:3}, at: rcu_lock_acquire.constprop.0+0x7/0x30
[ 1358.907998] 4 locks held by python3/3825:
[ 1358.913294] #0: ff110001306d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.923183] #1: ff11000179825c80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.934142] #2: ff11000123c68b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.945295] #3: ff11000123c49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1358.955387] 4 locks held by python3/5891:
[ 1358.960682] #0: ff110001306d93e8 (sb_writers#4){.+.+}-{0:0}, at: ksys_write+0x116/0x250
[ 1358.970569] #1: ff110001f3cdfa80 (&of->mutex#2){+.+.}-{4:4}, at: kernfs_fop_write_iter+0x248/0x510
[ 1358.981531] #2: ff11000123c68b50 (kn->active#118){.+.+}-{0:0}, at: kernfs_fop_write_iter+0x29e/0x510
[ 1358.992690] #3: ff11000123c49d68 (&dev->lock){+.+.}-{4:4}, at: threaded_store+0x132/0x220
[ 1359.002780]
[ 1359.005245] =============================================\x0a