[ 9.640054][ T138] sh (138) used greatest stack depth: 24376 bytes left [ 9.640072][ T138] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 9.640074][ T138] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 138, name: sh [ 9.640076][ T138] preempt_count: 2, expected: 0 [ 9.640077][ T138] RCU nest depth: 0, expected: 0 [ 9.640078][ T138] locks held by sh/138: 5, last CPU#2: [ 9.640080][ T138] #0: ffffffffa9e127b8 (low_water_lock){+.+.}-{3:3}, at: do_exit+0x887/0xdc0 [ 9.640092][ T138] #1: ffffffffa9f79cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 9.640098][ T138] #2: ffffffffa9f79d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 9.640102][ T138] #3: ffffffffa9e99660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 9.640106][ T138] #4: ffffffffa9e99560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 9.640110][ T138] irq event stamp: 9936 [ 9.640111][ T138] hardirqs last enabled at (9935): [] __down_trylock_console_sem+0x86/0xa0 [ 9.640113][ T138] hardirqs last disabled at (9936): [] console_emit_next_record+0x3d4/0x4c0 [ 9.640116][ T138] softirqs last enabled at (9216): [] handle_softirqs+0x67c/0x900 [ 9.640118][ T138] softirqs last disabled at (9211): [] __irq_exit_rcu+0x145/0x1c0 [ 9.640120][ T138] Preemption disabled at: [ 9.640121][ T138] [<0000000000000000>] 0x0 [ 9.640128][ T138] CPU: 2 UID: 0 PID: 138 Comm: sh Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 9.640131][ T138] Tainted: [W]=WARN [ 9.640132][ T138] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 9.640134][ T138] Call Trace: [ 9.640135][ T138] [ 9.640137][ T138] dump_stack_lvl+0x6f/0xa0 [ 9.640144][ T138] __might_resched.cold+0x1fe/0x2c1 [ 9.640148][ T138] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 9.640153][ T138] ? __kmalloc_noprof+0xdb/0x760 [ 9.640158][ T138] __kmalloc_noprof+0x443/0x760 [ 9.640162][ T138] ? alloc_buf.isra.0+0x4b/0x260 [ 9.640168][ T138] ? do_raw_spin_unlock+0x59/0x250 [ 9.640171][ T138] alloc_buf.isra.0+0x4b/0x260 [ 9.640175][ T138] put_chars+0x1e1/0x2f0 [ 9.640178][ T138] ? __send_to_port+0x420/0x420 [ 9.640179][ T138] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 9.640184][ T138] ? validate_chain+0x38b/0xc20 [ 9.640189][ T138] hvc_console_print+0x292/0x780 [ 9.640196][ T138] ? hvc_write+0x3a0/0x3a0 [ 9.640199][ T138] ? rcu_is_watching+0x16/0xd0 [ 9.640201][ T138] ? lock_acquire+0x13c/0x160 [ 9.640205][ T138] console_emit_next_record+0x22f/0x4c0 [ 9.640209][ T138] ? devkmsg_read+0x4b0/0x4b0 [ 9.640211][ T138] ? console_flush_one_record+0x106/0x710 [ 9.640214][ T138] ? rcu_is_watching+0x16/0xd0 [ 9.640217][ T138] ? lock_acquire+0x13c/0x160 [ 9.640220][ T138] console_flush_one_record+0x46f/0x710 [ 9.640225][ T138] ? console_emit_next_record+0x4c0/0x4c0 [ 9.640226][ T138] ? __lock_acquire+0x518/0xc20 [ 9.640232][ T138] console_unlock+0xee/0x1f0 [ 9.640235][ T138] ? console_flush_one_record+0x710/0x710 [ 9.640237][ T138] ? rcu_is_watching+0x16/0xd0 [ 9.640239][ T138] ? lock_acquire+0x60/0x160 [ 9.640243][ T138] ? __down_trylock_console_sem+0x5e/0xa0 [ 9.640244][ T138] ? vprintk_emit+0x320/0x3e0 [ 9.640248][ T138] vprintk_emit+0x37c/0x3e0 [ 9.640251][ T138] ? wake_up_klogd_work_func+0x90/0x90 [ 9.640255][ T138] ? __lock_acquire+0x518/0xc20 [ 9.640259][ T138] _printk+0xc7/0x100 [ 9.640262][ T138] ? snapshot_read.cold+0x21/0x21 [ 9.640265][ T138] ? do_raw_spin_lock+0x131/0x280 [ 9.640268][ T138] ? __rwlock_init+0x150/0x150 [ 9.640271][ T138] ? do_raw_spin_lock+0x131/0x280 [ 9.640274][ T138] do_exit.cold+0x82/0x9c [ 9.640278][ T138] ? exit_notify+0x890/0x890 [ 9.640279][ T138] ? __lock_release.isra.0+0x69/0x1a0 [ 9.640282][ T138] ? rcu_is_watching+0x16/0xd0 [ 9.640286][ T138] do_group_exit+0xb8/0x370 [ 9.640289][ T138] __x64_sys_exit_group+0x3c/0x50 [ 9.640291][ T138] x64_sys_call+0x1567/0x1570 [ 9.640293][ T138] do_syscall_64+0xff/0x530 [ 9.640297][ T138] ? exc_page_fault+0xee/0x100 [ 9.640300][ T138] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 9.640302][ T138] RIP: 0033:0x7f9dd26b51b8 [ 9.640305][ T138] Code: Unable to access opcode bytes at 0x7f9dd26b518e. [ 9.640306][ T138] RSP: 002b:00007ffcce7da3a8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7 [ 9.640308][ T138] RAX: ffffffffffffffda RBX: 00007f9dd27e5f88 RCX: 00007f9dd26b51b8 [ 9.640310][ T138] RDX: 00007f9dd25f2a48 RSI: ffffffffffffffb0 RDI: 0000000000000000 [ 9.640310][ T138] RBP: 00007ffcce7da400 R08: 0000000000000000 R09: 0000000000000050 [ 9.640312][ T138] R10: 00007ffcce7da240 R11: 0000000000000246 R12: 0000000000000001 [ 9.640312][ T138] R13: 0000000000000000 R14: 00007f9dd27e4680 R15: 00007f9dd27e5fa0 [ 9.640319][ T138] [ 13.974323][ C0] clocksource: Watchdog remote CPU 2 read timed out [ 13.974408][ C0] [ 13.974411][ C0] ======================================================== [ 13.974412][ C0] WARNING: possible irq lock inversion dependency detected [ 13.974415][ C0] 7.2.0-virtme #1 Tainted: G W [ 13.974417][ C0] -------------------------------------------------------- [ 13.974418][ C0] swapper/0/0 just changed the state of lock: [ 13.974420][ C0] ffffffffa9e99660 (console_owner){..-.}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 13.974435][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 13.974437][ C0] (fs_reclaim){+.+.}-{0:0} [ 13.974439][ C0] [ 13.974439][ C0] [ 13.974439][ C0] and interrupts could create inverse lock ordering between them. [ 13.974439][ C0] [ 13.974440][ C0] [ 13.974440][ C0] other info that might help us debug this: [ 13.974441][ C0] Possible interrupt unsafe locking scenario: [ 13.974441][ C0] [ 13.974442][ C0] CPU0 CPU1 [ 13.974443][ C0] ---- ---- [ 13.974443][ C0] lock(fs_reclaim); [ 13.974445][ C0] local_irq_disable(); [ 13.974446][ C0] lock(console_owner); [ 13.974448][ C0] lock(fs_reclaim); [ 13.974449][ C0] [ 13.974450][ C0] lock(console_owner); [ 13.974452][ C0] [ 13.974452][ C0] *** DEADLOCK *** [ 13.974452][ C0] [ 13.974452][ C0] locks held by swapper/0/0: 4, last CPU#0: [ 13.974454][ C0] #0: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 13.974462][ C0] #1: ffffffffa9fde8b8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 13.974468][ C0] #2: ffffffffa9f79cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 13.974474][ C0] #3: ffffffffa9f79d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 13.974479][ C0] [ 13.974479][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 13.974485][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 13.974489][ C0] HARDIRQ-ON-W at: [ 13.974492][ C0] __lock_acquire+0x388/0xc20 [ 13.974495][ C0] lock_acquire.part.0+0xd4/0x280 [ 13.974498][ C0] fs_reclaim_acquire+0xd5/0x120 [ 13.974502][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 13.974505][ C0] kthread_create_worker_on_node+0xea/0x210 [ 13.974508][ C0] workqueue_init+0x2a/0x680 [ 13.974513][ C0] kernel_init_freeable+0x2fe/0x630 [ 13.974517][ C0] kernel_init+0x21/0x150 [ 13.974521][ C0] ret_from_fork+0x474/0x6b0 [ 13.974525][ C0] ret_from_fork_asm+0x11/0x20 [ 13.974529][ C0] SOFTIRQ-ON-W at: [ 13.974530][ C0] __lock_acquire+0x388/0xc20 [ 13.974532][ C0] lock_acquire.part.0+0xd4/0x280 [ 13.974534][ C0] fs_reclaim_acquire+0xd5/0x120 [ 13.974536][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 13.974538][ C0] kthread_create_worker_on_node+0xea/0x210 [ 13.974540][ C0] workqueue_init+0x2a/0x680 [ 13.974542][ C0] kernel_init_freeable+0x2fe/0x630 [ 13.974544][ C0] kernel_init+0x21/0x150 [ 13.974546][ C0] ret_from_fork+0x474/0x6b0 [ 13.974548][ C0] ret_from_fork_asm+0x11/0x20 [ 13.974550][ C0] INITIAL USE at: [ 13.974552][ C0] __lock_acquire+0x388/0xc20 [ 13.974554][ C0] lock_acquire.part.0+0xd4/0x280 [ 13.974557][ C0] fs_reclaim_acquire+0xd5/0x120 [ 13.974558][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 13.974561][ C0] kthread_create_worker_on_node+0xea/0x210 [ 13.974563][ C0] workqueue_init+0x2a/0x680 [ 13.974564][ C0] kernel_init_freeable+0x2fe/0x630 [ 13.974567][ C0] kernel_init+0x21/0x150 [ 13.974569][ C0] ret_from_fork+0x474/0x6b0 [ 13.974570][ C0] ret_from_fork_asm+0x11/0x20 [ 13.974572][ C0] } [ 13.974573][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 13.974578][ C0] ... acquired at: [ 13.974579][ C0] __lock_acquire+0x518/0xc20 [ 13.974581][ C0] lock_acquire.part.0+0xd4/0x280 [ 13.974583][ C0] fs_reclaim_acquire+0xd5/0x120 [ 13.974585][ C0] __kmalloc_noprof+0xd3/0x760 [ 13.974587][ C0] alloc_buf.isra.0+0x4b/0x260 [ 13.974591][ C0] put_chars+0x1e1/0x2f0 [ 13.974593][ C0] hvc_console_print+0x292/0x780 [ 13.974596][ C0] console_emit_next_record+0x22f/0x4c0 [ 13.974598][ C0] console_flush_one_record+0x46f/0x710 [ 13.974601][ C0] console_unlock+0xee/0x1f0 [ 13.974603][ C0] vprintk_emit+0x37c/0x3e0 [ 13.974605][ C0] _printk+0xc7/0x100 [ 13.974609][ C0] dm_interface_init+0x50/0x60 [ 13.974613][ C0] dm_init+0x51/0xd0 [ 13.974615][ C0] do_one_initcall+0x124/0x4f0 [ 13.974617][ C0] kernel_init_freeable+0x596/0x630 [ 13.974620][ C0] kernel_init+0x21/0x150 [ 13.974622][ C0] ret_from_fork+0x474/0x6b0 [ 13.974624][ C0] ret_from_fork_asm+0x11/0x20 [ 13.974626][ C0] [ 13.974632][ C0] -> (console_owner){..-.}-{0:0} { [ 13.974635][ C0] IN-SOFTIRQ-W at: [ 13.974636][ C0] __lock_acquire+0x388/0xc20 [ 13.974638][ C0] lock_acquire.part.0+0xd4/0x280 [ 13.974640][ C0] console_lock_spinning_enable+0x5c/0x60 [ 13.974643][ C0] console_emit_next_record+0x1d1/0x4c0 [ 13.974646][ C0] console_flush_one_record+0x46f/0x710 [ 13.974648][ C0] console_unlock+0xee/0x1f0 [ 13.974650][ C0] vprintk_emit+0x37c/0x3e0 [ 13.974653][ C0] _printk+0xc7/0x100 [ 13.974655][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 13.974658][ C0] call_timer_fn+0x160/0x4d0 [ 13.974660][ C0] __run_timers+0x68f/0xaa0 [ 13.974663][ C0] run_timer_softirq+0xf0/0x160 [ 13.974665][ C0] handle_softirqs+0x1d3/0x900 [ 13.974668][ C0] __irq_exit_rcu+0x145/0x1c0 [ 13.974670][ C0] irq_exit_rcu+0xe/0x30 [ 13.974672][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 13.974675][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 13.974678][ C0] pv_native_safe_halt+0xf/0x10 [ 13.974680][ C0] default_idle+0x9/0x10 [ 13.974682][ C0] default_idle_call+0x6e/0xb0 [ 13.974684][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 13.974687][ C0] do_idle+0xd8/0x190 [ 13.974689][ C0] cpu_startup_entry+0x53/0x70 [ 13.974691][ C0] rest_init+0x279/0x280 [ 13.974693][ C0] start_kernel+0x3af/0x3b0 [ 13.974695][ C0] x86_64_start_reservations+0x24/0x30 [ 13.974698][ C0] x86_64_start_kernel+0x12b/0x130 [ 13.974700][ C0] common_startup_64+0x13e/0x148 [ 13.974703][ C0] INITIAL USE at: [ 13.974705][ C0] } [ 13.974705][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 13.974710][ C0] ... acquired at: [ 13.974711][ C0] mark_lock+0x1d7/0xa00 [ 13.974713][ C0] mark_usage+0x42/0x170 [ 13.974715][ C0] __lock_acquire+0x388/0xc20 [ 13.974717][ C0] lock_acquire.part.0+0xd4/0x280 [ 13.974719][ C0] console_lock_spinning_enable+0x5c/0x60 [ 13.974721][ C0] console_emit_next_record+0x1d1/0x4c0 [ 13.974724][ C0] console_flush_one_record+0x46f/0x710 [ 13.974726][ C0] console_unlock+0xee/0x1f0 [ 13.974728][ C0] vprintk_emit+0x37c/0x3e0 [ 13.974731][ C0] _printk+0xc7/0x100 [ 13.974733][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 13.974734][ C0] call_timer_fn+0x160/0x4d0 [ 13.974737][ C0] __run_timers+0x68f/0xaa0 [ 13.974739][ C0] run_timer_softirq+0xf0/0x160 [ 13.974741][ C0] handle_softirqs+0x1d3/0x900 [ 13.974743][ C0] __irq_exit_rcu+0x145/0x1c0 [ 13.974745][ C0] irq_exit_rcu+0xe/0x30 [ 13.974747][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 13.974749][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 13.974751][ C0] pv_native_safe_halt+0xf/0x10 [ 13.974752][ C0] default_idle+0x9/0x10 [ 13.974754][ C0] default_idle_call+0x6e/0xb0 [ 13.974756][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 13.974758][ C0] do_idle+0xd8/0x190 [ 13.974760][ C0] cpu_startup_entry+0x53/0x70 [ 13.974761][ C0] rest_init+0x279/0x280 [ 13.974763][ C0] start_kernel+0x3af/0x3b0 [ 13.974766][ C0] x86_64_start_reservations+0x24/0x30 [ 13.974768][ C0] x86_64_start_kernel+0x12b/0x130 [ 13.974770][ C0] common_startup_64+0x13e/0x148 [ 13.974772][ C0] [ 13.974773][ C0] [ 13.974773][ C0] stack backtrace: [ 13.974776][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 13.974781][ C0] Tainted: [W]=WARN [ 13.974782][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 13.974784][ C0] Call Trace: [ 13.974786][ C0] [ 13.974788][ C0] dump_stack_lvl+0x6f/0xa0 [ 13.974793][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 13.974796][ C0] mark_lock_irq+0x989/0x9c0 [ 13.974798][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 13.974803][ C0] mark_lock+0x1d7/0xa00 [ 13.974806][ C0] mark_usage+0x42/0x170 [ 13.974809][ C0] __lock_acquire+0x388/0xc20 [ 13.974813][ C0] lock_acquire.part.0+0xd4/0x280 [ 13.974815][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 13.974818][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.974823][ C0] ? lock_acquire+0x13c/0x160 [ 13.974826][ C0] console_lock_spinning_enable+0x5c/0x60 [ 13.974829][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 13.974831][ C0] console_emit_next_record+0x1d1/0x4c0 [ 13.974835][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 13.974837][ C0] ? console_flush_one_record+0x106/0x710 [ 13.974840][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.974843][ C0] ? lock_acquire+0x13c/0x160 [ 13.974846][ C0] console_flush_one_record+0x46f/0x710 [ 13.974850][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 13.974852][ C0] ? __lock_acquire+0x518/0xc20 [ 13.974856][ C0] console_unlock+0xee/0x1f0 [ 13.974859][ C0] ? console_flush_one_record+0x710/0x710 [ 13.974861][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.974864][ C0] ? lock_acquire+0x60/0x160 [ 13.974867][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 13.974869][ C0] ? vprintk_emit+0x320/0x3e0 [ 13.974872][ C0] vprintk_emit+0x37c/0x3e0 [ 13.974876][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 13.974879][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 13.974882][ C0] _printk+0xc7/0x100 [ 13.974885][ C0] ? snapshot_read.cold+0x21/0x21 [ 13.974888][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 13.974890][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 13.974894][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 13.974896][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 13.974899][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 13.974901][ C0] call_timer_fn+0x160/0x4d0 [ 13.974904][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 13.974907][ C0] ? debug_object_active_state+0x430/0x430 [ 13.974912][ C0] ? find_held_lock+0x2b/0x80 [ 13.974914][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 13.974917][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.974920][ C0] __run_timers+0x68f/0xaa0 [ 13.974923][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 13.974927][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 13.974929][ C0] ? __lock_acquire+0x518/0xc20 [ 13.974933][ C0] ? __rwlock_init+0x150/0x150 [ 13.974937][ C0] run_timer_softirq+0xf0/0x160 [ 13.974940][ C0] ? __run_timers+0xaa0/0xaa0 [ 13.974943][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 13.974946][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.974949][ C0] handle_softirqs+0x1d3/0x900 [ 13.974952][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 13.974954][ C0] ? _local_bh_enable+0xc0/0xc0 [ 13.974958][ C0] __irq_exit_rcu+0x145/0x1c0 [ 13.974960][ C0] irq_exit_rcu+0xe/0x30 [ 13.974962][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 13.974964][ C0] [ 13.974965][ C0] [ 13.974966][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 13.974969][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 13.974972][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 13.974975][ C0] Code: 48 8b 3d 94 02 06 02 e8 1f 00 00 00 48 2b 05 58 03 a0 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 a6 17 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 13.974978][ C0] RSP: 0018:ffffffffa9c07cf8 EFLAGS: 00000296 [ 13.974981][ C0] RAX: 00000000000739d9 RBX: ffffffffa9c2c600 RCX: ffffffffa6afa307 [ 13.974983][ C0] RDX: ffffffffa9c2c600 RSI: ffffffffa9a78e68 RDI: ffffffffa948dce0 [ 13.974985][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 13.974986][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff5380fa2 [ 13.974987][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 13.974990][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 13.974994][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 13.974996][ C0] default_idle+0x9/0x10 [ 13.974998][ C0] default_idle_call+0x6e/0xb0 [ 13.975000][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 13.975003][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 13.975005][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 13.975009][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 13.975011][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.975014][ C0] do_idle+0xd8/0x190 [ 13.975016][ C0] cpu_startup_entry+0x53/0x70 [ 13.975019][ C0] rest_init+0x279/0x280 [ 13.975021][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 13.975025][ C0] ? rest_init+0x280/0x280 [ 13.975027][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 13.975031][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 13.975035][ C0] ? acpi_enable+0x1e4/0x330 [ 13.975040][ C0] start_kernel+0x3af/0x3b0 [ 13.975043][ C0] x86_64_start_reservations+0x24/0x30 [ 13.975046][ C0] x86_64_start_kernel+0x12b/0x130 [ 13.975049][ C0] common_startup_64+0x13e/0x148 [ 13.975053][ C0] [ 13.975059][ C0] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 13.975061][ C0] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 0, name: swapper/0 [ 13.975063][ C0] preempt_count: 103, expected: 0 [ 13.975064][ C0] RCU nest depth: 0, expected: 0 [ 13.975066][ C0] INFO: lockdep is turned off. [ 13.975067][ C0] irq event stamp: 473577 [ 13.975068][ C0] hardirqs last enabled at (473576): [] __down_trylock_console_sem+0x86/0xa0 [ 13.975071][ C0] hardirqs last disabled at (473577): [] console_emit_next_record+0x3d4/0x4c0 [ 13.975074][ C0] softirqs last enabled at (473556): [] handle_softirqs+0x67c/0x900 [ 13.975077][ C0] softirqs last disabled at (473563): [] __irq_exit_rcu+0x145/0x1c0 [ 13.975080][ C0] Preemption disabled at: [ 13.975080][ C0] [] schedule_preempt_disabled+0x22/0x30 [ 13.975085][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 13.975088][ C0] Tainted: [W]=WARN [ 13.975089][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 13.975090][ C0] Call Trace: [ 13.975091][ C0] [ 13.975092][ C0] dump_stack_lvl+0x6f/0xa0 [ 13.975095][ C0] ? schedule_preempt_disabled+0x22/0x30 [ 13.975098][ C0] __might_resched.cold+0x1fe/0x2c1 [ 13.975102][ C0] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 13.975106][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.975109][ C0] __kmalloc_noprof+0x443/0x760 [ 13.975112][ C0] ? __rwlock_init+0x150/0x150 [ 13.975114][ C0] ? alloc_buf.isra.0+0x4b/0x260 [ 13.975117][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 13.975120][ C0] alloc_buf.isra.0+0x4b/0x260 [ 13.975123][ C0] put_chars+0x1e1/0x2f0 [ 13.975126][ C0] ? __send_to_port+0x420/0x420 [ 13.975129][ C0] ? mark_lock+0x1d7/0xa00 [ 13.975133][ C0] hvc_console_print+0x292/0x780 [ 13.975137][ C0] ? hvc_write+0x3a0/0x3a0 [ 13.975140][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.975142][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.975146][ C0] console_emit_next_record+0x22f/0x4c0 [ 13.975150][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 13.975152][ C0] ? console_flush_one_record+0x106/0x710 [ 13.975160][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.975163][ C0] ? lock_acquire+0x13c/0x160 [ 13.975166][ C0] console_flush_one_record+0x46f/0x710 [ 13.975170][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 13.975172][ C0] ? __lock_acquire+0x518/0xc20 [ 13.975176][ C0] console_unlock+0xee/0x1f0 [ 13.975179][ C0] ? console_flush_one_record+0x710/0x710 [ 13.975181][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.975184][ C0] ? lock_acquire+0x60/0x160 [ 13.975187][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 13.975189][ C0] ? vprintk_emit+0x320/0x3e0 [ 13.975193][ C0] vprintk_emit+0x37c/0x3e0 [ 13.975196][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 13.975200][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 13.975202][ C0] _printk+0xc7/0x100 [ 13.975205][ C0] ? snapshot_read.cold+0x21/0x21 [ 13.975208][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 13.975210][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 13.975214][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 13.975217][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 13.975219][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 13.975222][ C0] call_timer_fn+0x160/0x4d0 [ 13.975225][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 13.975228][ C0] ? debug_object_active_state+0x430/0x430 [ 13.975231][ C0] ? find_held_lock+0x2b/0x80 [ 13.975233][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 13.975236][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.975239][ C0] __run_timers+0x68f/0xaa0 [ 13.975241][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 13.975245][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 13.975248][ C0] ? __lock_acquire+0x518/0xc20 [ 13.975252][ C0] ? __rwlock_init+0x150/0x150 [ 13.975256][ C0] run_timer_softirq+0xf0/0x160 [ 13.975259][ C0] ? __run_timers+0xaa0/0xaa0 [ 13.975261][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 13.975263][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.975266][ C0] handle_softirqs+0x1d3/0x900 [ 13.975269][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 13.975271][ C0] ? _local_bh_enable+0xc0/0xc0 [ 13.975275][ C0] __irq_exit_rcu+0x145/0x1c0 [ 13.975277][ C0] irq_exit_rcu+0xe/0x30 [ 13.975279][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 13.975281][ C0] [ 13.975282][ C0] [ 13.975283][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 13.975286][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 13.975288][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 13.975291][ C0] Code: 48 8b 3d 94 02 06 02 e8 1f 00 00 00 48 2b 05 58 03 a0 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 a6 17 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 13.975292][ C0] RSP: 0018:ffffffffa9c07cf8 EFLAGS: 00000296 [ 13.975294][ C0] RAX: 00000000000739d9 RBX: ffffffffa9c2c600 RCX: ffffffffa6afa307 [ 13.975296][ C0] RDX: ffffffffa9c2c600 RSI: ffffffffa9a78e68 RDI: ffffffffa948dce0 [ 13.975297][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 13.975298][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff5380fa2 [ 13.975300][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 13.975302][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 13.975306][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 13.975308][ C0] default_idle+0x9/0x10 [ 13.975310][ C0] default_idle_call+0x6e/0xb0 [ 13.975312][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 13.975315][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 13.975317][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 13.975320][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 13.975322][ C0] ? rcu_is_watching+0x16/0xd0 [ 13.975325][ C0] do_idle+0xd8/0x190 [ 13.975327][ C0] cpu_startup_entry+0x53/0x70 [ 13.975330][ C0] rest_init+0x279/0x280 [ 13.975332][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 13.975336][ C0] ? rest_init+0x280/0x280 [ 13.975338][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 13.975341][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 13.975344][ C0] ? acpi_enable+0x1e4/0x330 [ 13.975347][ C0] start_kernel+0x3af/0x3b0 [ 13.975350][ C0] x86_64_start_reservations+0x24/0x30 [ 13.975353][ C0] x86_64_start_kernel+0x12b/0x130 [ 13.975356][ C0] common_startup_64+0x13e/0x148 [ 13.975361][ C0] [ 21.375014][ T248] RDS: shutdown called in state 1 [ 21.375030][ T248] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 21.375033][ T248] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 248, name: kworker/u16:11 [ 21.375035][ T248] preempt_count: 1, expected: 0 [ 21.375035][ T248] RCU nest depth: 0, expected: 0 [ 21.375036][ T248] INFO: lockdep is turned off. [ 21.375037][ T248] irq event stamp: 0 [ 21.375038][ T248] hardirqs last enabled at (0): [<0000000000000000>] 0x0 [ 21.375043][ T248] hardirqs last disabled at (0): [] copy_process+0x1ccd/0x6240 [ 21.375050][ T248] softirqs last enabled at (0): [] copy_process+0x1d21/0x6240 [ 21.375052][ T248] softirqs last disabled at (0): [<0000000000000000>] 0x0 [ 21.375054][ T248] Preemption disabled at: [ 21.375054][ T248] [] vprintk_emit+0x31b/0x3e0 [ 21.375063][ T248] CPU: 1 UID: 0 PID: 248 Comm: kworker/u16:11 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 21.375066][ T248] Tainted: [W]=WARN [ 21.375067][ T248] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 21.375069][ T248] Workqueue: krds_cp_wq#1/6 rds_shutdown_worker [ 21.375076][ T248] Call Trace: [ 21.375078][ T248] [ 21.375080][ T248] dump_stack_lvl+0x6f/0xa0 [ 21.375086][ T248] ? vprintk_emit+0x31b/0x3e0 [ 21.375088][ T248] __might_resched.cold+0x1fe/0x2c1 [ 21.375091][ T248] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 21.375095][ T248] ? prb_next_reserve_seq+0x2d0/0x2d0 [ 21.375097][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375101][ T248] __kmalloc_noprof+0x443/0x760 [ 21.375105][ T248] ? __rwlock_init+0x150/0x150 [ 21.375107][ T248] ? alloc_buf.isra.0+0x4b/0x260 [ 21.375112][ T248] ? do_raw_spin_unlock+0x59/0x250 [ 21.375113][ T248] alloc_buf.isra.0+0x4b/0x260 [ 21.375115][ T248] put_chars+0x1e1/0x2f0 [ 21.375117][ T248] ? prb_final_commit+0x50/0x50 [ 21.375119][ T248] ? __send_to_port+0x420/0x420 [ 21.375121][ T248] ? printk_get_next_message+0x240/0x650 [ 21.375123][ T248] hvc_console_print+0x292/0x780 [ 21.375127][ T248] ? hvc_write+0x3a0/0x3a0 [ 21.375129][ T248] ? do_raw_spin_lock+0x131/0x280 [ 21.375130][ T248] ? vsnprintf+0x668/0x1700 [ 21.375132][ T248] ? __rwlock_init+0x150/0x150 [ 21.375134][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375136][ T248] ? lock_acquire+0x13c/0x160 [ 21.375138][ T248] console_emit_next_record+0x22f/0x4c0 [ 21.375140][ T248] ? devkmsg_read+0x4b0/0x4b0 [ 21.375142][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375144][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375146][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375148][ T248] ? lock_acquire+0x13c/0x160 [ 21.375150][ T248] ? console_flush_one_record+0x111/0x710 [ 21.375151][ T248] console_flush_one_record+0x46f/0x710 [ 21.375154][ T248] ? console_emit_next_record+0x4c0/0x4c0 [ 21.375156][ T248] console_unlock+0xee/0x1f0 [ 21.375162][ T248] ? lock_acquire+0x13c/0x160 [ 21.375164][ T248] ? console_flush_one_record+0x710/0x710 [ 21.375166][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375167][ T248] ? lock_release+0x184/0x1f0 [ 21.375169][ T248] ? lock_acquire+0x60/0x160 [ 21.375170][ T248] ? __rcu_read_lock+0x30/0x70 [ 21.375172][ T248] ? __down_trylock_console_sem+0x5e/0xa0 [ 21.375174][ T248] ? vprintk_emit+0x320/0x3e0 [ 21.375176][ T248] vprintk_emit+0x37c/0x3e0 [ 21.375178][ T248] ? wake_up_klogd_work_func+0x90/0x90 [ 21.375180][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375182][ T248] ? ww_mutex_lock+0x160/0x160 [ 21.375185][ T248] ? try_to_grab_pending+0x77/0x840 [ 21.375188][ T248] __rds_conn_path_error+0xbd/0x100 [ 21.375191][ T248] ? rds_check_all_paths+0xb0/0xb0 [ 21.375193][ T248] ? lock_acquire+0x13c/0x160 [ 21.375194][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375197][ T248] ? rds_conn_shutdown+0x652/0xa20 [ 21.375198][ T248] rds_conn_shutdown+0x695/0xa20 [ 21.375200][ T248] ? __rds_conn_path_error+0x100/0x100 [ 21.375201][ T248] ? debug_object_active_state+0x430/0x430 [ 21.375205][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375207][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375209][ T248] ? lock_acquire+0x13c/0x160 [ 21.375210][ T248] ? rcu_is_watching+0x16/0xd0 [ 21.375212][ T248] ? process_one_work+0xdfc/0x1560 [ 21.375214][ T248] process_one_work+0xe3e/0x1560 [ 21.375216][ T248] ? __queue_delayed_work+0x470/0x470 [ 21.375218][ T248] ? lock_release+0x184/0x1f0 [ 21.375220][ T248] ? __rwlock_init+0x150/0x150 [ 21.375223][ T248] worker_thread+0x4f1/0xd60 [ 21.375225][ T248] ? rescuer_thread+0x1340/0x1340 [ 21.375227][ T248] ? __kthread_parkme+0xbd/0x210 [ 21.375229][ T248] ? rescuer_thread+0x1340/0x1340 [ 21.375231][ T248] ? rescuer_thread+0x1340/0x1340 [ 21.375233][ T248] kthread+0x367/0x460 [ 21.375234][ T248] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 21.375237][ T248] ? kthread_affine_preferred+0x4c0/0x4c0 [ 21.375239][ T248] ret_from_fork+0x474/0x6b0 [ 21.375242][ T248] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 21.375243][ T248] ? trace_x86_fpu_regs_deactivated+0x9b/0x190 [ 21.375246][ T248] ? save_fpregs_to_fpstate+0x46/0x1a0 [ 21.375247][ T248] ? __switch_to+0x5a3/0xe00 [ 21.375249][ T248] ? kthread_affine_preferred+0x4c0/0x4c0 [ 21.375251][ T248] ret_from_fork_asm+0x11/0x20 [ 21.375255][ T248]