[ 10.407147][ C0] clocksource: Watchdog remote CPU 3 read timed out [ 10.407196][ C0] [ 10.407197][ C0] ======================================================== [ 10.407199][ C0] WARNING: possible irq lock inversion dependency detected [ 10.407201][ C0] 7.2.0-virtme #1 Tainted: G W [ 10.407203][ C0] -------------------------------------------------------- [ 10.407203][ C0] swapper/0/0 just changed the state of lock: [ 10.407204][ C0] ffffffffac289660 (console_owner){..-.}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 10.407217][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 10.407218][ C0] (fs_reclaim){+.+.}-{0:0} [ 10.407219][ C0] [ 10.407219][ C0] [ 10.407219][ C0] and interrupts could create inverse lock ordering between them. [ 10.407219][ C0] [ 10.407220][ C0] [ 10.407220][ C0] other info that might help us debug this: [ 10.407221][ C0] Possible interrupt unsafe locking scenario: [ 10.407221][ C0] [ 10.407222][ C0] CPU0 CPU1 [ 10.407222][ C0] ---- ---- [ 10.407222][ C0] lock(fs_reclaim); [ 10.407223][ C0] local_irq_disable(); [ 10.407224][ C0] lock(console_owner); [ 10.407225][ C0] lock(fs_reclaim); [ 10.407225][ C0] [ 10.407226][ C0] lock(console_owner); [ 10.407227][ C0] [ 10.407227][ C0] *** DEADLOCK *** [ 10.407227][ C0] [ 10.407227][ C0] locks held by swapper/0/0: 4, last CPU#0: [ 10.407228][ C0] #0: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 10.407233][ C0] #1: ffffffffac3fe8b8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 10.407237][ C0] #2: ffffffffac399cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 10.407240][ C0] #3: ffffffffac399d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 10.407243][ C0] [ 10.407243][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 10.407248][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 10.407250][ C0] HARDIRQ-ON-W at: [ 10.407252][ C0] __lock_acquire+0x388/0xc20 [ 10.407255][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.407257][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.407260][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 10.407263][ C0] kthread_create_worker_on_node+0xea/0x210 [ 10.407266][ C0] workqueue_init+0x2a/0x680 [ 10.407270][ C0] kernel_init_freeable+0x2fe/0x630 [ 10.407272][ C0] kernel_init+0x21/0x150 [ 10.407276][ C0] ret_from_fork+0x474/0x6b0 [ 10.407280][ C0] ret_from_fork_asm+0x11/0x20 [ 10.407283][ C0] SOFTIRQ-ON-W at: [ 10.407284][ C0] __lock_acquire+0x388/0xc20 [ 10.407285][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.407287][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.407288][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 10.407290][ C0] kthread_create_worker_on_node+0xea/0x210 [ 10.407292][ C0] workqueue_init+0x2a/0x680 [ 10.407293][ C0] kernel_init_freeable+0x2fe/0x630 [ 10.407294][ C0] kernel_init+0x21/0x150 [ 10.407296][ C0] ret_from_fork+0x474/0x6b0 [ 10.407297][ C0] ret_from_fork_asm+0x11/0x20 [ 10.407299][ C0] INITIAL USE at: [ 10.407300][ C0] __lock_acquire+0x388/0xc20 [ 10.407302][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.407303][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.407305][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 10.407307][ C0] kthread_create_worker_on_node+0xea/0x210 [ 10.407308][ C0] workqueue_init+0x2a/0x680 [ 10.407310][ C0] kernel_init_freeable+0x2fe/0x630 [ 10.407311][ C0] kernel_init+0x21/0x150 [ 10.407312][ C0] ret_from_fork+0x474/0x6b0 [ 10.407314][ C0] ret_from_fork_asm+0x11/0x20 [ 10.407315][ C0] } [ 10.407316][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 10.407320][ C0] ... acquired at: [ 10.407321][ C0] __lock_acquire+0x518/0xc20 [ 10.407323][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.407324][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.407326][ C0] __kmalloc_noprof+0xd3/0x760 [ 10.407327][ C0] alloc_buf.isra.0+0x4b/0x260 [ 10.407331][ C0] put_chars+0x1e1/0x2f0 [ 10.407332][ C0] hvc_console_print+0x292/0x780 [ 10.407335][ C0] console_emit_next_record+0x252/0x4f0 [ 10.407336][ C0] console_flush_one_record+0x46f/0x710 [ 10.407338][ C0] console_unlock+0xee/0x1f0 [ 10.407339][ C0] vprintk_emit+0x37c/0x3e0 [ 10.407340][ C0] _printk+0xc7/0x100 [ 10.407343][ C0] i8042_pnp_init+0xf7/0x3c0 [ 10.407345][ C0] i8042_platform_init+0x3f9/0x460 [ 10.407346][ C0] i8042_init+0x45/0x130 [ 10.407347][ C0] do_one_initcall+0x124/0x4f0 [ 10.407349][ C0] kernel_init_freeable+0x596/0x630 [ 10.407350][ C0] kernel_init+0x21/0x150 [ 10.407351][ C0] ret_from_fork+0x474/0x6b0 [ 10.407353][ C0] ret_from_fork_asm+0x11/0x20 [ 10.407354][ C0] [ 10.407354][ C0] -> (console_owner){..-.}-{0:0} { [ 10.407356][ C0] IN-SOFTIRQ-W at: [ 10.407357][ C0] __lock_acquire+0x388/0xc20 [ 10.407359][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.407361][ C0] console_lock_spinning_enable+0x5c/0x60 [ 10.407362][ C0] console_emit_next_record+0x1f4/0x4f0 [ 10.407363][ C0] console_flush_one_record+0x46f/0x710 [ 10.407364][ C0] console_unlock+0xee/0x1f0 [ 10.407365][ C0] vprintk_emit+0x37c/0x3e0 [ 10.407367][ C0] _printk+0xc7/0x100 [ 10.407368][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.407370][ C0] call_timer_fn+0x160/0x4d0 [ 10.407371][ C0] __run_timers+0x68f/0xaa0 [ 10.407373][ C0] run_timer_softirq+0xf0/0x160 [ 10.407374][ C0] handle_softirqs+0x1d3/0x900 [ 10.407377][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.407378][ C0] irq_exit_rcu+0xe/0x30 [ 10.407380][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.407382][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.407383][ C0] pv_native_safe_halt+0xf/0x10 [ 10.407385][ C0] default_idle+0x9/0x10 [ 10.407386][ C0] default_idle_call+0x6e/0xb0 [ 10.407388][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.407390][ C0] do_idle+0xd8/0x190 [ 10.407392][ C0] cpu_startup_entry+0x53/0x70 [ 10.407393][ C0] rest_init+0x279/0x280 [ 10.407395][ C0] start_kernel+0x3af/0x3b0 [ 10.407396][ C0] x86_64_start_reservations+0x24/0x30 [ 10.407398][ C0] x86_64_start_kernel+0x12b/0x130 [ 10.407400][ C0] common_startup_64+0x13e/0x148 [ 10.407403][ C0] INITIAL USE at: [ 10.407403][ C0] } [ 10.407404][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 10.407407][ C0] ... acquired at: [ 10.407407][ C0] mark_lock+0x1d7/0xa00 [ 10.407409][ C0] mark_usage+0x42/0x170 [ 10.407411][ C0] __lock_acquire+0x388/0xc20 [ 10.407412][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.407414][ C0] console_lock_spinning_enable+0x5c/0x60 [ 10.407415][ C0] console_emit_next_record+0x1f4/0x4f0 [ 10.407416][ C0] console_flush_one_record+0x46f/0x710 [ 10.407417][ C0] console_unlock+0xee/0x1f0 [ 10.407418][ C0] vprintk_emit+0x37c/0x3e0 [ 10.407419][ C0] _printk+0xc7/0x100 [ 10.407421][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.407422][ C0] call_timer_fn+0x160/0x4d0 [ 10.407423][ C0] __run_timers+0x68f/0xaa0 [ 10.407424][ C0] run_timer_softirq+0xf0/0x160 [ 10.407425][ C0] handle_softirqs+0x1d3/0x900 [ 10.407426][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.407428][ C0] irq_exit_rcu+0xe/0x30 [ 10.407429][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.407431][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.407432][ C0] pv_native_safe_halt+0xf/0x10 [ 10.407433][ C0] default_idle+0x9/0x10 [ 10.407434][ C0] default_idle_call+0x6e/0xb0 [ 10.407436][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.407437][ C0] do_idle+0xd8/0x190 [ 10.407439][ C0] cpu_startup_entry+0x53/0x70 [ 10.407440][ C0] rest_init+0x279/0x280 [ 10.407442][ C0] start_kernel+0x3af/0x3b0 [ 10.407443][ C0] x86_64_start_reservations+0x24/0x30 [ 10.407444][ C0] x86_64_start_kernel+0x12b/0x130 [ 10.407446][ C0] common_startup_64+0x13e/0x148 [ 10.407447][ C0] [ 10.407448][ C0] [ 10.407448][ C0] stack backtrace: [ 10.407450][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 10.407454][ C0] Tainted: [W]=WARN [ 10.407454][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 10.407456][ C0] Call Trace: [ 10.407457][ C0] [ 10.407458][ C0] dump_stack_lvl+0x6f/0xa0 [ 10.407461][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 10.407464][ C0] mark_lock_irq+0x989/0x9c0 [ 10.407467][ C0] mark_lock+0x1d7/0xa00 [ 10.407469][ C0] mark_usage+0x42/0x170 [ 10.407471][ C0] __lock_acquire+0x388/0xc20 [ 10.407474][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.407476][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 10.407477][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407480][ C0] ? lock_acquire+0x13c/0x160 [ 10.407483][ C0] console_lock_spinning_enable+0x5c/0x60 [ 10.407484][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 10.407485][ C0] console_emit_next_record+0x1f4/0x4f0 [ 10.407487][ C0] ? devkmsg_read+0x4e0/0x4e0 [ 10.407489][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407490][ C0] ? lock_acquire+0x13c/0x160 [ 10.407493][ C0] console_flush_one_record+0x46f/0x710 [ 10.407495][ C0] ? console_emit_next_record+0x4f0/0x4f0 [ 10.407496][ C0] ? __lock_acquire+0x518/0xc20 [ 10.407498][ C0] console_unlock+0xee/0x1f0 [ 10.407500][ C0] ? console_flush_one_record+0x710/0x710 [ 10.407501][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407503][ C0] ? lock_acquire+0x60/0x160 [ 10.407505][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 10.407507][ C0] ? vprintk_emit+0x320/0x3e0 [ 10.407508][ C0] vprintk_emit+0x37c/0x3e0 [ 10.407510][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 10.407512][ C0] ? clocksource_watchdog.part.0+0x4d0/0x540 [ 10.407514][ C0] _printk+0xc7/0x100 [ 10.407516][ C0] ? snapshot_read.cold+0x21/0x21 [ 10.407518][ C0] ? clocksource_watchdog.part.0+0x4d0/0x540 [ 10.407520][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.407522][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.407524][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.407526][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.407528][ C0] call_timer_fn+0x160/0x4d0 [ 10.407529][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 10.407531][ C0] ? debug_object_active_state+0x430/0x430 [ 10.407534][ C0] ? find_held_lock+0x2b/0x80 [ 10.407536][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.407538][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407540][ C0] __run_timers+0x68f/0xaa0 [ 10.407541][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.407544][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 10.407545][ C0] ? __lock_acquire+0x518/0xc20 [ 10.407548][ C0] ? __rwlock_init+0x150/0x150 [ 10.407550][ C0] run_timer_softirq+0xf0/0x160 [ 10.407551][ C0] ? __run_timers+0xaa0/0xaa0 [ 10.407553][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 10.407555][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407557][ C0] handle_softirqs+0x1d3/0x900 [ 10.407559][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.407561][ C0] ? _local_bh_enable+0xc0/0xc0 [ 10.407563][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.407565][ C0] irq_exit_rcu+0xe/0x30 [ 10.407567][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.407569][ C0] [ 10.407569][ C0] [ 10.407570][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 10.407572][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.407573][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 10.407576][ C0] Code: 48 8b 3d 94 12 09 02 e8 1f 00 00 00 48 2b 05 58 a3 a6 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 56 1b 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 10.407578][ C0] RSP: 0018:ffffffffac007cf8 EFLAGS: 00000296 [ 10.407580][ C0] RAX: 00000000000555a7 RBX: ffffffffac01c600 RCX: ffffffffa8efa307 [ 10.407581][ C0] RDX: ffffffffac01c600 RSI: ffffffffabea7f75 RDI: ffffffffab88f560 [ 10.407582][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 10.407583][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff5800fa2 [ 10.407584][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 10.407585][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.407588][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 10.407589][ C0] default_idle+0x9/0x10 [ 10.407591][ C0] default_idle_call+0x6e/0xb0 [ 10.407592][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.407594][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 10.407596][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 10.407599][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407601][ C0] do_idle+0xd8/0x190 [ 10.407602][ C0] cpu_startup_entry+0x53/0x70 [ 10.407604][ C0] rest_init+0x279/0x280 [ 10.407606][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 10.407609][ C0] ? rest_init+0x280/0x280 [ 10.407611][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 10.407614][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 10.407616][ C0] ? acpi_enable+0x1e4/0x330 [ 10.407618][ C0] start_kernel+0x3af/0x3b0 [ 10.407620][ C0] x86_64_start_reservations+0x24/0x30 [ 10.407622][ C0] x86_64_start_kernel+0x12b/0x130 [ 10.407624][ C0] common_startup_64+0x13e/0x148 [ 10.407627][ C0] [ 10.407630][ C0] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 10.407632][ C0] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 0, name: swapper/0 [ 10.407633][ C0] preempt_count: 103, expected: 0 [ 10.407634][ C0] RCU nest depth: 0, expected: 0 [ 10.407635][ C0] INFO: lockdep is turned off. [ 10.407635][ C0] irq event stamp: 349623 [ 10.407636][ C0] hardirqs last enabled at (349622): [] __down_trylock_console_sem+0x86/0xa0 [ 10.407639][ C0] hardirqs last disabled at (349623): [] console_emit_next_record+0x3f8/0x4f0 [ 10.407640][ C0] softirqs last enabled at (349602): [] handle_softirqs+0x67c/0x900 [ 10.407642][ C0] softirqs last disabled at (349609): [] __irq_exit_rcu+0x145/0x1c0 [ 10.407644][ C0] Preemption disabled at: [ 10.407644][ C0] [] schedule_preempt_disabled+0x22/0x30 [ 10.407648][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 10.407650][ C0] Tainted: [W]=WARN [ 10.407650][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 10.407651][ C0] Call Trace: [ 10.407651][ C0] [ 10.407652][ C0] dump_stack_lvl+0x6f/0xa0 [ 10.407653][ C0] ? schedule_preempt_disabled+0x22/0x30 [ 10.407655][ C0] __might_resched.cold+0x1fe/0x2c1 [ 10.407658][ C0] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 10.407660][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407662][ C0] __kmalloc_noprof+0x443/0x760 [ 10.407664][ C0] ? __rwlock_init+0x150/0x150 [ 10.407665][ C0] ? alloc_buf.isra.0+0x4b/0x260 [ 10.407668][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 10.407669][ C0] alloc_buf.isra.0+0x4b/0x260 [ 10.407672][ C0] put_chars+0x1e1/0x2f0 [ 10.407674][ C0] ? __send_to_port+0x420/0x420 [ 10.407677][ C0] hvc_console_print+0x292/0x780 [ 10.407680][ C0] ? mark_usage+0x42/0x170 [ 10.407681][ C0] ? __lock_acquire+0x388/0xc20 [ 10.407684][ C0] ? hvc_write+0x3a0/0x3a0 [ 10.407685][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 10.407688][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407689][ C0] ? lock_acquire+0x13c/0x160 [ 10.407691][ C0] console_emit_next_record+0x252/0x4f0 [ 10.407693][ C0] ? devkmsg_read+0x4e0/0x4e0 [ 10.407695][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407696][ C0] ? lock_acquire+0x13c/0x160 [ 10.407698][ C0] console_flush_one_record+0x46f/0x710 [ 10.407700][ C0] ? console_emit_next_record+0x4f0/0x4f0 [ 10.407701][ C0] ? __lock_acquire+0x518/0xc20 [ 10.407704][ C0] console_unlock+0xee/0x1f0 [ 10.407705][ C0] ? console_flush_one_record+0x710/0x710 [ 10.407707][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407708][ C0] ? lock_acquire+0x60/0x160 [ 10.407710][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 10.407712][ C0] ? vprintk_emit+0x320/0x3e0 [ 10.407713][ C0] vprintk_emit+0x37c/0x3e0 [ 10.407715][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 10.407717][ C0] ? clocksource_watchdog.part.0+0x4d0/0x540 [ 10.407720][ C0] _printk+0xc7/0x100 [ 10.407722][ C0] ? snapshot_read.cold+0x21/0x21 [ 10.407724][ C0] ? clocksource_watchdog.part.0+0x4d0/0x540 [ 10.407726][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.407728][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.407730][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.407732][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.407734][ C0] call_timer_fn+0x160/0x4d0 [ 10.407735][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 10.407736][ C0] ? debug_object_active_state+0x430/0x430 [ 10.407738][ C0] ? find_held_lock+0x2b/0x80 [ 10.407740][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.407742][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407743][ C0] __run_timers+0x68f/0xaa0 [ 10.407745][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.407747][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 10.407748][ C0] ? __lock_acquire+0x518/0xc20 [ 10.407751][ C0] ? __rwlock_init+0x150/0x150 [ 10.407753][ C0] run_timer_softirq+0xf0/0x160 [ 10.407755][ C0] ? __run_timers+0xaa0/0xaa0 [ 10.407756][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 10.407757][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407759][ C0] handle_softirqs+0x1d3/0x900 [ 10.407761][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.407763][ C0] ? _local_bh_enable+0xc0/0xc0 [ 10.407765][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.407767][ C0] irq_exit_rcu+0xe/0x30 [ 10.407769][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.407770][ C0] [ 10.407771][ C0] [ 10.407771][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 10.407773][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.407775][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 10.407777][ C0] Code: 48 8b 3d 94 12 09 02 e8 1f 00 00 00 48 2b 05 58 a3 a6 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 56 1b 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 10.407778][ C0] RSP: 0018:ffffffffac007cf8 EFLAGS: 00000296 [ 10.407779][ C0] RAX: 00000000000555a7 RBX: ffffffffac01c600 RCX: ffffffffa8efa307 [ 10.407779][ C0] RDX: ffffffffac01c600 RSI: ffffffffabea7f75 RDI: ffffffffab88f560 [ 10.407780][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 10.407781][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff5800fa2 [ 10.407781][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 10.407783][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.407785][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 10.407787][ C0] default_idle+0x9/0x10 [ 10.407789][ C0] default_idle_call+0x6e/0xb0 [ 10.407790][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.407792][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 10.407794][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 10.407796][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.407797][ C0] do_idle+0xd8/0x190 [ 10.407799][ C0] cpu_startup_entry+0x53/0x70 [ 10.407801][ C0] rest_init+0x279/0x280 [ 10.407803][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 10.407806][ C0] ? rest_init+0x280/0x280 [ 10.407808][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 10.407810][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 10.407811][ C0] ? acpi_enable+0x1e4/0x330 [ 10.407812][ C0] start_kernel+0x3af/0x3b0 [ 10.407814][ C0] x86_64_start_reservations+0x24/0x30 [ 10.407816][ C0] x86_64_start_kernel+0x12b/0x130 [ 10.407818][ C0] common_startup_64+0x13e/0x148 [ 10.407821][ C0] [ 10.506829][ T204] bond0: (slave eth0): making interface the new active one [ 10.507297][ T204] bond0: (slave eth0): Enslaving as an active interface with an up link [ 10.518876][ T204] ip (204) used greatest stack depth: 24728 bytes left [ 10.533968][ T206] bond0: (slave eth1): Enslaving as a backup interface with an up link [ 10.591059][ T209] Initializing XFRM netlink socket [ 10.678519][ T211] bond_xfrm_update_stats: eth0 doesn't support xdo_dev_state_update_stats [ 10.695320][ T215] bond_xfrm_update_stats: eth0 doesn't support xdo_dev_state_update_stats [ 10.712688][ T217] bond_xfrm_update_stats: eth0 doesn't support xdo_dev_state_update_stats [ 10.712964][ T217] bond_xfrm_update_stats: eth0 doesn't support xdo_dev_state_update_stats [ 11.678502][ C3] bond_xfrm_update_stats: eth0 doesn't support xdo_dev_state_update_stats [ 11.678521][ C3] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 11.678523][ C3] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 0, name: swapper/3 [ 11.678525][ C3] preempt_count: 103, expected: 0 [ 11.678526][ C3] RCU nest depth: 1, expected: 0 [ 11.678527][ C3] INFO: lockdep is turned off. [ 11.678528][ C3] irq event stamp: 301190 [ 11.678529][ C3] hardirqs last enabled at (301189): [] default_idle_call+0x98/0xb0 [ 11.678539][ C3] hardirqs last disabled at (301190): [] __schedule+0x1246/0x20e0 [ 11.678542][ C3] softirqs last enabled at (301020): [] handle_softirqs+0x67c/0x900 [ 11.678546][ C3] softirqs last disabled at (300173): [] __irq_exit_rcu+0x145/0x1c0 [ 11.678548][ C3] Preemption disabled at: [ 11.678549][ C3] [<0000000000000000>] 0x0 [ 11.678557][ C3] CPU: 3 UID: 0 PID: 0 Comm: swapper/3 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 11.678561][ C3] Tainted: [W]=WARN [ 11.678562][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 11.678564][ C3] Call Trace: [ 11.678566][ C3] [ 11.678567][ C3] dump_stack_lvl+0x6f/0xa0 [ 11.678572][ C3] __might_resched.cold+0x1fe/0x2c1 [ 11.678575][ C3] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 11.678578][ C3] ? rcu_is_watching+0x16/0xd0 [ 11.678582][ C3] __kmalloc_noprof+0x443/0x760 [ 11.678585][ C3] ? __rwlock_init+0x150/0x150 [ 11.678587][ C3] ? alloc_buf.isra.0+0x4b/0x260 [ 11.678592][ C3] ? do_raw_spin_unlock+0x59/0x250 [ 11.678593][ C3] alloc_buf.isra.0+0x4b/0x260 [ 11.678595][ C3] put_chars+0x1e1/0x2f0 [ 11.678598][ C3] ? desc_read_finalized_seq+0x41/0x120 [ 11.678601][ C3] ? __send_to_port+0x420/0x420 [ 11.678604][ C3] hvc_console_print+0x292/0x780 [ 11.678608][ C3] ? hvc_write+0x3a0/0x3a0 [ 11.678610][ C3] ? __rwlock_init+0x150/0x150 [ 11.678611][ C3] ? lock_acquire+0x13c/0x160 [ 11.678614][ C3] console_emit_next_record+0x252/0x4f0 [ 11.678616][ C3] ? devkmsg_read+0x4e0/0x4e0 [ 11.678618][ C3] ? _prb_read_valid+0x6e0/0x6e0 [ 11.678620][ C3] ? __asan_memmove+0x3c/0x60 [ 11.678622][ C3] ? rcu_is_watching+0x16/0xd0 [ 11.678623][ C3] ? rcu_is_watching+0x16/0xd0 [ 11.678625][ C3] ? rcu_is_watching+0x16/0xd0 [ 11.678626][ C3] ? lock_acquire+0x13c/0x160 [ 11.678628][ C3] ? console_flush_one_record+0x111/0x710 [ 11.678629][ C3] console_flush_one_record+0x46f/0x710 [ 11.678631][ C3] ? console_emit_next_record+0x4f0/0x4f0 [ 11.678633][ C3] console_unlock+0xee/0x1f0 [ 11.678635][ C3] ? lock_acquire+0x13c/0x160 [ 11.678636][ C3] ? console_flush_one_record+0x710/0x710 [ 11.678638][ C3] ? rcu_is_watching+0x16/0xd0 [ 11.678639][ C3] ? lock_release+0x184/0x1f0 [ 11.678640][ C3] ? lock_acquire+0x60/0x160 [ 11.678642][ C3] ? sync_exp_reset_tree_hotplug+0x3a0/0x3f0 [ 11.678644][ C3] ? __down_trylock_console_sem+0x5e/0xa0 [ 11.678646][ C3] ? vprintk_emit+0x320/0x3e0 [ 11.678648][ C3] vprintk_emit+0x37c/0x3e0 [ 11.678650][ C3] ? wake_up_klogd_work_func+0x90/0x90 [ 11.678651][ C3] ? do_raw_spin_trylock+0xb6/0x180 [ 11.678652][ C3] ? rcu_is_watching+0x16/0xd0 [ 11.678653][ C3] ? lock_acquire+0x13c/0x160 [ 11.678656][ C3] _printk+0xc7/0x100 [ 11.678659][ C3] ? snapshot_read.cold+0x21/0x21 [ 11.678660][ C3] ? ___ratelimit+0x4e7/0xa00 [ 11.678664][ C3] ? idr_get_free+0x830/0x830 [ 11.678666][ C3] ? trace_irq_enable.constprop.0+0x30/0x160 [ 11.678669][ C3] bond_xfrm_update_stats.cold+0x49/0x4e [ 11.678672][ C3] xfrm_timer_handler+0x10e/0xcb0 [ 11.678676][ C3] ? xfrm_state_delete+0x40/0x40 [ 11.678678][ C3] ? rb_erase_linked+0xc5/0x1b0 [ 11.678680][ C3] ? rcu_is_watching+0x16/0xd0 [ 11.678681][ C3] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 11.678683][ C3] ? xfrm_state_delete+0x40/0x40 [ 11.678684][ C3] __run_hrtimer+0x281/0x560 [ 11.678688][ C3] __hrtimer_run_queues+0x123/0x270 [ 11.678690][ C3] hrtimer_run_softirq+0x1ba/0x320 [ 11.678692][ C3] handle_softirqs+0x1d3/0x900 [ 11.678695][ C3] ? _local_bh_enable+0xc0/0xc0 [ 11.678696][ C3] ? rcu_is_watching+0x16/0xd0 [ 11.678698][ C3] ? lock_release+0x184/0x1f0 [ 11.678700][ C3] __irq_exit_rcu+0x145/0x1c0 [ 11.678702][ C3] irq_exit_rcu+0xe/0x30 [ 11.678703][ C3] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 11.678705][ C3] [ 11.678706][ C3] [ 11.678707][ C3] ? _raw_spin_unlock+0x2d/0x50 [ 11.678709][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 11.678711][ C3] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 11.678714][ C3] Code: 48 8b 3d 94 12 09 02 e8 1f 00 00 00 48 2b 05 58 a3 a6 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 56 1b 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 11.678716][ C3] RSP: 0018:ffa0000000167e00 EFLAGS: 00000246 [ 11.678719][ C3] RAX: 0000000000000003 RBX: ff11000001c98040 RCX: 0000000000000001 [ 11.678721][ C3] RDX: 0000000000000003 RSI: ffffffffab88f4e0 RDI: ffffffffa8efa307 [ 11.678722][ C3] RBP: 0000000000000000 R08: ffffffffab4e4421 R09: 1fe2200005cf63a2 [ 11.678723][ C3] R10: 0000000000000003 R11: 0000000000000000 R12: 1ff400000002cfc3 [ 11.678723][ C3] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000000000 [ 11.678725][ C3] ? ct_kernel_exit.constprop.0+0x101/0x160 [ 11.678727][ C3] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 11.678730][ C3] default_idle+0x9/0x10 [ 11.678732][ C3] default_idle_call+0x6e/0xb0 [ 11.678734][ C3] cpuidle_idle_call.constprop.0+0x237/0x410 [ 11.678736][ C3] ? arch_cpu_idle_exit+0x40/0x40 [ 11.678737][ C3] ? mark_tsc_async_resets+0x30/0x30 [ 11.678740][ C3] ? rcu_is_watching+0x16/0xd0 [ 11.678742][ C3] do_idle+0xd8/0x190 [ 11.678744][ C3] cpu_startup_entry+0x53/0x70 [ 11.678746][ C3] start_secondary+0x204/0x2b0 [ 11.678748][ C3] ? set_cpu_sibling_map+0x2130/0x2130 [ 11.678750][ C3] common_startup_64+0x13e/0x148 [ 11.678755][ C3] [ 11.695308][ C0] bond_xfrm_update_stats: eth0 doesn't support xdo_dev_state_update_stats [ 12.036338][ T12] bond0: (slave eth0): link status definitely down, disabling slave [ 12.036610][ T12] bond0: (slave eth1): making interface the new active one [ 13.341364][ T12] bond0: (slave eth1): Releasing backup interface [ 13.341379][ T12] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 13.341381][ T12] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 12, name: kworker/u16:0 [ 13.341383][ T12] preempt_count: 1, expected: 0 [ 13.341384][ T12] RCU nest depth: 0, expected: 0 [ 13.341385][ T12] INFO: lockdep is turned off. [ 13.341386][ T12] irq event stamp: 120 [ 13.341387][ T12] hardirqs last enabled at (119): [] _raw_spin_unlock_irq+0x28/0x50 [ 13.341395][ T12] hardirqs last disabled at (120): [] __schedule+0x1246/0x20e0 [ 13.341398][ T12] softirqs last enabled at (108): [] handle_softirqs+0x67c/0x900 [ 13.341402][ T12] softirqs last disabled at (101): [] __irq_exit_rcu+0x145/0x1c0 [ 13.341405][ T12] Preemption disabled at: [ 13.341406][ T12] [] vprintk_emit+0x31b/0x3e0 [ 13.341413][ T12] CPU: 1 UID: 0 PID: 12 Comm: kworker/u16:0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 13.341416][ T12] Tainted: [W]=WARN [ 13.341417][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 13.341419][ T12] Workqueue: netns cleanup_net [ 13.341424][ T12] Call Trace: [ 13.341426][ T12] [ 13.341427][ T12] dump_stack_lvl+0x6f/0xa0 [ 13.341432][ T12] ? vprintk_emit+0x31b/0x3e0 [ 13.341433][ T12] __might_resched.cold+0x1fe/0x2c1 [ 13.341437][ T12] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 13.341439][ T12] ? __asan_memcpy+0x3c/0x60 [ 13.341442][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341446][ T12] __kmalloc_noprof+0x443/0x760 [ 13.341449][ T12] ? __rwlock_init+0x150/0x150 [ 13.341451][ T12] ? alloc_buf.isra.0+0x4b/0x260 [ 13.341455][ T12] ? do_raw_spin_unlock+0x59/0x250 [ 13.341456][ T12] alloc_buf.isra.0+0x4b/0x260 [ 13.341459][ T12] put_chars+0x1e1/0x2f0 [ 13.341462][ T12] ? __send_to_port+0x420/0x420 [ 13.341464][ T12] ? desc_read+0x2f0/0x2f0 [ 13.341466][ T12] ? console_prepend_replay+0x20/0x20 [ 13.341468][ T12] ? desc_read+0x219/0x2f0 [ 13.341469][ T12] hvc_console_print+0x292/0x780 [ 13.341474][ T12] ? hvc_write+0x3a0/0x3a0 [ 13.341476][ T12] ? __rwlock_init+0x150/0x150 [ 13.341477][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341478][ T12] ? lock_acquire+0x13c/0x160 [ 13.341481][ T12] console_emit_next_record+0x252/0x4f0 [ 13.341483][ T12] ? devkmsg_read+0x4e0/0x4e0 [ 13.341485][ T12] ? _prb_read_valid+0x6e0/0x6e0 [ 13.341487][ T12] ? __asan_memmove+0x3c/0x60 [ 13.341488][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341489][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341491][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341492][ T12] ? lock_acquire+0x13c/0x160 [ 13.341494][ T12] ? console_flush_one_record+0x111/0x710 [ 13.341495][ T12] console_flush_one_record+0x46f/0x710 [ 13.341497][ T12] ? console_emit_next_record+0x4f0/0x4f0 [ 13.341499][ T12] console_unlock+0xee/0x1f0 [ 13.341501][ T12] ? lock_acquire+0x13c/0x160 [ 13.341503][ T12] ? console_flush_one_record+0x710/0x710 [ 13.341504][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341505][ T12] ? lock_release+0x184/0x1f0 [ 13.341507][ T12] ? lock_acquire+0x60/0x160 [ 13.341509][ T12] ? sync_exp_reset_tree_hotplug+0x3a0/0x3f0 [ 13.341511][ T12] ? __down_trylock_console_sem+0x5e/0xa0 [ 13.341513][ T12] ? vprintk_emit+0x320/0x3e0 [ 13.341515][ T12] vprintk_emit+0x37c/0x3e0 [ 13.341517][ T12] ? wake_up_klogd_work_func+0x90/0x90 [ 13.341518][ T12] ? bond_slave_netdev_event.isra.0+0x23/0x820 [ 13.341521][ T12] _printk+0xc7/0x100 [ 13.341524][ T12] ? snapshot_read.cold+0x21/0x21 [ 13.341527][ T12] ? __netdev_upper_dev_unlink+0x16f/0x1e0 [ 13.341529][ T12] ? netdev_name+0x43/0x60 [ 13.341531][ T12] ? __netdev_printk+0x17f/0x1d0 [ 13.341533][ T12] netdev_info+0xe2/0x116 [ 13.341535][ T12] ? netdev_notice+0x120/0x120 [ 13.341537][ T12] ? netdev_upper_dev_unlink+0x79/0xa0 [ 13.341538][ T12] ? __netdev_upper_dev_unlink+0x1e0/0x1e0 [ 13.341540][ T12] __bond_release_one.cold+0x80/0xa60 [ 13.341544][ T12] ? __flush_work+0x70/0x1f0 [ 13.341546][ T12] ? bond_enslave+0x5100/0x5100 [ 13.341550][ T12] ? trace_hardirqs_on+0x36/0x40 [ 13.341552][ T12] ? __local_bh_enable_ip+0xaa/0x150 [ 13.341554][ T12] ? bond_slave_netdev_event.isra.0+0xaa/0x820 [ 13.341555][ T12] ? xfrm_dev_policy_flush+0x17c/0x220 [ 13.341558][ T12] bond_netdev_event+0x13f/0x300 [ 13.341560][ T12] notifier_call_chain+0xae/0x300 [ 13.341563][ T12] unregister_netdevice_many_notify+0xc5a/0x1b40 [ 13.341566][ T12] ? unregister_netdevice_queued+0x80/0x80 [ 13.341568][ T12] ? nsim_destroy+0x133/0x7c0 [netdevsim] [ 13.341574][ T12] ? netdev_run_todo+0x2a8/0xfd0 [ 13.341576][ T12] ? rtnl_is_locked+0x15/0x20 [ 13.341579][ T12] unregister_netdevice_queue+0x290/0x470 [ 13.341581][ T12] ? rtnl_net_dev_lock+0xdb/0x270 [ 13.341583][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341585][ T12] ? unregister_netdevice_many+0x20/0x20 [ 13.341587][ T12] nsim_destroy+0x1b1/0x7c0 [netdevsim] [ 13.341590][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341592][ T12] __nsim_dev_port_del+0x183/0x300 [netdevsim] [ 13.341595][ T12] nsim_dev_reload_destroy+0xe3/0x4b0 [netdevsim] [ 13.341598][ T12] nsim_dev_reload_down+0x5d/0xc0 [netdevsim] [ 13.341601][ T12] devlink_reload+0x16a/0x430 [ 13.341604][ T12] ? xas_find_conflict+0xa51/0xb10 [ 13.341607][ T12] ? devlink_notify_unregister+0x60/0x60 [ 13.341609][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341610][ T12] ? lock_release+0x184/0x1f0 [ 13.341613][ T12] devlink_pernet_pre_exit+0x1fd/0x330 [ 13.341614][ T12] ? devlink_free+0x480/0x480 [ 13.341616][ T12] ? lock_release+0x184/0x1f0 [ 13.341618][ T12] ? _raw_spin_unlock+0x2d/0x50 [ 13.341620][ T12] ops_undo_list+0x156/0x8f0 [ 13.341622][ T12] ? rtnl_net_dumpid_one+0x2d0/0x2d0 [ 13.341623][ T12] ? idr_alloc+0xc0/0xc0 [ 13.341626][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341628][ T12] cleanup_net+0x431/0x890 [ 13.341630][ T12] ? net_passive_dec+0x230/0x230 [ 13.341631][ T12] ? lock_acquire+0x13c/0x160 [ 13.341633][ T12] ? rcu_is_watching+0x16/0xd0 [ 13.341635][ T12] process_one_work+0xe3e/0x1560 [ 13.341638][ T12] ? __queue_delayed_work+0x470/0x470 [ 13.341639][ T12] ? find_held_lock+0x2b/0x80 [ 13.341641][ T12] ? __rwlock_init+0x150/0x150 [ 13.341643][ T12] worker_thread+0x4f1/0xd60 [ 13.341646][ T12] ? rescuer_thread+0x1340/0x1340 [ 13.341647][ T12] kthread+0x367/0x460 [ 13.341649][ T12] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 13.341651][ T12] ? kthread_affine_preferred+0x4c0/0x4c0 [ 13.341653][ T12] ret_from_fork+0x474/0x6b0 [ 13.341656][ T12] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 13.341659][ T12] ? __switch_to+0x5a3/0xe00 [ 13.341662][ T12] ? kthread_affine_preferred+0x4c0/0x4c0 [ 13.341664][ T12] ret_from_fork_asm+0x11/0x20 [ 13.341668][ T12] [ 13.379165][ T12] bond0: (slave eth0): Releasing backup interface [ 13.419608][ T12] bond0 (unregistering): Released all slaves