[ 10.396139][ C0] clocksource: Watchdog remote CPU 3 read timed out [ 10.396315][ C0] [ 10.396317][ C0] ======================================================== [ 10.396318][ C0] WARNING: possible irq lock inversion dependency detected [ 10.396320][ C0] 7.2.0-virtme #1 Tainted: G W [ 10.396322][ C0] -------------------------------------------------------- [ 10.396322][ C0] swapper/0/0 just changed the state of lock: [ 10.396324][ C0] ffffffffb5689660 (console_owner){..-.}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 10.396336][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 10.396337][ C0] (fs_reclaim){+.+.}-{0:0} [ 10.396339][ C0] [ 10.396339][ C0] [ 10.396339][ C0] and interrupts could create inverse lock ordering between them. [ 10.396339][ C0] [ 10.396340][ C0] [ 10.396340][ C0] other info that might help us debug this: [ 10.396340][ C0] Possible interrupt unsafe locking scenario: [ 10.396340][ C0] [ 10.396341][ C0] CPU0 CPU1 [ 10.396341][ C0] ---- ---- [ 10.396342][ C0] lock(fs_reclaim); [ 10.396343][ C0] local_irq_disable(); [ 10.396343][ C0] lock(console_owner); [ 10.396344][ C0] lock(fs_reclaim); [ 10.396345][ C0] [ 10.396346][ C0] lock(console_owner); [ 10.396346][ C0] [ 10.396346][ C0] *** DEADLOCK *** [ 10.396346][ C0] [ 10.396347][ C0] locks held by swapper/0/0: 4, last CPU#0: [ 10.396348][ C0] #0: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 10.396354][ C0] #1: ffffffffb57ce8b8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 10.396358][ C0] #2: ffffffffb5769cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 10.396362][ C0] #3: ffffffffb5769d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 10.396365][ C0] [ 10.396365][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 10.396370][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 10.396373][ C0] HARDIRQ-ON-W at: [ 10.396374][ C0] __lock_acquire+0x388/0xc20 [ 10.396378][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.396379][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.396382][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 10.396385][ C0] kthread_create_worker_on_node+0xea/0x210 [ 10.396388][ C0] workqueue_init+0x2a/0x680 [ 10.396391][ C0] kernel_init_freeable+0x2fe/0x630 [ 10.396394][ C0] kernel_init+0x21/0x150 [ 10.396397][ C0] ret_from_fork+0x474/0x6b0 [ 10.396400][ C0] ret_from_fork_asm+0x11/0x20 [ 10.396403][ C0] SOFTIRQ-ON-W at: [ 10.396404][ C0] __lock_acquire+0x388/0xc20 [ 10.396405][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.396407][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.396408][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 10.396409][ C0] kthread_create_worker_on_node+0xea/0x210 [ 10.396410][ C0] workqueue_init+0x2a/0x680 [ 10.396412][ C0] kernel_init_freeable+0x2fe/0x630 [ 10.396413][ C0] kernel_init+0x21/0x150 [ 10.396414][ C0] ret_from_fork+0x474/0x6b0 [ 10.396415][ C0] ret_from_fork_asm+0x11/0x20 [ 10.396417][ C0] INITIAL USE at: [ 10.396417][ C0] __lock_acquire+0x388/0xc20 [ 10.396419][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.396420][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.396421][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 10.396423][ C0] kthread_create_worker_on_node+0xea/0x210 [ 10.396424][ C0] workqueue_init+0x2a/0x680 [ 10.396425][ C0] kernel_init_freeable+0x2fe/0x630 [ 10.396426][ C0] kernel_init+0x21/0x150 [ 10.396428][ C0] ret_from_fork+0x474/0x6b0 [ 10.396429][ C0] ret_from_fork_asm+0x11/0x20 [ 10.396430][ C0] } [ 10.396430][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 10.396434][ C0] ... acquired at: [ 10.396435][ C0] __lock_acquire+0x518/0xc20 [ 10.396437][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.396438][ C0] fs_reclaim_acquire+0xd5/0x120 [ 10.396439][ C0] __kmalloc_noprof+0xd3/0x760 [ 10.396440][ C0] alloc_buf.isra.0+0x4b/0x260 [ 10.396443][ C0] put_chars+0x1e1/0x2f0 [ 10.396444][ C0] hvc_console_print+0x292/0x780 [ 10.396446][ C0] console_emit_next_record+0x22f/0x4c0 [ 10.396448][ C0] console_flush_one_record+0x46f/0x710 [ 10.396449][ C0] console_unlock+0xee/0x1f0 [ 10.396451][ C0] vprintk_emit+0x37c/0x3e0 [ 10.396452][ C0] dev_vprintk_emit+0x27f/0x2c0 [ 10.396455][ C0] dev_printk_emit+0xb9/0xee [ 10.396457][ C0] _dev_info+0xe2/0x116 [ 10.396458][ C0] __devm_rtc_register_device.cold+0xc3/0x3a8 [ 10.396461][ C0] cmos_do_probe+0x73b/0x98a [ 10.396463][ C0] platform_probe+0xfe/0x1f0 [ 10.396466][ C0] call_driver_probe+0x61/0x1c0 [ 10.396467][ C0] really_probe+0x199/0x760 [ 10.396469][ C0] __driver_probe_device+0x24f/0x440 [ 10.396470][ C0] driver_probe_device+0x4a/0xf0 [ 10.396472][ C0] __driver_attach+0x1b8/0x540 [ 10.396473][ C0] bus_for_each_dev+0x130/0x1e0 [ 10.396474][ C0] bus_add_driver+0x2c8/0x530 [ 10.396475][ C0] driver_register+0x1a3/0x390 [ 10.396477][ C0] __platform_driver_probe+0x13f/0x270 [ 10.396478][ C0] cmos_init+0x31/0x40 [ 10.396481][ C0] do_one_initcall+0x124/0x4f0 [ 10.396482][ C0] kernel_init_freeable+0x596/0x630 [ 10.396484][ C0] kernel_init+0x21/0x150 [ 10.396485][ C0] ret_from_fork+0x474/0x6b0 [ 10.396486][ C0] ret_from_fork_asm+0x11/0x20 [ 10.396487][ C0] [ 10.396488][ C0] -> (console_owner){..-.}-{0:0} { [ 10.396489][ C0] IN-SOFTIRQ-W at: [ 10.396490][ C0] __lock_acquire+0x388/0xc20 [ 10.396492][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.396493][ C0] console_lock_spinning_enable+0x5c/0x60 [ 10.396495][ C0] console_emit_next_record+0x1d1/0x4c0 [ 10.396497][ C0] console_flush_one_record+0x46f/0x710 [ 10.396498][ C0] console_unlock+0xee/0x1f0 [ 10.396500][ C0] vprintk_emit+0x37c/0x3e0 [ 10.396501][ C0] _printk+0xc7/0x100 [ 10.396504][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.396506][ C0] call_timer_fn+0x160/0x4d0 [ 10.396508][ C0] __run_timers+0x68f/0xaa0 [ 10.396509][ C0] run_timer_softirq+0xf0/0x160 [ 10.396511][ C0] handle_softirqs+0x1d3/0x900 [ 10.396513][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.396515][ C0] irq_exit_rcu+0xe/0x30 [ 10.396516][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.396518][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.396520][ C0] pv_native_safe_halt+0xf/0x10 [ 10.396521][ C0] default_idle+0x9/0x10 [ 10.396523][ C0] default_idle_call+0x6e/0xb0 [ 10.396524][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.396527][ C0] do_idle+0xd8/0x190 [ 10.396528][ C0] cpu_startup_entry+0x53/0x70 [ 10.396529][ C0] rest_init+0x279/0x280 [ 10.396530][ C0] start_kernel+0x3af/0x3b0 [ 10.396532][ C0] x86_64_start_reservations+0x24/0x30 [ 10.396534][ C0] x86_64_start_kernel+0x12b/0x130 [ 10.396535][ C0] common_startup_64+0x13e/0x148 [ 10.396537][ C0] INITIAL USE at: [ 10.396538][ C0] } [ 10.396539][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 10.396542][ C0] ... acquired at: [ 10.396542][ C0] mark_lock+0x1d7/0xa00 [ 10.396544][ C0] mark_usage+0x42/0x170 [ 10.396545][ C0] __lock_acquire+0x388/0xc20 [ 10.396546][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.396548][ C0] console_lock_spinning_enable+0x5c/0x60 [ 10.396549][ C0] console_emit_next_record+0x1d1/0x4c0 [ 10.396551][ C0] console_flush_one_record+0x46f/0x710 [ 10.396552][ C0] console_unlock+0xee/0x1f0 [ 10.396554][ C0] vprintk_emit+0x37c/0x3e0 [ 10.396555][ C0] _printk+0xc7/0x100 [ 10.396557][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.396558][ C0] call_timer_fn+0x160/0x4d0 [ 10.396559][ C0] __run_timers+0x68f/0xaa0 [ 10.396561][ C0] run_timer_softirq+0xf0/0x160 [ 10.396562][ C0] handle_softirqs+0x1d3/0x900 [ 10.396564][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.396565][ C0] irq_exit_rcu+0xe/0x30 [ 10.396566][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.396567][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.396569][ C0] pv_native_safe_halt+0xf/0x10 [ 10.396570][ C0] default_idle+0x9/0x10 [ 10.396571][ C0] default_idle_call+0x6e/0xb0 [ 10.396573][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.396574][ C0] do_idle+0xd8/0x190 [ 10.396575][ C0] cpu_startup_entry+0x53/0x70 [ 10.396576][ C0] rest_init+0x279/0x280 [ 10.396578][ C0] start_kernel+0x3af/0x3b0 [ 10.396579][ C0] x86_64_start_reservations+0x24/0x30 [ 10.396580][ C0] x86_64_start_kernel+0x12b/0x130 [ 10.396582][ C0] common_startup_64+0x13e/0x148 [ 10.396583][ C0] [ 10.396583][ C0] [ 10.396583][ C0] stack backtrace: [ 10.396586][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 10.396590][ C0] Tainted: [W]=WARN [ 10.396591][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 10.396592][ C0] Call Trace: [ 10.396594][ C0] [ 10.396595][ C0] dump_stack_lvl+0x6f/0xa0 [ 10.396599][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 10.396601][ C0] mark_lock_irq+0x989/0x9c0 [ 10.396603][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 10.396606][ C0] mark_lock+0x1d7/0xa00 [ 10.396608][ C0] mark_usage+0x42/0x170 [ 10.396610][ C0] __lock_acquire+0x388/0xc20 [ 10.396612][ C0] lock_acquire.part.0+0xd4/0x280 [ 10.396614][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 10.396616][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396619][ C0] ? lock_acquire+0x13c/0x160 [ 10.396621][ C0] console_lock_spinning_enable+0x5c/0x60 [ 10.396623][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 10.396624][ C0] console_emit_next_record+0x1d1/0x4c0 [ 10.396626][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 10.396628][ C0] ? console_flush_one_record+0x106/0x710 [ 10.396630][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396632][ C0] ? lock_acquire+0x13c/0x160 [ 10.396634][ C0] console_flush_one_record+0x46f/0x710 [ 10.396636][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 10.396638][ C0] ? __lock_acquire+0x518/0xc20 [ 10.396640][ C0] console_unlock+0xee/0x1f0 [ 10.396642][ C0] ? console_flush_one_record+0x710/0x710 [ 10.396644][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396645][ C0] ? lock_acquire+0x60/0x160 [ 10.396647][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 10.396649][ C0] ? vprintk_emit+0x320/0x3e0 [ 10.396651][ C0] vprintk_emit+0x37c/0x3e0 [ 10.396653][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 10.396655][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 10.396657][ C0] _printk+0xc7/0x100 [ 10.396658][ C0] ? snapshot_read.cold+0x21/0x21 [ 10.396660][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 10.396662][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.396664][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.396666][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.396667][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.396669][ C0] call_timer_fn+0x160/0x4d0 [ 10.396671][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 10.396672][ C0] ? debug_object_active_state+0x430/0x430 [ 10.396676][ C0] ? find_held_lock+0x2b/0x80 [ 10.396677][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.396679][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396681][ C0] __run_timers+0x68f/0xaa0 [ 10.396683][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.396685][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 10.396686][ C0] ? __lock_acquire+0x518/0xc20 [ 10.396695][ C0] ? __rwlock_init+0x150/0x150 [ 10.396697][ C0] run_timer_softirq+0xf0/0x160 [ 10.396699][ C0] ? __run_timers+0xaa0/0xaa0 [ 10.396701][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 10.396703][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396705][ C0] handle_softirqs+0x1d3/0x900 [ 10.396707][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.396709][ C0] ? _local_bh_enable+0xc0/0xc0 [ 10.396711][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.396712][ C0] irq_exit_rcu+0xe/0x30 [ 10.396714][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.396715][ C0] [ 10.396716][ C0] [ 10.396716][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 10.396718][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.396720][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 10.396722][ C0] Code: 48 8b 3d 94 f2 f5 01 e8 1f 00 00 00 48 2b 05 58 b3 95 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 a6 11 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 10.396724][ C0] RSP: 0018:ffffffffb5407cf8 EFLAGS: 00000296 [ 10.396726][ C0] RAX: 0000000000051bbd RBX: ffffffffb541c600 RCX: ffffffffb24f0307 [ 10.396728][ C0] RDX: ffffffffb541c600 RSI: ffffffffb5238b1c RDI: ffffffffb4c8d8e0 [ 10.396728][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 10.396729][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff6a80fa2 [ 10.396730][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 10.396732][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.396734][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 10.396735][ C0] default_idle+0x9/0x10 [ 10.396737][ C0] default_idle_call+0x6e/0xb0 [ 10.396739][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.396740][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 10.396742][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 10.396744][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396746][ C0] do_idle+0xd8/0x190 [ 10.396747][ C0] cpu_startup_entry+0x53/0x70 [ 10.396749][ C0] rest_init+0x279/0x280 [ 10.396751][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 10.396753][ C0] ? rest_init+0x280/0x280 [ 10.396755][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 10.396759][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 10.396761][ C0] ? acpi_enable+0x1e4/0x330 [ 10.396764][ C0] start_kernel+0x3af/0x3b0 [ 10.396765][ C0] x86_64_start_reservations+0x24/0x30 [ 10.396767][ C0] x86_64_start_kernel+0x12b/0x130 [ 10.396769][ C0] common_startup_64+0x13e/0x148 [ 10.396772][ C0] [ 10.396776][ C0] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 10.396778][ C0] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 0, name: swapper/0 [ 10.396779][ C0] preempt_count: 103, expected: 0 [ 10.396780][ C0] RCU nest depth: 0, expected: 0 [ 10.396780][ C0] INFO: lockdep is turned off. [ 10.396781][ C0] irq event stamp: 334797 [ 10.396782][ C0] hardirqs last enabled at (334796): [] __down_trylock_console_sem+0x86/0xa0 [ 10.396784][ C0] hardirqs last disabled at (334797): [] console_emit_next_record+0x3d4/0x4c0 [ 10.396786][ C0] softirqs last enabled at (334776): [] handle_softirqs+0x67c/0x900 [ 10.396788][ C0] softirqs last disabled at (334783): [] __irq_exit_rcu+0x145/0x1c0 [ 10.396789][ C0] Preemption disabled at: [ 10.396790][ C0] [] schedule_preempt_disabled+0x22/0x30 [ 10.396792][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 10.396794][ C0] Tainted: [W]=WARN [ 10.396795][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 10.396795][ C0] Call Trace: [ 10.396796][ C0] [ 10.396796][ C0] dump_stack_lvl+0x6f/0xa0 [ 10.396798][ C0] ? schedule_preempt_disabled+0x22/0x30 [ 10.396800][ C0] __might_resched.cold+0x1fe/0x2c1 [ 10.396802][ C0] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 10.396806][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396808][ C0] __kmalloc_noprof+0x443/0x760 [ 10.396809][ C0] ? __rwlock_init+0x150/0x150 [ 10.396811][ C0] ? alloc_buf.isra.0+0x4b/0x260 [ 10.396813][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 10.396814][ C0] alloc_buf.isra.0+0x4b/0x260 [ 10.396816][ C0] put_chars+0x1e1/0x2f0 [ 10.396818][ C0] ? __send_to_port+0x420/0x420 [ 10.396820][ C0] ? mark_lock+0x1d7/0xa00 [ 10.396822][ C0] hvc_console_print+0x292/0x780 [ 10.396824][ C0] ? hvc_write+0x3a0/0x3a0 [ 10.396825][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396827][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396829][ C0] console_emit_next_record+0x22f/0x4c0 [ 10.396831][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 10.396833][ C0] ? console_flush_one_record+0x106/0x710 [ 10.396835][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396837][ C0] ? lock_acquire+0x13c/0x160 [ 10.396839][ C0] console_flush_one_record+0x46f/0x710 [ 10.396841][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 10.396842][ C0] ? __lock_acquire+0x518/0xc20 [ 10.396845][ C0] console_unlock+0xee/0x1f0 [ 10.396846][ C0] ? console_flush_one_record+0x710/0x710 [ 10.396848][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396850][ C0] ? lock_acquire+0x60/0x160 [ 10.396852][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 10.396853][ C0] ? vprintk_emit+0x320/0x3e0 [ 10.396855][ C0] vprintk_emit+0x37c/0x3e0 [ 10.396857][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 10.396860][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 10.396861][ C0] _printk+0xc7/0x100 [ 10.396863][ C0] ? snapshot_read.cold+0x21/0x21 [ 10.396865][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 10.396866][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.396868][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 10.396870][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.396872][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.396873][ C0] call_timer_fn+0x160/0x4d0 [ 10.396875][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 10.396877][ C0] ? debug_object_active_state+0x430/0x430 [ 10.396878][ C0] ? find_held_lock+0x2b/0x80 [ 10.396880][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.396881][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396883][ C0] __run_timers+0x68f/0xaa0 [ 10.396885][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 10.396887][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 10.396889][ C0] ? __lock_acquire+0x518/0xc20 [ 10.396892][ C0] ? __rwlock_init+0x150/0x150 [ 10.396894][ C0] run_timer_softirq+0xf0/0x160 [ 10.396896][ C0] ? __run_timers+0xaa0/0xaa0 [ 10.396897][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 10.396899][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396900][ C0] handle_softirqs+0x1d3/0x900 [ 10.396902][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 10.396904][ C0] ? _local_bh_enable+0xc0/0xc0 [ 10.396906][ C0] __irq_exit_rcu+0x145/0x1c0 [ 10.396907][ C0] irq_exit_rcu+0xe/0x30 [ 10.396908][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 10.396910][ C0] [ 10.396910][ C0] [ 10.396911][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 10.396912][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 10.396914][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 10.396916][ C0] Code: 48 8b 3d 94 f2 f5 01 e8 1f 00 00 00 48 2b 05 58 b3 95 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 a6 11 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 10.396917][ C0] RSP: 0018:ffffffffb5407cf8 EFLAGS: 00000296 [ 10.396918][ C0] RAX: 0000000000051bbd RBX: ffffffffb541c600 RCX: ffffffffb24f0307 [ 10.396919][ C0] RDX: ffffffffb541c600 RSI: ffffffffb5238b1c RDI: ffffffffb4c8d8e0 [ 10.396919][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 10.396920][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff6a80fa2 [ 10.396921][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 10.396922][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.396924][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 10.396926][ C0] default_idle+0x9/0x10 [ 10.396927][ C0] default_idle_call+0x6e/0xb0 [ 10.396929][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 10.396930][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 10.396932][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 10.396934][ C0] ? rcu_is_watching+0x16/0xd0 [ 10.396936][ C0] do_idle+0xd8/0x190 [ 10.396937][ C0] cpu_startup_entry+0x53/0x70 [ 10.396939][ C0] rest_init+0x279/0x280 [ 10.396940][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 10.396943][ C0] ? rest_init+0x280/0x280 [ 10.396945][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 10.396947][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 10.396949][ C0] ? acpi_enable+0x1e4/0x330 [ 10.396951][ C0] start_kernel+0x3af/0x3b0 [ 10.396952][ C0] x86_64_start_reservations+0x24/0x30 [ 10.396954][ C0] x86_64_start_kernel+0x12b/0x130 [ 10.396956][ C0] common_startup_64+0x13e/0x148 [ 10.396958][ C0] [ 10.874103][ T242] br1: port 1(veth1) entered blocking state [ 10.874396][ T242] br1: port 1(veth1) entered disabled state [ 10.874665][ T242] veth1: entered allmulticast mode [ 10.876498][ T242] veth1: entered promiscuous mode [ 10.898297][ T38] br1: port 1(veth1) entered blocking state [ 10.898503][ T38] br1: port 1(veth1) entered forwarding state [ 10.913048][ T244] br1: port 2(veth2) entered blocking state [ 10.913253][ T244] br1: port 2(veth2) entered disabled state [ 10.913429][ T244] veth2: entered allmulticast mode [ 10.914307][ T244] veth2: entered promiscuous mode [ 10.931408][ T38] br1: port 2(veth2) entered blocking state [ 10.931657][ T38] br1: port 2(veth2) entered forwarding state [ 24.262853][ T624] br1: port 2(veth2) entered disabled state [ 24.262870][ T624] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 24.262873][ T624] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 624, name: ip [ 24.262874][ T624] preempt_count: 202, expected: 0 [ 24.262875][ T624] RCU nest depth: 0, expected: 0 [ 24.262876][ T624] INFO: lockdep is turned off. [ 24.262877][ T624] irq event stamp: 0 [ 24.262878][ T624] hardirqs last enabled at (0): [<0000000000000000>] 0x0 [ 24.262883][ T624] hardirqs last disabled at (0): [] copy_process+0x1ccd/0x6240 [ 24.262889][ T624] softirqs last enabled at (0): [] copy_process+0x1d21/0x6240 [ 24.262891][ T624] softirqs last disabled at (0): [<0000000000000000>] 0x0 [ 24.262893][ T624] Preemption disabled at: [ 24.262893][ T624] [<0000000000000000>] 0x0 [ 24.262898][ T624] CPU: 0 UID: 0 PID: 624 Comm: ip Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 24.262902][ T624] Tainted: [W]=WARN [ 24.262903][ T624] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 24.262905][ T624] Call Trace: [ 24.262906][ T624] [ 24.262908][ T624] dump_stack_lvl+0x6f/0xa0 [ 24.262913][ T624] __might_resched.cold+0x1fe/0x2c1 [ 24.262917][ T624] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 24.262921][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.262925][ T624] __kmalloc_noprof+0x443/0x760 [ 24.262929][ T624] ? __rwlock_init+0x150/0x150 [ 24.262931][ T624] ? alloc_buf.isra.0+0x4b/0x260 [ 24.262935][ T624] ? do_raw_spin_unlock+0x59/0x250 [ 24.262937][ T624] alloc_buf.isra.0+0x4b/0x260 [ 24.262939][ T624] put_chars+0x1e1/0x2f0 [ 24.262941][ T624] ? __send_to_port+0x420/0x420 [ 24.262943][ T624] ? printk_get_next_message+0x240/0x650 [ 24.262946][ T624] hvc_console_print+0x292/0x780 [ 24.262949][ T624] ? hvc_write+0x3a0/0x3a0 [ 24.262951][ T624] ? __rwlock_init+0x150/0x150 [ 24.262953][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.262955][ T624] ? lock_acquire+0x13c/0x160 [ 24.262957][ T624] console_emit_next_record+0x22f/0x4c0 [ 24.262959][ T624] ? devkmsg_read+0x4b0/0x4b0 [ 24.262961][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.262963][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.262964][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.262966][ T624] ? lock_acquire+0x13c/0x160 [ 24.262968][ T624] ? console_flush_one_record+0x111/0x710 [ 24.262970][ T624] console_flush_one_record+0x46f/0x710 [ 24.262972][ T624] ? console_emit_next_record+0x4c0/0x4c0 [ 24.262975][ T624] console_unlock+0xee/0x1f0 [ 24.262976][ T624] ? lock_acquire+0x13c/0x160 [ 24.262978][ T624] ? console_flush_one_record+0x710/0x710 [ 24.262980][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.262981][ T624] ? lock_release+0x184/0x1f0 [ 24.262983][ T624] ? lock_acquire+0x60/0x160 [ 24.262984][ T624] ? __rcu_read_lock+0x30/0x70 [ 24.262986][ T624] ? __down_trylock_console_sem+0x5e/0xa0 [ 24.262988][ T624] ? vprintk_emit+0x320/0x3e0 [ 24.262990][ T624] vprintk_emit+0x37c/0x3e0 [ 24.262992][ T624] ? wake_up_klogd_work_func+0x90/0x90 [ 24.262994][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.262996][ T624] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 24.262998][ T624] ? trace_hardirqs_on+0x36/0x40 [ 24.263002][ T624] _printk+0xc7/0x100 [ 24.263005][ T624] ? snapshot_read.cold+0x21/0x21 [ 24.263008][ T624] ? ipv6_mc_down+0x17e/0x2d0 [ 24.263012][ T624] br_set_state+0x22f/0x430 [bridge] [ 24.263025][ T624] br_stp_disable_port+0x11f/0x390 [bridge] [ 24.263033][ T624] br_device_event+0x7b5/0x8f0 [bridge] [ 24.263042][ T624] ? _raw_spin_unlock_irqrestore+0x40/0x80 [ 24.263045][ T624] ? _sub_I_65535_1+0x4d0/0x4d0 [stp] [ 24.263048][ T624] ? addrconf_notify+0x2c8/0xf30 [ 24.263052][ T624] notifier_call_chain+0xae/0x300 [ 24.263055][ T624] __dev_notify_flags+0x23c/0x3c0 [ 24.263058][ T624] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 24.263060][ T624] ? netif_change_name+0x8c0/0x8c0 [ 24.263062][ T624] ? netif_set_allmulti+0x250/0x250 [ 24.263064][ T624] ? __kernel_text_address+0x12/0x30 [ 24.263066][ T624] ? write_profile+0xf0/0xf0 [ 24.263068][ T624] ? unwind_get_return_address+0x67/0xd0 [ 24.263071][ T624] netif_change_flags+0xfe/0x190 [ 24.263074][ T624] do_setlink.isra.0+0x1cc3/0x2750 [ 24.263077][ T624] ? stack_trace_save+0x93/0xc0 [ 24.263078][ T624] ? rtnl_link_get_size+0x350/0x350 [ 24.263079][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263081][ T624] ? stack_depot_save_flags+0x1bc/0x790 [ 24.263085][ T624] ? kasan_save_stack+0x3d/0x50 [ 24.263088][ T624] ? kasan_save_stack+0x2f/0x50 [ 24.263089][ T624] ? kasan_save_track+0x14/0x30 [ 24.263090][ T624] ? __kasan_kmalloc+0x7b/0x90 [ 24.263092][ T624] ? __kmalloc_cache_noprof+0x29a/0x620 [ 24.263093][ T624] ? rtnl_newlink+0x124/0x11c0 [ 24.263094][ T624] ? rtnetlink_rcv_msg+0x6fd/0xbd0 [ 24.263096][ T624] ? netlink_rcv_skb+0x14e/0x3a0 [ 24.263098][ T624] ? netlink_unicast+0x486/0x750 [ 24.263099][ T624] ? netlink_sendmsg+0x735/0xc60 [ 24.263101][ T624] ? ____sys_sendmsg+0x415/0x880 [ 24.263103][ T624] ? ___sys_sendmsg+0x14e/0x1d0 [ 24.263105][ T624] ? __sys_sendmsg+0x12c/0x1d0 [ 24.263106][ T624] ? do_syscall_64+0xff/0x530 [ 24.263108][ T624] ? entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 24.263111][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263113][ T624] ? lock_acquire+0x13c/0x160 [ 24.263114][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263116][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263118][ T624] ? trace_contention_end+0xb3/0x180 [ 24.263121][ T624] ? __mutex_lock+0x1db/0x1ea0 [ 24.263122][ T624] ? __mutex_lock+0x9a3/0x1ea0 [ 24.263124][ T624] ? rtnl_newlink+0x9a8/0x11c0 [ 24.263125][ T624] ? ww_mutex_lock+0x160/0x160 [ 24.263127][ T624] ? __rtnl_newlink+0x3fa/0xa50 [ 24.263129][ T624] rtnl_newlink+0x9f1/0x11c0 [ 24.263131][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263133][ T624] ? rtnl_bridge_getlink+0x850/0x850 [ 24.263134][ T624] ? lock_acquire+0x13c/0x160 [ 24.263136][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263138][ T624] ? is_bpf_text_address+0x3e/0x110 [ 24.263141][ T624] ? is_bpf_text_address+0x72/0x110 [ 24.263143][ T624] ? kernel_text_address+0x149/0x170 [ 24.263144][ T624] ? __kernel_text_address+0x12/0x30 [ 24.263145][ T624] ? write_profile+0xf0/0xf0 [ 24.263147][ T624] ? unwind_get_return_address+0x67/0xd0 [ 24.263148][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263150][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263151][ T624] ? cap_capable+0x1d7/0x3d0 [ 24.263155][ T624] ? lock_acquire+0x13c/0x160 [ 24.263156][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263158][ T624] ? rtnl_bridge_getlink+0x850/0x850 [ 24.263159][ T624] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 24.263161][ T624] ? rtnl_link_fill+0x920/0x920 [ 24.263162][ T624] ? filter_irq_stacks+0xd0/0xd0 [ 24.263164][ T624] ? stack_depot_save_flags+0x1bc/0x790 [ 24.263166][ T624] netlink_rcv_skb+0x14e/0x3a0 [ 24.263167][ T624] ? rtnl_link_fill+0x920/0x920 [ 24.263169][ T624] ? lock_release+0x184/0x1f0 [ 24.263170][ T624] ? netlink_ack+0xcf0/0xcf0 [ 24.263172][ T624] ? __netlink_lookup+0xb9/0x6b0 [ 24.263174][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263176][ T624] ? lock_release+0x184/0x1f0 [ 24.263178][ T624] netlink_unicast+0x486/0x750 [ 24.263180][ T624] ? netlink_attachskb+0x810/0x810 [ 24.263181][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263183][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263185][ T624] ? lock_acquire+0x13c/0x160 [ 24.263186][ T624] netlink_sendmsg+0x735/0xc60 [ 24.263188][ T624] ? netlink_unicast+0x750/0x750 [ 24.263190][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263192][ T624] ? lock_release+0x184/0x1f0 [ 24.263194][ T624] ____sys_sendmsg+0x415/0x880 [ 24.263195][ T624] ? copy_msghdr_from_user+0x279/0x420 [ 24.263197][ T624] ? get_timestamp.constprop.0+0x390/0x390 [ 24.263198][ T624] ? move_addr_to_kernel+0x40/0x40 [ 24.263200][ T624] ? filter_irq_stacks+0xd0/0xd0 [ 24.263202][ T624] ___sys_sendmsg+0x14e/0x1d0 [ 24.263204][ T624] ? copy_msghdr_from_user+0x420/0x420 [ 24.263209][ T624] __sys_sendmsg+0x12c/0x1d0 [ 24.263211][ T624] ? __sys_sendmsg_sock+0x20/0x20 [ 24.263214][ T624] ? rcu_is_watching+0x16/0xd0 [ 24.263216][ T624] do_syscall_64+0xff/0x530 [ 24.263217][ T624] ? exc_page_fault+0xee/0x100 [ 24.263219][ T624] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 24.263221][ T624] RIP: 0033:0x7f51d0fd254e [ 24.263223][ T624] Code: 4d 89 d8 e8 b4 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 24.263224][ T624] RSP: 002b:00007ffe7d692ed0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 24.263228][ T624] RAX: ffffffffffffffda RBX: 0000000000000003 RCX: 00007f51d0fd254e [ 24.263229][ T624] RDX: 0000000000000000 RSI: 00007ffe7d692f80 RDI: 0000000000000005 [ 24.263230][ T624] RBP: 00007ffe7d692ee0 R08: 0000000000000000 R09: 0000000000000000 [ 24.263231][ T624] R10: 0000000000000000 R11: 0000000000000202 R12: 000000006a90e726 [ 24.263231][ T624] R13: 00000000004a1620 R14: 0000000000000000 R15: 00007ffe7d693640 [ 24.263234][ T624] [ 24.296912][ T624] ip (624) used greatest stack depth: 23016 bytes left [ 24.320236][ T625] veth2: left allmulticast mode [ 24.320510][ T625] veth2: left promiscuous mode [ 24.320888][ T625] br1: port 2(veth2) entered disabled state [ 24.344073][ T626] br1: port 1(veth1) entered disabled state [ 24.368236][ T627] veth1: left allmulticast mode [ 24.368402][ T627] veth1: left promiscuous mode [ 24.368603][ T627] br1: port 1(veth1) entered disabled state