[ 11.290384][ T241] br1: port 1(veth1) entered blocking state [ 11.290488][ T241] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 11.290490][ T241] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 241, name: ip [ 11.290492][ T241] preempt_count: 1, expected: 0 [ 11.290493][ T241] RCU nest depth: 0, expected: 0 [ 11.290494][ T241] locks held by ip/241: 5, last CPU#3: [ 11.290496][ T241] #0: ffffffffb9ad2c40 (rtnl_mutex){+.+.}-{4:4}, at: rtnl_newlink+0x9a8/0x11c0 [ 11.290509][ T241] #1: ffffffffb9369cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 11.290515][ T241] #2: ffffffffb9369d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 11.290519][ T241] #3: ffffffffb9289660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 11.290523][ T241] #4: ffffffffb9289560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 11.290527][ T241] irq event stamp: 20018 [ 11.290527][ T241] hardirqs last enabled at (20017): [] __down_trylock_console_sem+0x86/0xa0 [ 11.290530][ T241] hardirqs last disabled at (20018): [] console_emit_next_record+0x3d4/0x4c0 [ 11.290532][ T241] softirqs last enabled at (19930): [] __alloc_skb+0x4c2/0x5f0 [ 11.290535][ T241] softirqs last disabled at (19928): [] __alloc_skb+0x4c2/0x5f0 [ 11.290538][ T241] Preemption disabled at: [ 11.290538][ T241] [] vprintk_emit+0x31b/0x3e0 [ 11.290544][ T241] CPU: 3 UID: 0 PID: 241 Comm: ip Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 11.290548][ T241] Tainted: [W]=WARN [ 11.290549][ T241] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 11.290551][ T241] Call Trace: [ 11.290552][ T241] [ 11.290554][ T241] dump_stack_lvl+0x6f/0xa0 [ 11.290560][ T241] ? vprintk_emit+0x31b/0x3e0 [ 11.290562][ T241] __might_resched.cold+0x1fe/0x2c1 [ 11.290566][ T241] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 11.290570][ T241] ? __kmalloc_noprof+0xdb/0x760 [ 11.290576][ T241] __kmalloc_noprof+0x443/0x760 [ 11.290578][ T241] ? alloc_buf.isra.0+0x4b/0x260 [ 11.290584][ T241] ? do_raw_spin_unlock+0x59/0x250 [ 11.290586][ T241] alloc_buf.isra.0+0x4b/0x260 [ 11.290590][ T241] put_chars+0x1e1/0x2f0 [ 11.290592][ T241] ? __send_to_port+0x420/0x420 [ 11.290597][ T241] ? validate_chain+0x34a/0xc20 [ 11.290600][ T241] hvc_console_print+0x292/0x780 [ 11.290603][ T241] ? mark_usage+0x61/0x170 [ 11.290605][ T241] ? __lock_acquire+0x518/0xc20 [ 11.290607][ T241] ? __lock_acquire+0x518/0xc20 [ 11.290611][ T241] ? hvc_write+0x3a0/0x3a0 [ 11.290613][ T241] ? console_emit_next_record+0x1df/0x4c0 [ 11.290616][ T241] ? rcu_is_watching+0x16/0xd0 [ 11.290620][ T241] ? lock_acquire+0x13c/0x160 [ 11.290624][ T241] console_emit_next_record+0x22f/0x4c0 [ 11.290627][ T241] ? devkmsg_read+0x4b0/0x4b0 [ 11.290629][ T241] ? console_flush_one_record+0x106/0x710 [ 11.290632][ T241] ? rcu_is_watching+0x16/0xd0 [ 11.290635][ T241] ? lock_acquire+0x13c/0x160 [ 11.290639][ T241] console_flush_one_record+0x46f/0x710 [ 11.290643][ T241] ? console_emit_next_record+0x4c0/0x4c0 [ 11.290644][ T241] ? __lock_acquire+0x518/0xc20 [ 11.290650][ T241] console_unlock+0xee/0x1f0 [ 11.290652][ T241] ? console_flush_one_record+0x710/0x710 [ 11.290654][ T241] ? rcu_is_watching+0x16/0xd0 [ 11.290657][ T241] ? lock_acquire+0x60/0x160 [ 11.290660][ T241] ? __down_trylock_console_sem+0x5e/0xa0 [ 11.290662][ T241] ? vprintk_emit+0x320/0x3e0 [ 11.290665][ T241] vprintk_emit+0x37c/0x3e0 [ 11.290669][ T241] ? wake_up_klogd_work_func+0x90/0x90 [ 11.290671][ T241] ? __lock_release.isra.0+0x69/0x1a0 [ 11.290673][ T241] ? _raw_spin_unlock_irqrestore+0x40/0x80 [ 11.290677][ T241] ? mark_held_locks+0x40/0x70 [ 11.290681][ T241] _printk+0xc7/0x100 [ 11.290684][ T241] ? snapshot_read.cold+0x21/0x21 [ 11.290688][ T241] ? br_multicast_flood+0xab0/0xab0 [bridge] [ 11.290701][ T241] ? do_setlink.isra.0+0xa31/0x2750 [ 11.290702][ T241] ? rtnl_newlink+0x9f1/0x11c0 [ 11.290704][ T241] ? rtnetlink_rcv_msg+0x6fd/0xbd0 [ 11.290708][ T241] br_set_state+0x22f/0x430 [bridge] [ 11.290718][ T241] br_init_port+0xc4/0x200 [bridge] [ 11.290726][ T241] new_nbp+0x39c/0x580 [bridge] [ 11.290735][ T241] br_add_if+0x212/0x1320 [bridge] [ 11.290746][ T241] ? is_bpf_text_address+0x72/0x110 [ 11.290750][ T241] ? kernel_text_address+0x149/0x170 [ 11.290753][ T241] ? __kernel_text_address+0x12/0x30 [ 11.290757][ T241] do_set_master+0x357/0x580 [ 11.290761][ T241] do_setlink.isra.0+0xa31/0x2750 [ 11.290765][ T241] ? stack_trace_save+0x93/0xc0 [ 11.290767][ T241] ? rtnl_link_get_size+0x350/0x350 [ 11.290769][ T241] ? rcu_read_lock_any_held+0x66/0x90 [ 11.290771][ T241] ? stack_depot_save_flags+0x38e/0x790 [ 11.290775][ T241] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 11.290778][ T241] ? rcu_read_lock_any_held+0x3c/0x90 [ 11.290779][ T241] ? validate_chain+0x38b/0xc20 [ 11.290782][ T241] ? kasan_save_stack+0x3d/0x50 [ 11.290785][ T241] ? kasan_save_stack+0x2f/0x50 [ 11.290786][ T241] ? kasan_save_track+0x14/0x30 [ 11.290789][ T241] ? __lock_acquire+0x518/0xc20 [ 11.290791][ T241] ? netlink_seq_next+0xe/0x60 [ 11.290794][ T241] ? ___sys_sendmsg+0xb0/0x1d0 [ 11.290798][ T241] ? lock_acquire.part.0+0xd4/0x280 [ 11.290800][ T241] ? rtnl_newlink+0x9a8/0x11c0 [ 11.290802][ T241] ? rcu_is_watching+0x16/0xd0 [ 11.290805][ T241] ? lock_acquire+0x13c/0x160 [ 11.290806][ T241] ? rcu_is_watching+0x16/0xd0 [ 11.290808][ T241] ? rcu_is_watching+0x16/0xd0 [ 11.290810][ T241] ? trace_contention_end+0xb3/0x180 [ 11.290814][ T241] ? __mutex_lock+0x1db/0x1ea0 [ 11.290816][ T241] ? __mutex_lock+0x9a3/0x1ea0 [ 11.290818][ T241] ? rtnl_newlink+0x9a8/0x11c0 [ 11.290821][ T241] ? ww_mutex_lock+0x160/0x160 [ 11.290823][ T241] ? nla_get_range_signed+0x3d0/0x3d0 [ 11.290828][ T241] ? __rtnl_newlink+0x3fa/0xa50 [ 11.290833][ T241] rtnl_newlink+0x9f1/0x11c0 [ 11.290838][ T241] ? rtnl_bridge_getlink+0x850/0x850 [ 11.290840][ T241] ? __lock_acquire+0x518/0xc20 [ 11.290844][ T241] ? lock_acquire.part.0+0xd4/0x280 [ 11.290846][ T241] ? find_held_lock+0x2b/0x80 [ 11.290848][ T241] ? rtnl_bridge_getlink+0x850/0x850 [ 11.290850][ T241] ? __lock_release.isra.0+0x69/0x1a0 [ 11.290853][ T241] ? rtnl_bridge_getlink+0x850/0x850 [ 11.290855][ T241] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 11.290858][ T241] ? rtnl_link_fill+0x920/0x920 [ 11.290860][ T241] ? __lock_acquire+0x518/0xc20 [ 11.290864][ T241] ? lock_acquire.part.0+0xd4/0x280 [ 11.290866][ T241] ? find_held_lock+0x2b/0x80 [ 11.290869][ T241] netlink_rcv_skb+0x14e/0x3a0 [ 11.290871][ T241] ? rtnl_link_fill+0x920/0x920 [ 11.290874][ T241] ? netlink_ack+0xcf0/0xcf0 [ 11.290880][ T241] ? netlink_deliver_tap+0xc5/0x330 [ 11.290881][ T241] ? netlink_deliver_tap+0x13c/0x330 [ 11.290885][ T241] netlink_unicast+0x486/0x750 [ 11.290889][ T241] ? netlink_attachskb+0x810/0x810 [ 11.290891][ T241] ? __lock_acquire+0x518/0xc20 [ 11.290896][ T241] netlink_sendmsg+0x735/0xc60 [ 11.290899][ T241] ? netlink_unicast+0x750/0x750 [ 11.290903][ T241] ? __might_fault+0x97/0x140 [ 11.290908][ T241] ____sys_sendmsg+0x415/0x880 [ 11.290910][ T241] ? copy_msghdr_from_user+0x279/0x420 [ 11.290913][ T241] ? get_timestamp.constprop.0+0x390/0x390 [ 11.290920][ T241] ? move_addr_to_kernel+0x40/0x40 [ 11.290927][ T241] ___sys_sendmsg+0x14e/0x1d0 [ 11.290930][ T241] ? copy_msghdr_from_user+0x420/0x420 [ 11.290945][ T241] __sys_sendmsg+0x12c/0x1d0 [ 11.290948][ T241] ? __sys_sendmsg_sock+0x20/0x20 [ 11.290954][ T241] ? rcu_is_watching+0x16/0xd0 [ 11.290958][ T241] do_syscall_64+0xff/0x530 [ 11.290960][ T241] ? exc_page_fault+0xee/0x100 [ 11.290963][ T241] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 11.290966][ T241] RIP: 0033:0x7f205108554e [ 11.290969][ T241] Code: 4d 89 d8 e8 b4 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 11.290971][ T241] RSP: 002b:00007ffd11492fc0 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 11.290974][ T241] RAX: ffffffffffffffda RBX: 0000000000000004 RCX: 00007f205108554e [ 11.290975][ T241] RDX: 0000000000000000 RSI: 00007ffd11493070 RDI: 0000000000000005 [ 11.290976][ T241] RBP: 00007ffd11492fd0 R08: 0000000000000000 R09: 0000000000000000 [ 11.290977][ T241] R10: 0000000000000000 R11: 0000000000000202 R12: 000000006a9183da [ 11.290978][ T241] R13: 00000000004a1620 R14: 0000000000000000 R15: 00007ffd11493730 [ 11.290984][ T241] [ 11.331554][ T241] br1: port 1(veth1) entered disabled state [ 11.331984][ T241] veth1: entered allmulticast mode [ 11.333785][ T241] veth1: entered promiscuous mode [ 11.343030][ T241] ip (241) used greatest stack depth: 23336 bytes left [ 11.370881][ T46] br1: port 1(veth1) entered blocking state [ 11.371326][ T46] br1: port 1(veth1) entered forwarding state [ 11.402883][ T243] br1: port 2(veth2) entered blocking state [ 11.403210][ T243] br1: port 2(veth2) entered disabled state [ 11.403519][ T243] veth2: entered allmulticast mode [ 11.406049][ T243] veth2: entered promiscuous mode [ 11.434359][ T104] br1: port 2(veth2) entered blocking state [ 11.434689][ T104] br1: port 2(veth2) entered forwarding state [ 26.478809][ C0] [ 26.478823][ C0] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 26.478825][ C0] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 0, name: swapper/0 [ 26.478827][ C0] preempt_count: 104, expected: 0 [ 26.478827][ C0] RCU nest depth: 0, expected: 0 [ 26.478829][ C0] INFO: lockdep is turned off. [ 26.478829][ C0] irq event stamp: 868074 [ 26.478830][ C0] hardirqs last enabled at (868074): [] _raw_spin_unlock_irq+0x28/0x50 [ 26.478839][ C0] hardirqs last disabled at (868073): [] _raw_spin_lock_irq+0x4a/0x50 [ 26.478841][ C0] softirqs last enabled at (868046): [] handle_softirqs+0x67c/0x900 [ 26.478844][ C0] softirqs last disabled at (868071): [] __irq_exit_rcu+0x145/0x1c0 [ 26.478846][ C0] Preemption disabled at: [ 26.478847][ C0] [] schedule_preempt_disabled+0x22/0x30 [ 26.478853][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 26.478857][ C0] Tainted: [W]=WARN [ 26.478858][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 26.478860][ C0] Call Trace: [ 26.478862][ C0] [ 26.478863][ C0] dump_stack_lvl+0x6f/0xa0 [ 26.478869][ C0] ? schedule_preempt_disabled+0x22/0x30 [ 26.478870][ C0] __might_resched.cold+0x1fe/0x2c1 [ 26.478874][ C0] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 26.478877][ C0] ? __asan_memcpy+0x3c/0x60 [ 26.478880][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.478883][ C0] __kmalloc_noprof+0x443/0x760 [ 26.478886][ C0] ? __rwlock_init+0x150/0x150 [ 26.478889][ C0] ? alloc_buf.isra.0+0x4b/0x260 [ 26.478893][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 26.478894][ C0] alloc_buf.isra.0+0x4b/0x260 [ 26.478896][ C0] put_chars+0x1e1/0x2f0 [ 26.478898][ C0] ? __send_to_port+0x420/0x420 [ 26.478900][ C0] ? console_prepend_replay+0x20/0x20 [ 26.478903][ C0] hvc_console_print+0x292/0x780 [ 26.478907][ C0] ? hvc_write+0x3a0/0x3a0 [ 26.478908][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.478910][ C0] ? lock_acquire+0x13c/0x160 [ 26.478912][ C0] console_emit_next_record+0x22f/0x4c0 [ 26.478914][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 26.478916][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.478918][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.478920][ C0] ? lock_acquire+0x13c/0x160 [ 26.478921][ C0] ? console_flush_one_record+0x111/0x710 [ 26.478923][ C0] console_flush_one_record+0x46f/0x710 [ 26.478925][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 26.478928][ C0] console_unlock+0xee/0x1f0 [ 26.478930][ C0] ? lock_acquire+0x13c/0x160 [ 26.478931][ C0] ? console_flush_one_record+0x710/0x710 [ 26.478933][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.478934][ C0] ? lock_release+0x184/0x1f0 [ 26.478936][ C0] ? lock_acquire+0x60/0x160 [ 26.478938][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 26.478939][ C0] ? vprintk_emit+0x320/0x3e0 [ 26.478941][ C0] vprintk_emit+0x37c/0x3e0 [ 26.478943][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 26.478945][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.478947][ C0] ? lock_release+0x184/0x1f0 [ 26.478948][ C0] ? x86_64_start_kernel+0xe0/0x130 [ 26.478953][ C0] _printk+0xc7/0x100 [ 26.478956][ C0] ? snapshot_read.cold+0x21/0x21 [ 26.478962][ C0] ? arch_stack_walk+0xd7/0x130 [ 26.478966][ C0] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 26.478968][ C0] ? nbcon_cpu_emergency_enter+0x28/0x80 [ 26.478970][ C0] print_irq_inversion_bug.part.0+0x32/0xc0 [ 26.478973][ C0] mark_lock_irq+0x989/0x9c0 [ 26.478976][ C0] mark_lock+0x1d7/0xa00 [ 26.478978][ C0] mark_usage+0x42/0x170 [ 26.478979][ C0] __lock_acquire+0x388/0xc20 [ 26.478982][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.478983][ C0] ? br_forward_delay_timer_expired+0x44/0x5d0 [bridge] [ 26.478996][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.478998][ C0] ? lock_acquire+0x13c/0x160 [ 26.478999][ C0] ? br_message_age_timer_expired+0x70/0x70 [bridge] [ 26.479006][ C0] _raw_spin_lock+0x33/0x40 [ 26.479008][ C0] ? br_forward_delay_timer_expired+0x44/0x5d0 [bridge] [ 26.479013][ C0] br_forward_delay_timer_expired+0x44/0x5d0 [bridge] [ 26.479020][ C0] ? br_message_age_timer_expired+0x70/0x70 [bridge] [ 26.479026][ C0] call_timer_fn+0x160/0x4d0 [ 26.479030][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 26.479033][ C0] ? debug_object_active_state+0x430/0x430 [ 26.479037][ C0] ? find_held_lock+0x2b/0x80 [ 26.479039][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.479040][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.479042][ C0] __run_timers+0x68f/0xaa0 [ 26.479044][ C0] ? br_message_age_timer_expired+0x70/0x70 [bridge] [ 26.479051][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 26.479053][ C0] ? __lock_acquire+0x518/0xc20 [ 26.479055][ C0] ? __rwlock_init+0x150/0x150 [ 26.479058][ C0] run_timer_softirq+0xf0/0x160 [ 26.479060][ C0] ? __run_timers+0xaa0/0xaa0 [ 26.479061][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 26.479064][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.479065][ C0] handle_softirqs+0x1d3/0x900 [ 26.479067][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.479069][ C0] ? _local_bh_enable+0xc0/0xc0 [ 26.479071][ C0] __irq_exit_rcu+0x145/0x1c0 [ 26.479072][ C0] irq_exit_rcu+0xe/0x30 [ 26.479074][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 26.479076][ C0] [ 26.479077][ C0] [ 26.479078][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 26.479079][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 26.479081][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 26.479084][ C0] Code: 48 8b 3d 94 d2 f5 01 e8 1f 00 00 00 48 2b 05 58 93 95 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 86 11 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 26.479086][ C0] RSP: 0018:ffffffffb9007cf8 EFLAGS: 00000296 [ 26.479089][ C0] RAX: 00000000000d3ee5 RBX: ffffffffb901c600 RCX: ffffffffb60f0307 [ 26.479090][ C0] RDX: ffffffffb901c600 RSI: ffffffffb8e38af6 RDI: ffffffffb888d8e0 [ 26.479091][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 26.479092][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff7200fa2 [ 26.479093][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 26.479095][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 26.479098][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 26.479099][ C0] default_idle+0x9/0x10 [ 26.479101][ C0] default_idle_call+0x6e/0xb0 [ 26.479102][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 26.479104][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 26.479106][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 26.479108][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 26.479109][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.479111][ C0] do_idle+0xd8/0x190 [ 26.479113][ C0] cpu_startup_entry+0x53/0x70 [ 26.479114][ C0] rest_init+0x279/0x280 [ 26.479116][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 26.479119][ C0] ? rest_init+0x280/0x280 [ 26.479121][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 26.479124][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 26.479127][ C0] ? acpi_enable+0x1e4/0x330 [ 26.479129][ C0] start_kernel+0x3af/0x3b0 [ 26.479131][ C0] x86_64_start_reservations+0x24/0x30 [ 26.479133][ C0] x86_64_start_kernel+0x12b/0x130 [ 26.479135][ C0] common_startup_64+0x13e/0x148 [ 26.479139][ C0] [ 26.501534][ C0] ======================================================== [ 26.501805][ C0] WARNING: possible irq lock inversion dependency detected [ 26.502085][ C0] 7.2.0-virtme #1 Tainted: G W [ 26.502324][ C0] -------------------------------------------------------- [ 26.502640][ C0] swapper/0/0 just changed the state of lock: [ 26.502822][ C0] ff1100000cc2ae58 (&br->lock){+.-.}-{3:3}, at: br_forward_delay_timer_expired+0x44/0x5d0 [bridge] [ 26.503188][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 26.503459][ C0] (fs_reclaim){+.+.}-{0:0} [ 26.503461][ C0] [ 26.503461][ C0] [ 26.503461][ C0] and interrupts could create inverse lock ordering between them. [ 26.503461][ C0] [ 26.504111][ C0] [ 26.504111][ C0] other info that might help us debug this: [ 26.504424][ C0] Chain exists of: [ 26.504424][ C0] &br->lock --> console_owner --> fs_reclaim [ 26.504424][ C0] [ 26.504813][ C0] Possible interrupt unsafe locking scenario: [ 26.504813][ C0] [ 26.505094][ C0] CPU0 CPU1 [ 26.505244][ C0] ---- ---- [ 26.505447][ C0] lock(fs_reclaim); [ 26.505561][ C0] local_irq_disable(); [ 26.505799][ C0] lock(&br->lock); [ 26.505994][ C0] lock(console_owner); [ 26.506184][ C0] [ 26.506299][ C0] lock(&br->lock); [ 26.506463][ C0] [ 26.506463][ C0] *** DEADLOCK *** [ 26.506463][ C0] [ 26.506682][ C0] locks held by swapper/0/0: 1, last CPU#0: [ 26.506867][ C0] #0: ffa0000000007c90 ((&p->forward_delay_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 26.507234][ C0] [ 26.507234][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 26.507544][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 26.507749][ C0] HARDIRQ-ON-W at: [ 26.507866][ C0] __lock_acquire+0x388/0xc20 [ 26.508068][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.508251][ C0] fs_reclaim_acquire+0xd5/0x120 [ 26.508541][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 26.508767][ C0] kthread_create_worker_on_node+0xea/0x210 [ 26.509102][ C0] workqueue_init+0x2a/0x680 [ 26.509341][ C0] kernel_init_freeable+0x2fe/0x630 [ 26.509615][ C0] kernel_init+0x21/0x150 [ 26.509796][ C0] ret_from_fork+0x474/0x6b0 [ 26.510040][ C0] ret_from_fork_asm+0x11/0x20 [ 26.510225][ C0] SOFTIRQ-ON-W at: [ 26.510381][ C0] __lock_acquire+0x388/0xc20 [ 26.510560][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.510794][ C0] fs_reclaim_acquire+0xd5/0x120 [ 26.511029][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 26.511249][ C0] kthread_create_worker_on_node+0xea/0x210 [ 26.511516][ C0] workqueue_init+0x2a/0x680 [ 26.511695][ C0] kernel_init_freeable+0x2fe/0x630 [ 26.511966][ C0] kernel_init+0x21/0x150 [ 26.512147][ C0] ret_from_fork+0x474/0x6b0 [ 26.512430][ C0] ret_from_fork_asm+0x11/0x20 [ 26.512612][ C0] INITIAL USE at: [ 26.512772][ C0] __lock_acquire+0x388/0xc20 [ 26.512951][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.513189][ C0] fs_reclaim_acquire+0xd5/0x120 [ 26.513418][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 26.513633][ C0] kthread_create_worker_on_node+0xea/0x210 [ 26.513900][ C0] workqueue_init+0x2a/0x680 [ 26.514141][ C0] kernel_init_freeable+0x2fe/0x630 [ 26.514319][ C0] kernel_init+0x21/0x150 [ 26.514547][ C0] ret_from_fork+0x474/0x6b0 [ 26.514780][ C0] ret_from_fork_asm+0x11/0x20 [ 26.514955][ C0] } [ 26.515086][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 26.515306][ C0] ... acquired at: [ 26.515463][ C0] __lock_acquire+0x518/0xc20 [ 26.515607][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.515801][ C0] fs_reclaim_acquire+0xd5/0x120 [ 26.515944][ C0] __kmalloc_noprof+0xd3/0x760 [ 26.516146][ C0] alloc_buf.isra.0+0x4b/0x260 [ 26.516291][ C0] put_chars+0x1e1/0x2f0 [ 26.516483][ C0] hvc_console_print+0x292/0x780 [ 26.516624][ C0] console_emit_next_record+0x22f/0x4c0 [ 26.516819][ C0] console_flush_one_record+0x46f/0x710 [ 26.516966][ C0] console_unlock+0xee/0x1f0 [ 26.517163][ C0] vprintk_emit+0x37c/0x3e0 [ 26.517304][ C0] dev_vprintk_emit+0x27f/0x2c0 [ 26.517501][ C0] dev_printk_emit+0xb9/0xee [ 26.517642][ C0] _dev_info+0xe2/0x116 [ 26.517748][ C0] __devm_rtc_register_device.cold+0xc3/0x3a8 [ 26.517926][ C0] cmos_do_probe+0x73b/0x98a [ 26.518138][ C0] platform_probe+0xfe/0x1f0 [ 26.518285][ C0] call_driver_probe+0x61/0x1c0 [ 26.518484][ C0] really_probe+0x199/0x760 [ 26.518625][ C0] __driver_probe_device+0x24f/0x440 [ 26.518820][ C0] driver_probe_device+0x4a/0xf0 [ 26.518968][ C0] __driver_attach+0x1b8/0x540 [ 26.519162][ C0] bus_for_each_dev+0x130/0x1e0 [ 26.519303][ C0] bus_add_driver+0x2c8/0x530 [ 26.519497][ C0] driver_register+0x1a3/0x390 [ 26.519641][ C0] __platform_driver_probe+0x13f/0x270 [ 26.519832][ C0] cmos_init+0x31/0x40 [ 26.519940][ C0] do_one_initcall+0x124/0x4f0 [ 26.520145][ C0] kernel_init_freeable+0x596/0x630 [ 26.520287][ C0] kernel_init+0x21/0x150 [ 26.520483][ C0] ret_from_fork+0x474/0x6b0 [ 26.520625][ C0] ret_from_fork_asm+0x11/0x20 [ 26.520818][ C0] [ 26.520892][ C0] -> (console_owner){....}-{0:0} { [ 26.521044][ C0] INITIAL USE at: [ 26.521201][ C0] } [ 26.521273][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 26.521538][ C0] ... acquired at: [ 26.521644][ C0] __lock_acquire+0x518/0xc20 [ 26.521835][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.521982][ C0] console_lock_spinning_enable+0x5c/0x60 [ 26.522217][ C0] console_emit_next_record+0x1d1/0x4c0 [ 26.522360][ C0] console_flush_one_record+0x46f/0x710 [ 26.522551][ C0] console_unlock+0xee/0x1f0 [ 26.522693][ C0] vprintk_emit+0x37c/0x3e0 [ 26.522887][ C0] _printk+0xc7/0x100 [ 26.523001][ C0] br_set_state+0x22f/0x430 [bridge] [ 26.523207][ C0] br_init_port+0xc4/0x200 [bridge] [ 26.523353][ C0] br_stp_enable_port+0x12/0x50 [bridge] [ 26.523587][ C0] br_port_carrier_check+0x220/0x430 [bridge] [ 26.523771][ C0] br_device_event+0x52d/0x8f0 [bridge] [ 26.523973][ C0] notifier_call_chain+0xae/0x300 [ 26.524118][ C0] netif_state_change+0x139/0x340 [ 26.524314][ C0] __linkwatch_run_queue+0x34c/0x750 [ 26.524458][ C0] linkwatch_event+0x7f/0xb0 [ 26.524647][ C0] process_one_work+0xe3e/0x1560 [ 26.524793][ C0] worker_thread+0x4f1/0xd60 [ 26.524990][ C0] kthread+0x367/0x460 [ 26.525099][ C0] ret_from_fork+0x474/0x6b0 [ 26.525293][ C0] ret_from_fork_asm+0x11/0x20 [ 26.525438][ C0] [ 26.525509][ C0] -> (&br->lock){+.-.}-{3:3} { [ 26.525705][ C0] HARDIRQ-ON-W at: [ 26.525817][ C0] __lock_acquire+0x388/0xc20 [ 26.526055][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.526285][ C0] _raw_spin_lock_bh+0x38/0x50 [ 26.526466][ C0] recalculate_group_addr+0x51/0x120 [bridge] [ 26.526737][ C0] br_vlan_filter_toggle+0x85/0x110 [bridge] [ 26.527019][ C0] br_changelink+0x575/0x16e0 [bridge] [ 26.527204][ C0] br_dev_newlink+0xeb/0x160 [bridge] [ 26.527439][ C0] rtnl_newlink_create+0x2d0/0x750 [ 26.527672][ C0] __rtnl_newlink+0x22b/0xa50 [ 26.527848][ C0] rtnl_newlink+0x9f1/0x11c0 [ 26.528088][ C0] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 26.528266][ C0] netlink_rcv_skb+0x14e/0x3a0 [ 26.528495][ C0] netlink_unicast+0x486/0x750 [ 26.528726][ C0] netlink_sendmsg+0x735/0xc60 [ 26.528904][ C0] ____sys_sendmsg+0x415/0x880 [ 26.529142][ C0] ___sys_sendmsg+0x14e/0x1d0 [ 26.529375][ C0] __sys_sendmsg+0x12c/0x1d0 [ 26.529551][ C0] do_syscall_64+0xff/0x530 [ 26.529784][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 26.530055][ C0] IN-SOFTIRQ-W at: [ 26.530162][ C0] __lock_acquire+0x388/0xc20 [ 26.530394][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.530573][ C0] _raw_spin_lock+0x33/0x40 [ 26.530802][ C0] br_forward_delay_timer_expired+0x44/0x5d0 [bridge] [ 26.531076][ C0] call_timer_fn+0x160/0x4d0 [ 26.531255][ C0] __run_timers+0x68f/0xaa0 [ 26.531484][ C0] run_timer_softirq+0xf0/0x160 [ 26.531662][ C0] handle_softirqs+0x1d3/0x900 [ 26.531896][ C0] __irq_exit_rcu+0x145/0x1c0 [ 26.532137][ C0] irq_exit_rcu+0xe/0x30 [ 26.536089][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 26.536372][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 26.536638][ C0] pv_native_safe_halt+0xf/0x10 [ 26.536822][ C0] default_idle+0x9/0x10 [ 26.537071][ C0] default_idle_call+0x6e/0xb0 [ 26.537302][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 26.537521][ C0] do_idle+0xd8/0x190 [ 26.537717][ C0] cpu_startup_entry+0x53/0x70 [ 26.537951][ C0] rest_init+0x279/0x280 [ 26.538142][ C0] start_kernel+0x3af/0x3b0 [ 26.538379][ C0] x86_64_start_reservations+0x24/0x30 [ 26.538559][ C0] x86_64_start_kernel+0x12b/0x130 [ 26.538794][ C0] common_startup_64+0x13e/0x148 [ 26.539038][ C0] INITIAL USE at: [ 26.539150][ C0] __lock_acquire+0x388/0xc20 [ 26.539388][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.539575][ C0] _raw_spin_lock_bh+0x38/0x50 [ 26.539810][ C0] recalculate_group_addr+0x51/0x120 [bridge] [ 26.540101][ C0] br_vlan_filter_toggle+0x85/0x110 [bridge] [ 26.540324][ C0] br_changelink+0x575/0x16e0 [bridge] [ 26.540564][ C0] br_dev_newlink+0xeb/0x160 [bridge] [ 26.540806][ C0] rtnl_newlink_create+0x2d0/0x750 [ 26.540994][ C0] __rtnl_newlink+0x22b/0xa50 [ 26.541232][ C0] rtnl_newlink+0x9f1/0x11c0 [ 26.541467][ C0] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 26.541647][ C0] netlink_rcv_skb+0x14e/0x3a0 [ 26.541882][ C0] netlink_unicast+0x486/0x750 [ 26.542070][ C0] netlink_sendmsg+0x735/0xc60 [ 26.542311][ C0] ____sys_sendmsg+0x415/0x880 [ 26.542546][ C0] ___sys_sendmsg+0x14e/0x1d0 [ 26.542730][ C0] __sys_sendmsg+0x12c/0x1d0 [ 26.542966][ C0] do_syscall_64+0xff/0x530 [ 26.543206][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 26.543429][ C0] } [ 26.543555][ C0] ... key at: [] __key.7+0x0/0x40 [bridge] [ 26.543780][ C0] ... acquired at: [ 26.543939][ C0] mark_lock+0x1d7/0xa00 [ 26.544095][ C0] mark_usage+0x42/0x170 [ 26.544291][ C0] __lock_acquire+0x388/0xc20 [ 26.544436][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.544639][ C0] _raw_spin_lock+0x33/0x40 [ 26.544785][ C0] br_forward_delay_timer_expired+0x44/0x5d0 [bridge] [ 26.545028][ C0] call_timer_fn+0x160/0x4d0 [ 26.545173][ C0] __run_timers+0x68f/0xaa0 [ 26.545371][ C0] run_timer_softirq+0xf0/0x160 [ 26.545516][ C0] handle_softirqs+0x1d3/0x900 [ 26.545715][ C0] __irq_exit_rcu+0x145/0x1c0 [ 26.545862][ C0] irq_exit_rcu+0xe/0x30 [ 26.546067][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 26.546247][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 26.546480][ C0] pv_native_safe_halt+0xf/0x10 [ 26.546677][ C0] default_idle+0x9/0x10 [ 26.546822][ C0] default_idle_call+0x6e/0xb0 [ 26.547024][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 26.547207][ C0] do_idle+0xd8/0x190 [ 26.547370][ C0] cpu_startup_entry+0x53/0x70 [ 26.547515][ C0] rest_init+0x279/0x280 [ 26.547710][ C0] start_kernel+0x3af/0x3b0 [ 26.547857][ C0] x86_64_start_reservations+0x24/0x30 [ 26.548057][ C0] x86_64_start_kernel+0x12b/0x130 [ 26.548203][ C0] common_startup_64+0x13e/0x148 [ 26.548399][ C0] [ 26.548477][ C0] [ 26.548477][ C0] stack backtrace: [ 26.548660][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 26.548664][ C0] Tainted: [W]=WARN [ 26.548665][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 26.548666][ C0] Call Trace: [ 26.548667][ C0] [ 26.548668][ C0] dump_stack_lvl+0x6f/0xa0 [ 26.548673][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 26.548676][ C0] mark_lock_irq+0x989/0x9c0 [ 26.548679][ C0] mark_lock+0x1d7/0xa00 [ 26.548681][ C0] mark_usage+0x42/0x170 [ 26.548683][ C0] __lock_acquire+0x388/0xc20 [ 26.548685][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.548687][ C0] ? br_forward_delay_timer_expired+0x44/0x5d0 [bridge] [ 26.548693][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.548697][ C0] ? lock_acquire+0x13c/0x160 [ 26.548698][ C0] ? br_message_age_timer_expired+0x70/0x70 [bridge] [ 26.548704][ C0] _raw_spin_lock+0x33/0x40 [ 26.548706][ C0] ? br_forward_delay_timer_expired+0x44/0x5d0 [bridge] [ 26.548712][ C0] br_forward_delay_timer_expired+0x44/0x5d0 [bridge] [ 26.548718][ C0] ? br_message_age_timer_expired+0x70/0x70 [bridge] [ 26.548724][ C0] call_timer_fn+0x160/0x4d0 [ 26.548726][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 26.548728][ C0] ? debug_object_active_state+0x430/0x430 [ 26.548731][ C0] ? find_held_lock+0x2b/0x80 [ 26.548733][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.548735][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.548737][ C0] __run_timers+0x68f/0xaa0 [ 26.548739][ C0] ? br_message_age_timer_expired+0x70/0x70 [bridge] [ 26.548745][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 26.548747][ C0] ? __lock_acquire+0x518/0xc20 [ 26.548749][ C0] ? __rwlock_init+0x150/0x150 [ 26.548752][ C0] run_timer_softirq+0xf0/0x160 [ 26.548754][ C0] ? __run_timers+0xaa0/0xaa0 [ 26.548755][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 26.548758][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.548759][ C0] handle_softirqs+0x1d3/0x900 [ 26.548761][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.548763][ C0] ? _local_bh_enable+0xc0/0xc0 [ 26.548765][ C0] __irq_exit_rcu+0x145/0x1c0 [ 26.548766][ C0] irq_exit_rcu+0xe/0x30 [ 26.548767][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 26.548769][ C0] [ 26.548770][ C0] [ 26.548770][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 26.548772][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 26.548774][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 26.548776][ C0] Code: 48 8b 3d 94 d2 f5 01 e8 1f 00 00 00 48 2b 05 58 93 95 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 86 11 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 26.548778][ C0] RSP: 0018:ffffffffb9007cf8 EFLAGS: 00000296 [ 26.548781][ C0] RAX: 00000000000d3ee5 RBX: ffffffffb901c600 RCX: ffffffffb60f0307 [ 26.548782][ C0] RDX: ffffffffb901c600 RSI: ffffffffb8e38af6 RDI: ffffffffb888d8e0 [ 26.548783][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 26.548784][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff7200fa2 [ 26.548785][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 26.548786][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 26.548788][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 26.548790][ C0] default_idle+0x9/0x10 [ 26.548791][ C0] default_idle_call+0x6e/0xb0 [ 26.548793][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 26.548794][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 26.548796][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 26.548798][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 26.548799][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.548801][ C0] do_idle+0xd8/0x190 [ 26.548803][ C0] cpu_startup_entry+0x53/0x70 [ 26.548804][ C0] rest_init+0x279/0x280 [ 26.548806][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 26.548809][ C0] ? rest_init+0x280/0x280 [ 26.548810][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 26.548814][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 26.548817][ C0] ? acpi_enable+0x1e4/0x330 [ 26.548819][ C0] start_kernel+0x3af/0x3b0 [ 26.548820][ C0] x86_64_start_reservations+0x24/0x30 [ 26.548822][ C0] x86_64_start_kernel+0x12b/0x130 [ 26.548824][ C0] common_startup_64+0x13e/0x148 [ 26.548827][ C0] [ 27.060478][ T624] br1: port 2(veth2) entered disabled state [ 27.078199][ T625] veth2: left allmulticast mode [ 27.078364][ T625] veth2: left promiscuous mode [ 27.078565][ T625] br1: port 2(veth2) entered disabled state [ 27.093747][ T626] br1: port 1(veth1) entered disabled state [ 27.107641][ T627] veth1: left allmulticast mode [ 27.108413][ T627] veth1: left promiscuous mode [ 27.108665][ T627] br1: port 1(veth1) entered disabled state