[ 33.297416][ T490] br1: port 1(veth1) entered blocking state [ 33.297884][ T490] br1: port 1(veth1) entered disabled state [ 33.298116][ T490] veth1: entered allmulticast mode [ 33.299621][ T490] veth1: entered promiscuous mode [ 33.363302][ T493] br1: port 2(veth2) entered blocking state [ 33.363513][ T493] br1: port 2(veth2) entered disabled state [ 33.363699][ T493] veth2: entered allmulticast mode [ 33.365070][ T493] veth2: entered promiscuous mode [ 33.424094][ T495] br1: port 2(veth2) entered blocking state [ 33.424495][ T495] br1: port 2(veth2) entered forwarding state [ 33.424906][ T495] br1: port 1(veth1) entered blocking state [ 33.425073][ T495] br1: port 1(veth1) entered forwarding state [ 38.182691][ C2] [ 38.182817][ C2] ======================================================== [ 38.182952][ C2] WARNING: possible irq lock inversion dependency detected [ 38.183078][ C2] 7.1.0-rc5-virtme #1 Not tainted [ 38.183159][ C2] -------------------------------------------------------- [ 38.183275][ C2] swapper/2/0 just changed the state of lock: [ 38.183384][ C2] ff1100000d753d78 (&ndev->lock){++-.}-{3:3}, at: addrconf_rs_timer+0xb0/0x770 [ 38.183535][ C2] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 38.183662][ C2] (acaddr_hash_lock){+.+.}-{3:3} [ 38.183664][ C2] [ 38.183664][ C2] [ 38.183664][ C2] and interrupts could create inverse lock ordering between them. [ 38.183664][ C2] [ 38.183969][ C2] [ 38.183969][ C2] other info that might help us debug this: [ 38.184089][ C2] Possible interrupt unsafe locking scenario: [ 38.184089][ C2] [ 38.184212][ C2] CPU0 CPU1 [ 38.184292][ C2] ---- ---- [ 38.184377][ C2] lock(acaddr_hash_lock); [ 38.184457][ C2] local_irq_disable(); [ 38.184556][ C2] lock(&ndev->lock); [ 38.184657][ C2] lock(acaddr_hash_lock); [ 38.184757][ C2] [ 38.184817][ C2] lock(&ndev->lock); [ 38.184878][ C2] [ 38.184878][ C2] *** DEADLOCK *** [ 38.184878][ C2] [ 38.184996][ C2] 1 lock held by swapper/2/0: [ 38.185076][ C2] #0: ffa0000000228c90 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0x113/0x4f0 [ 38.185221][ C2] [ 38.185221][ C2] the shortest dependencies between 2nd lock and 1st lock: [ 38.185363][ C2] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 38.185445][ C2] HARDIRQ-ON-W at: [ 38.185506][ C2] __lock_acquire+0x378/0xc10 [ 38.185608][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.185708][ C2] _raw_spin_lock+0x33/0x40 [ 38.185806][ C2] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 38.185925][ C2] __ipv6_dev_ac_inc+0x57e/0x930 [ 38.186024][ C2] addrconf_join_anycast+0x1bc/0x260 [ 38.186122][ C2] __ipv6_ifa_notify+0x75b/0xad0 [ 38.186222][ C2] addrconf_dad_completed+0x14b/0xe10 [ 38.186344][ C2] addrconf_dad_begin+0x2e1/0x540 [ 38.186443][ C2] addrconf_dad_work+0x170/0x930 [ 38.186543][ C2] process_one_work+0xdf8/0x1410 [ 38.186642][ C2] worker_thread+0x4f1/0xd60 [ 38.186742][ C2] kthread+0x367/0x460 [ 38.186840][ C2] ret_from_fork+0x474/0x6b0 [ 38.186940][ C2] ret_from_fork_asm+0x11/0x20 [ 38.187039][ C2] SOFTIRQ-ON-W at: [ 38.187098][ C2] __lock_acquire+0x378/0xc10 [ 38.187196][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.187295][ C2] _raw_spin_lock+0x33/0x40 [ 38.187400][ C2] __ipv6_dev_ac_dec+0x236/0x5d0 [ 38.187497][ C2] addrconf_leave_anycast+0x1bc/0x260 [ 38.187616][ C2] __ipv6_ifa_notify+0x6b4/0xad0 [ 38.187718][ C2] addrconf_ifdown.isra.0+0xa70/0x15f0 [ 38.187837][ C2] addrconf_notify+0x339/0xf30 [ 38.187938][ C2] notifier_call_chain+0xb0/0x320 [ 38.188038][ C2] __netdev_upper_dev_link+0x3a5/0x590 [ 38.188159][ C2] netdev_master_upper_dev_link+0x86/0xb0 [ 38.188280][ C2] vrf_add_slave+0xdd/0x210 [vrf] [ 38.188388][ C2] do_set_master+0x357/0x580 [ 38.188488][ C2] do_setlink.isra.0+0xa31/0x2750 [ 38.188587][ C2] rtnl_newlink+0x8d1/0xef0 [ 38.188686][ C2] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 38.188786][ C2] netlink_rcv_skb+0x14e/0x3a0 [ 38.188887][ C2] netlink_unicast+0x486/0x750 [ 38.188987][ C2] netlink_sendmsg+0x735/0xc60 [ 38.189085][ C2] ____sys_sendmsg+0x419/0x850 [ 38.189185][ C2] ___sys_sendmsg+0x14e/0x1d0 [ 38.189283][ C2] __sys_sendmsg+0x145/0x1f0 [ 38.189386][ C2] do_syscall_64+0x117/0x590 [ 38.189486][ C2] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 38.189607][ C2] INITIAL USE at: [ 38.189665][ C2] __lock_acquire+0x378/0xc10 [ 38.189764][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.189862][ C2] _raw_spin_lock+0x33/0x40 [ 38.189960][ C2] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 38.190076][ C2] __ipv6_dev_ac_inc+0x57e/0x930 [ 38.190174][ C2] addrconf_join_anycast+0x1bc/0x260 [ 38.190273][ C2] __ipv6_ifa_notify+0x75b/0xad0 [ 38.190375][ C2] addrconf_dad_completed+0x14b/0xe10 [ 38.190474][ C2] addrconf_dad_begin+0x2e1/0x540 [ 38.190572][ C2] addrconf_dad_work+0x170/0x930 [ 38.190671][ C2] process_one_work+0xdf8/0x1410 [ 38.190768][ C2] worker_thread+0x4f1/0xd60 [ 38.190867][ C2] kthread+0x367/0x460 [ 38.190964][ C2] ret_from_fork+0x474/0x6b0 [ 38.191061][ C2] ret_from_fork_asm+0x11/0x20 [ 38.191160][ C2] } [ 38.191200][ C2] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 38.191322][ C2] ... acquired at: [ 38.191386][ C2] __lock_acquire+0x508/0xc10 [ 38.191467][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.191546][ C2] _raw_spin_lock+0x33/0x40 [ 38.191623][ C2] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 38.191721][ C2] __ipv6_dev_ac_inc+0x57e/0x930 [ 38.191798][ C2] addrconf_join_anycast+0x1bc/0x260 [ 38.191876][ C2] __ipv6_ifa_notify+0x75b/0xad0 [ 38.191953][ C2] addrconf_dad_completed+0x14b/0xe10 [ 38.192032][ C2] addrconf_dad_begin+0x2e1/0x540 [ 38.192111][ C2] addrconf_dad_work+0x170/0x930 [ 38.192190][ C2] process_one_work+0xdf8/0x1410 [ 38.192268][ C2] worker_thread+0x4f1/0xd60 [ 38.192350][ C2] kthread+0x367/0x460 [ 38.192410][ C2] ret_from_fork+0x474/0x6b0 [ 38.192488][ C2] ret_from_fork_asm+0x11/0x20 [ 38.192567][ C2] [ 38.192608][ C2] -> (&ndev->lock){++-.}-{3:3} { [ 38.192690][ C2] HARDIRQ-ON-W at: [ 38.192751][ C2] __lock_acquire+0x378/0xc10 [ 38.192850][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.192949][ C2] _raw_write_lock_bh+0x38/0x50 [ 38.193048][ C2] addrconf_permanent_addr+0x108/0x9c0 [ 38.193147][ C2] addrconf_notify+0x151/0xf30 [ 38.193245][ C2] notifier_call_chain+0xb0/0x320 [ 38.193348][ C2] __dev_notify_flags+0xde/0x280 [ 38.193448][ C2] netif_change_flags+0xfe/0x190 [ 38.193548][ C2] do_setlink.isra.0+0x1cc3/0x2750 [ 38.193648][ C2] rtnl_newlink+0x8d1/0xef0 [ 38.193746][ C2] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 38.193846][ C2] netlink_rcv_skb+0x14e/0x3a0 [ 38.193944][ C2] netlink_unicast+0x486/0x750 [ 38.194043][ C2] netlink_sendmsg+0x735/0xc60 [ 38.194142][ C2] ____sys_sendmsg+0x419/0x850 [ 38.194241][ C2] ___sys_sendmsg+0x14e/0x1d0 [ 38.194341][ C2] __sys_sendmsg+0x145/0x1f0 [ 38.194442][ C2] do_syscall_64+0x117/0x590 [ 38.194540][ C2] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 38.194655][ C2] HARDIRQ-ON-R at: [ 38.194714][ C2] __lock_acquire+0x378/0xc10 [ 38.194810][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.194909][ C2] _raw_read_lock_bh+0x44/0x80 [ 38.195011][ C2] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 38.195128][ C2] inet6_fill_link_af+0x5c/0xe0 [ 38.195225][ C2] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 38.195351][ C2] rtnl_getlink+0x9c9/0xeb0 [ 38.195449][ C2] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 38.195549][ C2] netlink_rcv_skb+0x14e/0x3a0 [ 38.195648][ C2] netlink_unicast+0x486/0x750 [ 38.195747][ C2] netlink_sendmsg+0x735/0xc60 [ 38.195845][ C2] ____sys_sendmsg+0x419/0x850 [ 38.195944][ C2] ___sys_sendmsg+0x14e/0x1d0 [ 38.196043][ C2] __sys_sendmsg+0x145/0x1f0 [ 38.196143][ C2] do_syscall_64+0x117/0x590 [ 38.196243][ C2] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 38.196366][ C2] IN-SOFTIRQ-W at: [ 38.196426][ C2] __lock_acquire+0x378/0xc10 [ 38.196525][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.196624][ C2] _raw_write_lock+0x33/0x40 [ 38.196724][ C2] addrconf_rs_timer+0xb0/0x770 [ 38.196822][ C2] call_timer_fn+0x163/0x4f0 [ 38.196920][ C2] __run_timers+0x68f/0xab0 [ 38.197018][ C2] run_timer_softirq+0xf0/0x160 [ 38.197117][ C2] handle_softirqs+0x1d8/0x940 [ 38.197218][ C2] __irq_exit_rcu+0x103/0x1c0 [ 38.197316][ C2] irq_exit_rcu+0xe/0x30 [ 38.197419][ C2] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 38.197538][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.197658][ C2] pv_native_safe_halt+0xf/0x10 [ 38.197757][ C2] default_idle+0x9/0x10 [ 38.197855][ C2] default_idle_call+0x6e/0xb0 [ 38.197954][ C2] cpuidle_idle_call.constprop.0+0x237/0x410 [ 38.198073][ C2] do_idle+0xf5/0x160 [ 38.198151][ C2] cpu_startup_entry+0x53/0x70 [ 38.198249][ C2] start_secondary+0x204/0x2b0 [ 38.198352][ C2] common_startup_64+0x13e/0x148 [ 38.198454][ C2] INITIAL USE at: [ 38.198513][ C2] __lock_acquire+0x378/0xc10 [ 38.198612][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.198711][ C2] _raw_write_lock_bh+0x38/0x50 [ 38.198809][ C2] addrconf_permanent_addr+0x108/0x9c0 [ 38.198907][ C2] addrconf_notify+0x151/0xf30 [ 38.199010][ C2] notifier_call_chain+0xb0/0x320 [ 38.199109][ C2] __dev_notify_flags+0xde/0x280 [ 38.199207][ C2] netif_change_flags+0xfe/0x190 [ 38.199305][ C2] do_setlink.isra.0+0x1cc3/0x2750 [ 38.199409][ C2] rtnl_newlink+0x8d1/0xef0 [ 38.199506][ C2] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 38.199607][ C2] netlink_rcv_skb+0x14e/0x3a0 [ 38.199706][ C2] netlink_unicast+0x486/0x750 [ 38.199804][ C2] netlink_sendmsg+0x735/0xc60 [ 38.199902][ C2] ____sys_sendmsg+0x419/0x850 [ 38.199999][ C2] ___sys_sendmsg+0x14e/0x1d0 [ 38.200097][ C2] __sys_sendmsg+0x145/0x1f0 [ 38.200199][ C2] do_syscall_64+0x117/0x590 [ 38.200296][ C2] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 38.200417][ C2] INITIAL READ USE at: [ 38.200476][ C2] __lock_acquire+0x378/0xc10 [ 38.200572][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.200674][ C2] _raw_read_lock_bh+0x44/0x80 [ 38.200772][ C2] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 38.200889][ C2] inet6_fill_link_af+0x5c/0xe0 [ 38.200987][ C2] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 38.201103][ C2] rtnl_getlink+0x9c9/0xeb0 [ 38.201204][ C2] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 38.201305][ C2] netlink_rcv_skb+0x14e/0x3a0 [ 38.201407][ C2] netlink_unicast+0x486/0x750 [ 38.201506][ C2] netlink_sendmsg+0x735/0xc60 [ 38.201605][ C2] ____sys_sendmsg+0x419/0x850 [ 38.201710][ C2] ___sys_sendmsg+0x14e/0x1d0 [ 38.201809][ C2] __sys_sendmsg+0x145/0x1f0 [ 38.201909][ C2] do_syscall_64+0x117/0x590 [ 38.202008][ C2] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 38.202125][ C2] } [ 38.202165][ C2] ... key at: [] __key.37+0x0/0x40 [ 38.202288][ C2] ... acquired at: [ 38.202351][ C2] mark_lock+0x1d7/0xa00 [ 38.202429][ C2] mark_usage+0x42/0x170 [ 38.202507][ C2] __lock_acquire+0x378/0xc10 [ 38.202585][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.202662][ C2] _raw_write_lock+0x33/0x40 [ 38.202739][ C2] addrconf_rs_timer+0xb0/0x770 [ 38.202822][ C2] call_timer_fn+0x163/0x4f0 [ 38.202900][ C2] __run_timers+0x68f/0xab0 [ 38.202980][ C2] run_timer_softirq+0xf0/0x160 [ 38.203058][ C2] handle_softirqs+0x1d8/0x940 [ 38.203135][ C2] __irq_exit_rcu+0x103/0x1c0 [ 38.203214][ C2] irq_exit_rcu+0xe/0x30 [ 38.203293][ C2] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 38.203396][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.203498][ C2] pv_native_safe_halt+0xf/0x10 [ 38.203579][ C2] default_idle+0x9/0x10 [ 38.203659][ C2] default_idle_call+0x6e/0xb0 [ 38.203738][ C2] cpuidle_idle_call.constprop.0+0x237/0x410 [ 38.203837][ C2] do_idle+0xf5/0x160 [ 38.203895][ C2] cpu_startup_entry+0x53/0x70 [ 38.203974][ C2] start_secondary+0x204/0x2b0 [ 38.204052][ C2] common_startup_64+0x13e/0x148 [ 38.204135][ C2] [ 38.204174][ C2] [ 38.204174][ C2] stack backtrace: [ 38.204276][ C2] CPU: 2 UID: 0 PID: 0 Comm: swapper/2 Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 38.204279][ C2] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 38.204281][ C2] Call Trace: [ 38.204283][ C2] [ 38.204285][ C2] dump_stack_lvl+0x6f/0xa0 [ 38.204290][ C2] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 38.204293][ C2] mark_lock_irq+0x989/0x9c0 [ 38.204296][ C2] mark_lock+0x1d7/0xa00 [ 38.204297][ C2] mark_usage+0x42/0x170 [ 38.204299][ C2] __lock_acquire+0x378/0xc10 [ 38.204300][ C2] ? add_chain_cache+0x12d/0x570 [ 38.204302][ C2] lock_acquire.part.0+0xbc/0x260 [ 38.204303][ C2] ? addrconf_rs_timer+0xb0/0x770 [ 38.204306][ C2] ? rcu_is_watching+0x15/0xd0 [ 38.204308][ C2] ? lock_acquire+0x134/0x160 [ 38.204310][ C2] ? ipv6_get_lladdr+0x3f0/0x3f0 [ 38.204312][ C2] _raw_write_lock+0x33/0x40 [ 38.204313][ C2] ? addrconf_rs_timer+0xb0/0x770 [ 38.204315][ C2] addrconf_rs_timer+0xb0/0x770 [ 38.204317][ C2] ? lock_acquire.part.0+0xbc/0x260 [ 38.204319][ C2] ? ipv6_get_lladdr+0x3f0/0x3f0 [ 38.204321][ C2] ? lock_acquire+0x134/0x160 [ 38.204322][ C2] ? ipv6_get_lladdr+0x3f0/0x3f0 [ 38.204324][ C2] call_timer_fn+0x163/0x4f0 [ 38.204326][ C2] ? detach_if_pending+0x1d0/0x1d0 [ 38.204327][ C2] ? debug_object_active_state+0x430/0x430 [ 38.204331][ C2] ? find_held_lock+0x2b/0x80 [ 38.204333][ C2] ? __lock_release.isra.0+0x6b/0x1a0 [ 38.204338][ C2] ? rcu_is_watching+0x15/0xd0 [ 38.204340][ C2] __run_timers+0x68f/0xab0 [ 38.204342][ C2] ? ipv6_get_lladdr+0x3f0/0x3f0 [ 38.204344][ C2] ? __bpf_trace_itimer_expire+0x10/0x10 [ 38.204346][ C2] ? __lock_acquire+0x508/0xc10 [ 38.204349][ C2] ? __rwlock_init+0x150/0x150 [ 38.204351][ C2] run_timer_softirq+0xf0/0x160 [ 38.204352][ C2] ? __run_timers+0xab0/0xab0 [ 38.204354][ C2] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 38.204357][ C2] ? rcu_is_watching+0x15/0xd0 [ 38.204359][ C2] handle_softirqs+0x1d8/0x940 [ 38.204360][ C2] ? find_held_lock+0x2b/0x80 [ 38.204362][ C2] ? __lock_release.isra.0+0x6b/0x1a0 [ 38.204364][ C2] ? _local_bh_enable+0xd0/0xd0 [ 38.204366][ C2] __irq_exit_rcu+0x103/0x1c0 [ 38.204367][ C2] irq_exit_rcu+0xe/0x30 [ 38.204369][ C2] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 38.204370][ C2] [ 38.204371][ C2] [ 38.204372][ C2] ? rcu_is_watching+0x15/0xd0 [ 38.204373][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 38.204375][ C2] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 38.204378][ C2] Code: 48 8b 3d 44 93 00 02 e8 1f 00 00 00 48 2b 05 c8 31 a3 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 43 b4 22 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 38.204379][ C2] RSP: 0018:ffa0000000157de8 EFLAGS: 00000296 [ 38.204382][ C2] RAX: 000000000010b81f RBX: ff11000001bb4640 RCX: ffffffff9a2d9667 [ 38.204383][ C2] RDX: ff11000001bb4640 RSI: ffffffff9d002230 RDI: ffffffff9ca6f6c0 [ 38.204384][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 38.204385][ C2] R10: 0000000000000002 R11: 0000000000000001 R12: 1ff400000002afc0 [ 38.204385][ C2] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000000000 [ 38.204387][ C2] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 38.204389][ C2] ? lockdep_hardirqs_on+0x8c/0x130 [ 38.204390][ C2] default_idle+0x9/0x10 [ 38.204392][ C2] default_idle_call+0x6e/0xb0 [ 38.204394][ C2] cpuidle_idle_call.constprop.0+0x237/0x410 [ 38.204395][ C2] ? arch_cpu_idle_exit+0x40/0x40 [ 38.204397][ C2] ? mark_tsc_async_resets+0x30/0x30 [ 38.204398][ C2] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 38.204400][ C2] ? rcu_is_watching+0x15/0xd0 [ 38.204402][ C2] do_idle+0xf5/0x160 [ 38.204403][ C2] cpu_startup_entry+0x53/0x70 [ 38.204405][ C2] start_secondary+0x204/0x2b0 [ 38.204406][ C2] ? set_cpu_sibling_map+0x1fb0/0x1fb0 [ 38.204408][ C2] common_startup_64+0x13e/0x148 [ 38.204411][ C2] [ 38.817853][ T528] GACT probability NOT on [ 42.160083][ T828] br1: port 2(veth2) entered disabled state [ 42.160409][ T828] br1: port 1(veth1) entered disabled state [ 42.196040][ T830] veth2: left allmulticast mode [ 42.196200][ T830] veth2: left promiscuous mode [ 42.196407][ T830] br1: port 2(veth2) entered disabled state [ 42.234234][ T832] veth1: left allmulticast mode [ 42.234398][ T832] veth1: left promiscuous mode [ 42.234597][ T832] br1: port 1(veth1) entered disabled state