[ 30.133004][ T531] br1: port 1(veth1) entered blocking state [ 30.133397][ T531] br1: port 1(veth1) entered disabled state [ 30.133855][ T531] veth1: entered allmulticast mode [ 30.136399][ T531] veth1: entered promiscuous mode [ 30.216530][ T534] br1: port 2(veth2) entered blocking state [ 30.216828][ T534] br1: port 2(veth2) entered disabled state [ 30.217116][ T534] veth2: entered allmulticast mode [ 30.219698][ T534] veth2: entered promiscuous mode [ 30.302968][ T537] br1: port 2(veth2) entered blocking state [ 30.303300][ T537] br1: port 2(veth2) entered forwarding state [ 30.303812][ T537] br1: port 1(veth1) entered blocking state [ 30.304020][ T537] br1: port 1(veth1) entered forwarding state [ 35.245567][ C2] [ 35.245707][ C2] ======================================================== [ 35.245842][ C2] WARNING: possible irq lock inversion dependency detected [ 35.245969][ C2] 7.1.0-rc5-virtme #1 Not tainted [ 35.246061][ C2] -------------------------------------------------------- [ 35.246185][ C2] swapper/2/0 just changed the state of lock: [ 35.246292][ C2] ff1100000bdebd78 (&ndev->lock){++-.}-{3:3}, at: addrconf_rs_timer+0xb0/0x770 [ 35.246444][ C2] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 35.246569][ C2] (acaddr_hash_lock){+.+.}-{3:3} [ 35.246572][ C2] [ 35.246572][ C2] [ 35.246572][ C2] and interrupts could create inverse lock ordering between them. [ 35.246572][ C2] [ 35.246868][ C2] [ 35.246868][ C2] other info that might help us debug this: [ 35.246985][ C2] Possible interrupt unsafe locking scenario: [ 35.246985][ C2] [ 35.247115][ C2] CPU0 CPU1 [ 35.247201][ C2] ---- ---- [ 35.247281][ C2] lock(acaddr_hash_lock); [ 35.247364][ C2] local_irq_disable(); [ 35.247467][ C2] lock(&ndev->lock); [ 35.247572][ C2] lock(acaddr_hash_lock); [ 35.247676][ C2] [ 35.247738][ C2] lock(&ndev->lock); [ 35.247801][ C2] [ 35.247801][ C2] *** DEADLOCK *** [ 35.247801][ C2] [ 35.247922][ C2] 1 lock held by swapper/2/0: [ 35.248002][ C2] #0: ffa0000000228c90 ((&ndev->rs_timer)){+.-.}-{0:0}, at: call_timer_fn+0x113/0x4f0 [ 35.248158][ C2] [ 35.248158][ C2] the shortest dependencies between 2nd lock and 1st lock: [ 35.248316][ C2] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 35.248399][ C2] HARDIRQ-ON-W at: [ 35.248461][ C2] __lock_acquire+0x378/0xc10 [ 35.248565][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.248664][ C2] _raw_spin_lock+0x33/0x40 [ 35.248770][ C2] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 35.248890][ C2] __ipv6_dev_ac_inc+0x57e/0x930 [ 35.248988][ C2] addrconf_join_anycast+0x1bc/0x260 [ 35.249089][ C2] __ipv6_ifa_notify+0x75b/0xad0 [ 35.249187][ C2] addrconf_dad_completed+0x14b/0xe10 [ 35.249307][ C2] addrconf_dad_begin+0x2e1/0x540 [ 35.249407][ C2] addrconf_dad_work+0x170/0x930 [ 35.249506][ C2] process_one_work+0xdf8/0x1410 [ 35.249605][ C2] worker_thread+0x4f1/0xd60 [ 35.249703][ C2] kthread+0x367/0x460 [ 35.249803][ C2] ret_from_fork+0x474/0x6b0 [ 35.249901][ C2] ret_from_fork_asm+0x11/0x20 [ 35.250004][ C2] SOFTIRQ-ON-W at: [ 35.250068][ C2] __lock_acquire+0x378/0xc10 [ 35.250166][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.250264][ C2] _raw_spin_lock+0x33/0x40 [ 35.250363][ C2] __ipv6_dev_ac_dec+0x236/0x5d0 [ 35.250466][ C2] addrconf_leave_anycast+0x1bc/0x260 [ 35.250586][ C2] __ipv6_ifa_notify+0x6b4/0xad0 [ 35.250685][ C2] addrconf_ifdown.isra.0+0xa70/0x15f0 [ 35.250806][ C2] addrconf_notify+0x339/0xf30 [ 35.250905][ C2] notifier_call_chain+0xb0/0x320 [ 35.251007][ C2] __netdev_upper_dev_link+0x3a5/0x590 [ 35.251133][ C2] netdev_master_upper_dev_link+0x86/0xb0 [ 35.251250][ C2] vrf_add_slave+0xdd/0x210 [vrf] [ 35.251353][ C2] do_set_master+0x357/0x580 [ 35.251453][ C2] do_setlink.isra.0+0xa31/0x2750 [ 35.251557][ C2] rtnl_newlink+0x8d1/0xef0 [ 35.251655][ C2] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 35.251752][ C2] netlink_rcv_skb+0x14e/0x3a0 [ 35.251851][ C2] netlink_unicast+0x486/0x750 [ 35.251951][ C2] netlink_sendmsg+0x735/0xc60 [ 35.252050][ C2] ____sys_sendmsg+0x419/0x850 [ 35.252159][ C2] ___sys_sendmsg+0x14e/0x1d0 [ 35.252259][ C2] __sys_sendmsg+0x145/0x1f0 [ 35.252360][ C2] do_syscall_64+0x117/0x590 [ 35.252460][ C2] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 35.252580][ C2] INITIAL USE at: [ 35.252643][ C2] __lock_acquire+0x378/0xc10 [ 35.252741][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.252840][ C2] _raw_spin_lock+0x33/0x40 [ 35.252938][ C2] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 35.253059][ C2] __ipv6_dev_ac_inc+0x57e/0x930 [ 35.253157][ C2] addrconf_join_anycast+0x1bc/0x260 [ 35.253259][ C2] __ipv6_ifa_notify+0x75b/0xad0 [ 35.253358][ C2] addrconf_dad_completed+0x14b/0xe10 [ 35.253457][ C2] addrconf_dad_begin+0x2e1/0x540 [ 35.253555][ C2] addrconf_dad_work+0x170/0x930 [ 35.253655][ C2] process_one_work+0xdf8/0x1410 [ 35.253754][ C2] worker_thread+0x4f1/0xd60 [ 35.253852][ C2] kthread+0x367/0x460 [ 35.253949][ C2] ret_from_fork+0x474/0x6b0 [ 35.254047][ C2] ret_from_fork_asm+0x11/0x20 [ 35.254151][ C2] } [ 35.254193][ C2] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 35.254318][ C2] ... acquired at: [ 35.254379][ C2] __lock_acquire+0x508/0xc10 [ 35.254458][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.254537][ C2] _raw_spin_lock+0x33/0x40 [ 35.254618][ C2] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 35.254719][ C2] __ipv6_dev_ac_inc+0x57e/0x930 [ 35.254801][ C2] addrconf_join_anycast+0x1bc/0x260 [ 35.254882][ C2] __ipv6_ifa_notify+0x75b/0xad0 [ 35.254960][ C2] addrconf_dad_completed+0x14b/0xe10 [ 35.255038][ C2] addrconf_dad_begin+0x2e1/0x540 [ 35.255122][ C2] addrconf_dad_work+0x170/0x930 [ 35.255201][ C2] process_one_work+0xdf8/0x1410 [ 35.255279][ C2] worker_thread+0x4f1/0xd60 [ 35.255363][ C2] kthread+0x367/0x460 [ 35.255425][ C2] ret_from_fork+0x474/0x6b0 [ 35.255509][ C2] ret_from_fork_asm+0x11/0x20 [ 35.255589][ C2] [ 35.255630][ C2] -> (&ndev->lock){++-.}-{3:3} { [ 35.255711][ C2] HARDIRQ-ON-W at: [ 35.255774][ C2] __lock_acquire+0x378/0xc10 [ 35.255876][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.255981][ C2] _raw_write_lock_bh+0x38/0x50 [ 35.256089][ C2] addrconf_permanent_addr+0x108/0x9c0 [ 35.256189][ C2] addrconf_notify+0x151/0xf30 [ 35.256287][ C2] notifier_call_chain+0xb0/0x320 [ 35.256385][ C2] __dev_notify_flags+0xde/0x280 [ 35.256486][ C2] netif_change_flags+0xfe/0x190 [ 35.256584][ C2] do_setlink.isra.0+0x1cc3/0x2750 [ 35.256683][ C2] rtnl_newlink+0x8d1/0xef0 [ 35.256784][ C2] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 35.256883][ C2] netlink_rcv_skb+0x14e/0x3a0 [ 35.256985][ C2] netlink_unicast+0x486/0x750 [ 35.257091][ C2] netlink_sendmsg+0x735/0xc60 [ 35.257189][ C2] ____sys_sendmsg+0x419/0x850 [ 35.257289][ C2] ___sys_sendmsg+0x14e/0x1d0 [ 35.257389][ C2] __sys_sendmsg+0x145/0x1f0 [ 35.257487][ C2] do_syscall_64+0x117/0x590 [ 35.257586][ C2] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 35.257708][ C2] HARDIRQ-ON-R at: [ 35.257769][ C2] __lock_acquire+0x378/0xc10 [ 35.257866][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.257965][ C2] _raw_read_lock_bh+0x44/0x80 [ 35.258067][ C2] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 35.258192][ C2] inet6_fill_link_af+0x5c/0xe0 [ 35.258291][ C2] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 35.258409][ C2] rtnl_getlink+0x9c9/0xeb0 [ 35.258506][ C2] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 35.258605][ C2] netlink_rcv_skb+0x14e/0x3a0 [ 35.258704][ C2] netlink_unicast+0x486/0x750 [ 35.258807][ C2] netlink_sendmsg+0x735/0xc60 [ 35.258907][ C2] ____sys_sendmsg+0x419/0x850 [ 35.259005][ C2] ___sys_sendmsg+0x14e/0x1d0 [ 35.259109][ C2] __sys_sendmsg+0x145/0x1f0 [ 35.259210][ C2] do_syscall_64+0x117/0x590 [ 35.259308][ C2] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 35.259426][ C2] IN-SOFTIRQ-W at: [ 35.259486][ C2] __lock_acquire+0x378/0xc10 [ 35.259586][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.259685][ C2] _raw_write_lock+0x33/0x40 [ 35.259787][ C2] addrconf_rs_timer+0xb0/0x770 [ 35.259887][ C2] call_timer_fn+0x163/0x4f0 [ 35.259990][ C2] __run_timers+0x68f/0xab0 [ 35.260092][ C2] run_timer_softirq+0xf0/0x160 [ 35.260190][ C2] handle_softirqs+0x1d8/0x940 [ 35.260289][ C2] __irq_exit_rcu+0x103/0x1c0 [ 35.260387][ C2] irq_exit_rcu+0xe/0x30 [ 35.260486][ C2] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 35.260608][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 35.260727][ C2] pv_native_safe_halt+0xf/0x10 [ 35.260827][ C2] default_idle+0x9/0x10 [ 35.260926][ C2] default_idle_call+0x6e/0xb0 [ 35.261024][ C2] cpuidle_idle_call.constprop.0+0x237/0x410 [ 35.261152][ C2] do_idle+0xf5/0x160 [ 35.261230][ C2] cpu_startup_entry+0x53/0x70 [ 35.261329][ C2] start_secondary+0x204/0x2b0 [ 35.261429][ C2] common_startup_64+0x13e/0x148 [ 35.261529][ C2] INITIAL USE at: [ 35.261589][ C2] __lock_acquire+0x378/0xc10 [ 35.261688][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.261791][ C2] _raw_write_lock_bh+0x38/0x50 [ 35.261891][ C2] addrconf_permanent_addr+0x108/0x9c0 [ 35.261989][ C2] addrconf_notify+0x151/0xf30 [ 35.262093][ C2] notifier_call_chain+0xb0/0x320 [ 35.262191][ C2] __dev_notify_flags+0xde/0x280 [ 35.262290][ C2] netif_change_flags+0xfe/0x190 [ 35.262389][ C2] do_setlink.isra.0+0x1cc3/0x2750 [ 35.262487][ C2] rtnl_newlink+0x8d1/0xef0 [ 35.262585][ C2] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 35.262684][ C2] netlink_rcv_skb+0x14e/0x3a0 [ 35.262785][ C2] netlink_unicast+0x486/0x750 [ 35.262882][ C2] netlink_sendmsg+0x735/0xc60 [ 35.262979][ C2] ____sys_sendmsg+0x419/0x850 [ 35.263081][ C2] ___sys_sendmsg+0x14e/0x1d0 [ 35.263179][ C2] __sys_sendmsg+0x145/0x1f0 [ 35.263322][ C2] do_syscall_64+0x117/0x590 [ 35.263421][ C2] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 35.263541][ C2] INITIAL READ USE at: [ 35.263602][ C2] __lock_acquire+0x378/0xc10 [ 35.263746][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.263847][ C2] _raw_read_lock_bh+0x44/0x80 [ 35.263944][ C2] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 35.264113][ C2] inet6_fill_link_af+0x5c/0xe0 [ 35.264212][ C2] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 35.264331][ C2] rtnl_getlink+0x9c9/0xeb0 [ 35.264472][ C2] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 35.264569][ C2] netlink_rcv_skb+0x14e/0x3a0 [ 35.264669][ C2] netlink_unicast+0x486/0x750 [ 35.264812][ C2] netlink_sendmsg+0x735/0xc60 [ 35.264911][ C2] ____sys_sendmsg+0x419/0x850 [ 35.265008][ C2] ___sys_sendmsg+0x14e/0x1d0 [ 35.265153][ C2] __sys_sendmsg+0x145/0x1f0 [ 35.265255][ C2] do_syscall_64+0x117/0x590 [ 35.265353][ C2] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 35.265514][ C2] } [ 35.265553][ C2] ... key at: [] __key.37+0x0/0x40 [ 35.265671][ C2] ... acquired at: [ 35.265731][ C2] mark_lock+0x1d7/0xa00 [ 35.265853][ C2] mark_usage+0x42/0x170 [ 35.265929][ C2] __lock_acquire+0x378/0xc10 [ 35.266006][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.266088][ C2] _raw_write_lock+0x33/0x40 [ 35.266207][ C2] addrconf_rs_timer+0xb0/0x770 [ 35.266286][ C2] call_timer_fn+0x163/0x4f0 [ 35.266365][ C2] __run_timers+0x68f/0xab0 [ 35.266443][ C2] run_timer_softirq+0xf0/0x160 [ 35.266522][ C2] handle_softirqs+0x1d8/0x940 [ 35.266599][ C2] __irq_exit_rcu+0x103/0x1c0 [ 35.266678][ C2] irq_exit_rcu+0xe/0x30 [ 35.266754][ C2] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 35.266896][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 35.266993][ C2] pv_native_safe_halt+0xf/0x10 [ 35.267075][ C2] default_idle+0x9/0x10 [ 35.267153][ C2] default_idle_call+0x6e/0xb0 [ 35.267276][ C2] cpuidle_idle_call.constprop.0+0x237/0x410 [ 35.267372][ C2] do_idle+0xf5/0x160 [ 35.267432][ C2] cpu_startup_entry+0x53/0x70 [ 35.267510][ C2] start_secondary+0x204/0x2b0 [ 35.267631][ C2] common_startup_64+0x13e/0x148 [ 35.267710][ C2] [ 35.267749][ C2] [ 35.267749][ C2] stack backtrace: [ 35.267850][ C2] CPU: 2 UID: 0 PID: 0 Comm: swapper/2 Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 35.267853][ C2] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 35.267855][ C2] Call Trace: [ 35.267857][ C2] [ 35.267859][ C2] dump_stack_lvl+0x6f/0xa0 [ 35.267863][ C2] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 35.267866][ C2] mark_lock_irq+0x989/0x9c0 [ 35.267869][ C2] mark_lock+0x1d7/0xa00 [ 35.267871][ C2] mark_usage+0x42/0x170 [ 35.267872][ C2] __lock_acquire+0x378/0xc10 [ 35.267873][ C2] ? add_chain_cache+0x12d/0x570 [ 35.267875][ C2] lock_acquire.part.0+0xbc/0x260 [ 35.267877][ C2] ? addrconf_rs_timer+0xb0/0x770 [ 35.267879][ C2] ? rcu_is_watching+0x15/0xd0 [ 35.267882][ C2] ? lock_acquire+0x134/0x160 [ 35.267883][ C2] ? ipv6_get_lladdr+0x3f0/0x3f0 [ 35.267885][ C2] _raw_write_lock+0x33/0x40 [ 35.267886][ C2] ? addrconf_rs_timer+0xb0/0x770 [ 35.267888][ C2] addrconf_rs_timer+0xb0/0x770 [ 35.267890][ C2] ? lock_acquire.part.0+0xbc/0x260 [ 35.267891][ C2] ? ipv6_get_lladdr+0x3f0/0x3f0 [ 35.267893][ C2] ? lock_acquire+0x134/0x160 [ 35.267895][ C2] ? ipv6_get_lladdr+0x3f0/0x3f0 [ 35.267897][ C2] call_timer_fn+0x163/0x4f0 [ 35.267898][ C2] ? detach_if_pending+0x1d0/0x1d0 [ 35.267900][ C2] ? debug_object_active_state+0x430/0x430 [ 35.267903][ C2] ? find_held_lock+0x2b/0x80 [ 35.267906][ C2] ? __lock_release.isra.0+0x6b/0x1a0 [ 35.267908][ C2] ? rcu_is_watching+0x15/0xd0 [ 35.267910][ C2] __run_timers+0x68f/0xab0 [ 35.267911][ C2] ? ipv6_get_lladdr+0x3f0/0x3f0 [ 35.267913][ C2] ? __bpf_trace_itimer_expire+0x10/0x10 [ 35.267915][ C2] ? __lock_acquire+0x508/0xc10 [ 35.267917][ C2] ? __rwlock_init+0x150/0x150 [ 35.267920][ C2] run_timer_softirq+0xf0/0x160 [ 35.267921][ C2] ? __run_timers+0xab0/0xab0 [ 35.267923][ C2] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 35.267926][ C2] ? rcu_is_watching+0x15/0xd0 [ 35.267928][ C2] handle_softirqs+0x1d8/0x940 [ 35.267929][ C2] ? find_held_lock+0x2b/0x80 [ 35.267931][ C2] ? __lock_release.isra.0+0x6b/0x1a0 [ 35.267932][ C2] ? _local_bh_enable+0xd0/0xd0 [ 35.267934][ C2] __irq_exit_rcu+0x103/0x1c0 [ 35.267936][ C2] irq_exit_rcu+0xe/0x30 [ 35.267937][ C2] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 35.267939][ C2] [ 35.267939][ C2] [ 35.267940][ C2] ? rcu_is_watching+0x15/0xd0 [ 35.267941][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 35.267943][ C2] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 35.267946][ C2] Code: 48 8b 3d 44 93 00 02 e8 1f 00 00 00 48 2b 05 c8 31 a3 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 43 b4 22 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 35.267947][ C2] RSP: 0018:ffa0000000157de8 EFLAGS: 00000296 [ 35.267949][ C2] RAX: 000000000011cd33 RBX: ff11000001bb4640 RCX: ffffffff960d9667 [ 35.267951][ C2] RDX: ff11000001bb4640 RSI: ffffffff98e02230 RDI: ffffffff9886f6c0 [ 35.267952][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 35.267952][ C2] R10: 0000000000000002 R11: 0000000000000001 R12: 1ff400000002afc0 [ 35.267953][ C2] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000000000 [ 35.267955][ C2] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 35.267957][ C2] ? lockdep_hardirqs_on+0x8c/0x130 [ 35.267958][ C2] default_idle+0x9/0x10 [ 35.267960][ C2] default_idle_call+0x6e/0xb0 [ 35.267962][ C2] cpuidle_idle_call.constprop.0+0x237/0x410 [ 35.267963][ C2] ? arch_cpu_idle_exit+0x40/0x40 [ 35.267965][ C2] ? mark_tsc_async_resets+0x30/0x30 [ 35.267966][ C2] ? rcu_is_watching+0x15/0xd0 [ 35.267968][ C2] do_idle+0xf5/0x160 [ 35.267970][ C2] cpu_startup_entry+0x53/0x70 [ 35.267971][ C2] start_secondary+0x204/0x2b0 [ 35.267972][ C2] ? set_cpu_sibling_map+0x1fb0/0x1fb0 [ 35.267974][ C2] common_startup_64+0x13e/0x148 [ 35.267977][ C2] [ 35.760076][ T570] GACT probability NOT on [ 38.620914][ T869] br1: port 2(veth2) entered disabled state [ 38.621260][ T869] br1: port 1(veth1) entered disabled state [ 38.658388][ T871] veth2: left allmulticast mode [ 38.658576][ T871] veth2: left promiscuous mode [ 38.658784][ T871] br1: port 2(veth2) entered disabled state [ 38.691114][ T873] veth1: left allmulticast mode [ 38.691253][ T873] veth1: left promiscuous mode [ 38.691407][ T873] br1: port 1(veth1) entered disabled state