[ 33.018002][ T713] 8021q: 802.1Q VLAN Support v1.8 [ 33.590403][ T739] br1: port 1(veth1) entered blocking state [ 33.590611][ T739] br1: port 1(veth1) entered disabled state [ 33.590806][ T739] veth1: entered allmulticast mode [ 33.592245][ T739] veth1: entered promiscuous mode [ 33.619836][ T188] br1: port 1(veth1) entered blocking state [ 33.620023][ T188] br1: port 1(veth1) entered forwarding state [ 47.893493][ T873] [ 47.893585][ T873] ======================================================== [ 47.893718][ T873] WARNING: possible irq lock inversion dependency detected [ 47.893842][ T873] 7.1.0-rc5-virtme #1 Not tainted [ 47.893929][ T873] -------------------------------------------------------- [ 47.894052][ T873] sysctl/873 just changed the state of lock: [ 47.894160][ T873] ffffffff8cb7e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 47.894315][ T873] but this lock was taken by another, SOFTIRQ-safe lock in the past: [ 47.894438][ T873] (&ndev->lock){++--}-{3:3} [ 47.894441][ T873] [ 47.894441][ T873] [ 47.894441][ T873] and interrupts could create inverse lock ordering between them. [ 47.894441][ T873] [ 47.894752][ T873] [ 47.894752][ T873] other info that might help us debug this: [ 47.894873][ T873] Possible interrupt unsafe locking scenario: [ 47.894873][ T873] [ 47.894995][ T873] CPU0 CPU1 [ 47.895079][ T873] ---- ---- [ 47.895164][ T873] lock(acaddr_hash_lock); [ 47.895251][ T873] local_irq_disable(); [ 47.895354][ T873] lock(&ndev->lock); [ 47.895460][ T873] lock(acaddr_hash_lock); [ 47.895573][ T873] [ 47.895635][ T873] lock(&ndev->lock); [ 47.895700][ T873] [ 47.895700][ T873] *** DEADLOCK *** [ 47.895700][ T873] [ 47.895823][ T873] 2 locks held by sysctl/873: [ 47.895906][ T873] #0: ff11000009b343e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 47.896058][ T873] #1: ffffffff8ca8c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 47.896226][ T873] [ 47.896226][ T873] the shortest dependencies between 2nd lock and 1st lock: [ 47.896370][ T873] -> (&ndev->lock){++--}-{3:3} { [ 47.896457][ T873] HARDIRQ-ON-W at: [ 47.896521][ T873] __lock_acquire+0x378/0xc10 [ 47.896635][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.896741][ T873] _raw_write_lock_bh+0x38/0x50 [ 47.896844][ T873] addrconf_permanent_addr+0x108/0x9c0 [ 47.896967][ T873] addrconf_notify+0x151/0xf30 [ 47.897069][ T873] notifier_call_chain+0xb0/0x320 [ 47.897173][ T873] __dev_notify_flags+0xde/0x280 [ 47.897278][ T873] netif_change_flags+0xfe/0x190 [ 47.897378][ T873] do_setlink.isra.0+0x1cc3/0x2750 [ 47.897483][ T873] rtnl_newlink+0x8d1/0xef0 [ 47.897591][ T873] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 47.897739][ T873] netlink_rcv_skb+0x14e/0x3a0 [ 47.897849][ T873] netlink_unicast+0x486/0x750 [ 47.897950][ T873] netlink_sendmsg+0x735/0xc60 [ 47.898093][ T873] ____sys_sendmsg+0x419/0x850 [ 47.898195][ T873] ___sys_sendmsg+0x14e/0x1d0 [ 47.898298][ T873] __sys_sendmsg+0x145/0x1f0 [ 47.898445][ T873] do_syscall_64+0x117/0x590 [ 47.898553][ T873] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 47.898676][ T873] HARDIRQ-ON-R at: [ 47.898739][ T873] __lock_acquire+0x378/0xc10 [ 47.898904][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.899006][ T873] _raw_read_lock_bh+0x44/0x80 [ 47.899111][ T873] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 47.899281][ T873] inet6_fill_link_af+0x5c/0xe0 [ 47.899384][ T873] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 47.899510][ T873] rtnl_getlink+0x9c9/0xeb0 [ 47.899659][ T873] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 47.899763][ T873] netlink_rcv_skb+0x14e/0x3a0 [ 47.899864][ T873] netlink_unicast+0x486/0x750 [ 47.900012][ T873] netlink_sendmsg+0x735/0xc60 [ 47.900113][ T873] ____sys_sendmsg+0x419/0x850 [ 47.900215][ T873] ___sys_sendmsg+0x14e/0x1d0 [ 47.900364][ T873] __sys_sendmsg+0x145/0x1f0 [ 47.900466][ T873] do_syscall_64+0x117/0x590 [ 47.900573][ T873] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 47.900745][ T873] IN-SOFTIRQ-W at: [ 47.900809][ T873] __lock_acquire+0x378/0xc10 [ 47.900912][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.901016][ T873] _raw_write_lock+0x33/0x40 [ 47.901163][ T873] addrconf_rs_timer+0xb0/0x770 [ 47.901266][ T873] call_timer_fn+0x163/0x4f0 [ 47.901369][ T873] __run_timers+0x68f/0xab0 [ 47.901515][ T873] run_timer_softirq+0xf0/0x160 [ 47.901622][ T873] handle_softirqs+0x1d8/0x940 [ 47.901725][ T873] __irq_exit_rcu+0x103/0x1c0 [ 47.901868][ T873] irq_exit_rcu+0xe/0x30 [ 47.901971][ T873] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 47.902095][ T873] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 47.902264][ T873] pv_native_safe_halt+0xf/0x10 [ 47.902366][ T873] default_idle+0x9/0x10 [ 47.902471][ T873] default_idle_call+0x6e/0xb0 [ 47.902622][ T873] cpuidle_idle_call.constprop.0+0x237/0x410 [ 47.902744][ T873] do_idle+0xf5/0x160 [ 47.902847][ T873] cpu_startup_entry+0x53/0x70 [ 47.902994][ T873] rest_init+0x1f7/0x200 [ 47.903096][ T873] start_kernel+0x3ad/0x3b0 [ 47.903228][ T873] x86_64_start_reservations+0x24/0x30 [ 47.903470][ T873] x86_64_start_kernel+0x12b/0x130 [ 47.903610][ T873] common_startup_64+0x13e/0x148 [ 47.903750][ T873] IN-SOFTIRQ-R at: [ 47.903832][ T873] __lock_acquire+0x378/0xc10 [ 47.904029][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.904167][ T873] _raw_read_lock_bh+0x44/0x80 [ 47.904302][ T873] ipv6_get_lladdr+0xa8/0x3f0 [ 47.904499][ T873] addrconf_rs_timer+0x251/0x770 [ 47.904648][ T873] call_timer_fn+0x163/0x4f0 [ 47.904787][ T873] __run_timers+0x68f/0xab0 [ 47.904993][ T873] run_timer_softirq+0xf0/0x160 [ 47.905124][ T873] handle_softirqs+0x1d8/0x940 [ 47.905253][ T873] __irq_exit_rcu+0x103/0x1c0 [ 47.905461][ T873] irq_exit_rcu+0xe/0x30 [ 47.905596][ T873] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 47.905763][ T873] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 47.906001][ T873] pv_native_safe_halt+0xf/0x10 [ 47.906139][ T873] default_idle+0x9/0x10 [ 47.906274][ T873] default_idle_call+0x6e/0xb0 [ 47.906467][ T873] cpuidle_idle_call.constprop.0+0x237/0x410 [ 47.906626][ T873] do_idle+0xf5/0x160 [ 47.906768][ T873] cpu_startup_entry+0x53/0x70 [ 47.906971][ T873] rest_init+0x1f7/0x200 [ 47.907100][ T873] start_kernel+0x3ad/0x3b0 [ 47.907235][ T873] x86_64_start_reservations+0x24/0x30 [ 47.907455][ T873] x86_64_start_kernel+0x12b/0x130 [ 47.907595][ T873] common_startup_64+0x13e/0x148 [ 47.907737][ T873] INITIAL USE at: [ 47.907817][ T873] __lock_acquire+0x378/0xc10 [ 47.908015][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.908149][ T873] _raw_write_lock_bh+0x38/0x50 [ 47.908283][ T873] addrconf_permanent_addr+0x108/0x9c0 [ 47.908509][ T873] addrconf_notify+0x151/0xf30 [ 47.908645][ T873] notifier_call_chain+0xb0/0x320 [ 47.908777][ T873] __dev_notify_flags+0xde/0x280 [ 47.908947][ T873] netif_change_flags+0xfe/0x190 [ 47.909048][ T873] do_setlink.isra.0+0x1cc3/0x2750 [ 47.909149][ T873] rtnl_newlink+0x8d1/0xef0 [ 47.909293][ T873] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 47.909401][ T873] netlink_rcv_skb+0x14e/0x3a0 [ 47.909505][ T873] netlink_unicast+0x486/0x750 [ 47.909657][ T873] netlink_sendmsg+0x735/0xc60 [ 47.909759][ T873] ____sys_sendmsg+0x419/0x850 [ 47.909867][ T873] ___sys_sendmsg+0x14e/0x1d0 [ 47.909969][ T873] __sys_sendmsg+0x145/0x1f0 [ 47.910115][ T873] do_syscall_64+0x117/0x590 [ 47.910217][ T873] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 47.910339][ T873] INITIAL READ USE at: [ 47.910466][ T873] __lock_acquire+0x378/0xc10 [ 47.910580][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.910702][ T873] _raw_read_lock_bh+0x44/0x80 [ 47.910847][ T873] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 47.910968][ T873] inet6_fill_link_af+0x5c/0xe0 [ 47.911069][ T873] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 47.911232][ T873] rtnl_getlink+0x9c9/0xeb0 [ 47.911333][ T873] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 47.911434][ T873] netlink_rcv_skb+0x14e/0x3a0 [ 47.911586][ T873] netlink_unicast+0x486/0x750 [ 47.911687][ T873] netlink_sendmsg+0x735/0xc60 [ 47.911788][ T873] ____sys_sendmsg+0x419/0x850 [ 47.911933][ T873] ___sys_sendmsg+0x14e/0x1d0 [ 47.912048][ T873] __sys_sendmsg+0x145/0x1f0 [ 47.912156][ T873] do_syscall_64+0x117/0x590 [ 47.912300][ T873] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 47.912420][ T873] } [ 47.912467][ T873] ... key at: [] __key.37+0x0/0x40 [ 47.912608][ T873] ... acquired at: [ 47.912710][ T873] __lock_acquire+0x508/0xc10 [ 47.912792][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.912870][ T873] _raw_spin_lock+0x33/0x40 [ 47.912949][ T873] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 47.913090][ T873] __ipv6_dev_ac_inc+0x57e/0x930 [ 47.913169][ T873] addrconf_join_anycast+0x1bc/0x260 [ 47.913251][ T873] __ipv6_ifa_notify+0x75b/0xad0 [ 47.913330][ T873] addrconf_dad_completed+0x14b/0xe10 [ 47.913452][ T873] addrconf_dad_work+0x3c1/0x930 [ 47.913538][ T873] process_one_work+0xdf8/0x1410 [ 47.913620][ T873] worker_thread+0x4f1/0xd60 [ 47.913701][ T873] kthread+0x367/0x460 [ 47.913804][ T873] ret_from_fork+0x474/0x6b0 [ 47.913886][ T873] ret_from_fork_asm+0x11/0x20 [ 47.913968][ T873] [ 47.914011][ T873] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 47.914135][ T873] HARDIRQ-ON-W at: [ 47.914198][ T873] __lock_acquire+0x378/0xc10 [ 47.914299][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.914400][ T873] _raw_spin_lock+0x33/0x40 [ 47.914552][ T873] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 47.914671][ T873] __ipv6_dev_ac_inc+0x57e/0x930 [ 47.914784][ T873] addrconf_join_anycast+0x1bc/0x260 [ 47.914928][ T873] __ipv6_ifa_notify+0x75b/0xad0 [ 47.915029][ T873] addrconf_dad_completed+0x14b/0xe10 [ 47.915131][ T873] addrconf_dad_work+0x3c1/0x930 [ 47.915275][ T873] process_one_work+0xdf8/0x1410 [ 47.915380][ T873] worker_thread+0x4f1/0xd60 [ 47.915481][ T873] kthread+0x367/0x460 [ 47.915569][ T873] ret_from_fork+0x474/0x6b0 [ 47.915713][ T873] ret_from_fork_asm+0x11/0x20 [ 47.915816][ T873] SOFTIRQ-ON-W at: [ 47.915877][ T873] __lock_acquire+0x378/0xc10 [ 47.916019][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.916124][ T873] _raw_spin_lock+0x33/0x40 [ 47.916225][ T873] __ipv6_dev_ac_dec+0x236/0x5d0 [ 47.916368][ T873] addrconf_leave_anycast+0x1bc/0x260 [ 47.916471][ T873] dev_forward_change+0x3b3/0x850 [ 47.916582][ T873] addrconf_fixup_forwarding+0x2af/0x4d0 [ 47.916745][ T873] addrconf_sysctl_forward+0x209/0x2b0 [ 47.916851][ T873] proc_sys_call_handler+0x31b/0x480 [ 47.916958][ T873] new_sync_write+0x333/0x750 [ 47.917063][ T873] vfs_write+0x6a4/0xc10 [ 47.917206][ T873] ksys_write+0x116/0x250 [ 47.917306][ T873] do_syscall_64+0x117/0x590 [ 47.917406][ T873] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 47.917597][ T873] INITIAL USE at: [ 47.917657][ T873] __lock_acquire+0x378/0xc10 [ 47.917759][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.917902][ T873] _raw_spin_lock+0x33/0x40 [ 47.918004][ T873] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 47.918124][ T873] __ipv6_dev_ac_inc+0x57e/0x930 [ 47.918268][ T873] addrconf_join_anycast+0x1bc/0x260 [ 47.918372][ T873] __ipv6_ifa_notify+0x75b/0xad0 [ 47.918479][ T873] addrconf_dad_completed+0x14b/0xe10 [ 47.918629][ T873] addrconf_dad_work+0x3c1/0x930 [ 47.918739][ T873] process_one_work+0xdf8/0x1410 [ 47.918840][ T873] worker_thread+0x4f1/0xd60 [ 47.918941][ T873] kthread+0x367/0x460 [ 47.919074][ T873] ret_from_fork+0x474/0x6b0 [ 47.919184][ T873] ret_from_fork_asm+0x11/0x20 [ 47.919290][ T873] } [ 47.919336][ T873] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 47.919506][ T873] ... acquired at: [ 47.919572][ T873] mark_lock+0x1d7/0xa00 [ 47.919655][ T873] mark_usage+0x105/0x170 [ 47.919776][ T873] __lock_acquire+0x378/0xc10 [ 47.919857][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.919937][ T873] _raw_spin_lock+0x33/0x40 [ 47.920019][ T873] __ipv6_dev_ac_dec+0x236/0x5d0 [ 47.920142][ T873] addrconf_leave_anycast+0x1bc/0x260 [ 47.920227][ T873] dev_forward_change+0x3b3/0x850 [ 47.920309][ T873] addrconf_fixup_forwarding+0x2af/0x4d0 [ 47.920410][ T873] addrconf_sysctl_forward+0x209/0x2b0 [ 47.920543][ T873] proc_sys_call_handler+0x31b/0x480 [ 47.920625][ T873] new_sync_write+0x333/0x750 [ 47.920707][ T873] vfs_write+0x6a4/0xc10 [ 47.920790][ T873] ksys_write+0x116/0x250 [ 47.920913][ T873] do_syscall_64+0x117/0x590 [ 47.920993][ T873] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 47.921093][ T873] [ 47.921133][ T873] [ 47.921133][ T873] stack backtrace: [ 47.921276][ T873] CPU: 1 UID: 0 PID: 873 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 47.921280][ T873] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 47.921283][ T873] Call Trace: [ 47.921284][ T873] [ 47.921285][ T873] dump_stack_lvl+0x6f/0xa0 [ 47.921290][ T873] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 47.921293][ T873] mark_lock_irq+0x989/0x9c0 [ 47.921296][ T873] mark_lock+0x1d7/0xa00 [ 47.921297][ T873] mark_usage+0x105/0x170 [ 47.921299][ T873] __lock_acquire+0x378/0xc10 [ 47.921301][ T873] lock_acquire.part.0+0xbc/0x260 [ 47.921302][ T873] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 47.921304][ T873] ? rcu_is_watching+0x15/0xd0 [ 47.921307][ T873] ? do_raw_read_unlock+0x70/0x70 [ 47.921309][ T873] ? lock_acquire+0x134/0x160 [ 47.921311][ T873] _raw_spin_lock+0x33/0x40 [ 47.921312][ T873] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 47.921313][ T873] __ipv6_dev_ac_dec+0x236/0x5d0 [ 47.921316][ T873] addrconf_leave_anycast+0x1bc/0x260 [ 47.921317][ T873] ? find_held_lock+0x2b/0x80 [ 47.921320][ T873] ? __ipv6_isatap_ifid+0x210/0x210 [ 47.921322][ T873] ? mark_held_locks+0x40/0x70 [ 47.921323][ T873] ? lockdep_hardirqs_on+0x8c/0x130 [ 47.921326][ T873] dev_forward_change+0x3b3/0x850 [ 47.921328][ T873] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 47.921330][ T873] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 47.921332][ T873] addrconf_fixup_forwarding+0x2af/0x4d0 [ 47.921335][ T873] addrconf_sysctl_forward+0x209/0x2b0 [ 47.921337][ T873] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 47.921339][ T873] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 47.921341][ T873] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 47.921344][ T873] ? proc_sys_call_handler+0x25d/0x480 [ 47.921347][ T873] proc_sys_call_handler+0x31b/0x480 [ 47.921349][ T873] ? proc_sys_lookup+0x3d0/0x3d0 [ 47.921351][ T873] ? do_fault_around+0x300/0x5a0 [ 47.921353][ T873] ? find_held_lock+0x2b/0x80 [ 47.921355][ T873] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 47.921357][ T873] ? rcu_read_lock_any_held+0x3c/0x90 [ 47.921359][ T873] ? proc_sys_call_handler+0x480/0x480 [ 47.921361][ T873] new_sync_write+0x333/0x750 [ 47.921363][ T873] ? __lock_acquire+0x508/0xc10 [ 47.921364][ T873] ? new_sync_read+0x740/0x740 [ 47.921366][ T873] ? lock_acquire.part.0+0xbc/0x260 [ 47.921367][ T873] ? ksys_write+0x116/0x250 [ 47.921370][ T873] vfs_write+0x6a4/0xc10 [ 47.921371][ T873] ksys_write+0x116/0x250 [ 47.921373][ T873] ? __ia32_sys_read+0xc0/0xc0 [ 47.921374][ T873] ? rcu_is_watching+0x15/0xd0 [ 47.921376][ T873] ? rcu_is_watching+0x15/0xd0 [ 47.921378][ T873] do_syscall_64+0x117/0x590 [ 47.921379][ T873] ? trace_hardirqs_off+0xd/0x30 [ 47.921382][ T873] ? exc_page_fault+0xee/0x100 [ 47.921384][ T873] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 47.921385][ T873] RIP: 0033:0x7fe13c43408e [ 47.921389][ T873] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 47.921391][ T873] RSP: 002b:00007ffebb92ef60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 47.921393][ T873] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007fe13c43408e [ 47.921395][ T873] RDX: 0000000000000002 RSI: 000055e47c5854b0 RDI: 0000000000000005 [ 47.921396][ T873] RBP: 00007ffebb92ef70 R08: 0000000000000000 R09: 0000000000000000 [ 47.921397][ T873] R10: 0000000000000000 R11: 0000000000000202 R12: 000055e47c5875e0 [ 47.921397][ T873] R13: 000055e47c585470 R14: 0000000000000002 R15: 0000000000000000 [ 47.921400][ T873] [ 48.077666][ T883] br1: port 1(veth1) entered disabled state [ 48.092707][ T884] veth1: left allmulticast mode [ 48.092859][ T884] veth1: left promiscuous mode [ 48.093060][ T884] br1: port 1(veth1) entered disabled state