[ 8.566433][ T186] ip (186) used greatest stack depth: 24480 bytes left [ 9.254899][ T213] 8021q: 802.1Q VLAN Support v1.8 [ 9.948525][ T246] br1: port 1(veth1) entered blocking state [ 9.948854][ T246] br1: port 1(veth1) entered disabled state [ 9.949090][ T246] veth1: entered allmulticast mode [ 9.950585][ T246] veth1: entered promiscuous mode [ 9.982021][ T108] br1: port 1(veth1) entered blocking state [ 9.982325][ T108] br1: port 1(veth1) entered forwarding state [ 20.774325][ T343] [ 20.774408][ T343] ======================================================== [ 20.774533][ T343] WARNING: possible irq lock inversion dependency detected [ 20.774650][ T343] 7.1.0-rc5-virtme #1 Not tainted [ 20.774730][ T343] -------------------------------------------------------- [ 20.774850][ T343] sysctl/343 just changed the state of lock: [ 20.774949][ T343] ffffffff8f37e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.775097][ T343] but this lock was taken by another, SOFTIRQ-READ-safe lock in the past: [ 20.775216][ T343] (&ndev->lock){++.-}-{3:3} [ 20.775218][ T343] [ 20.775218][ T343] [ 20.775218][ T343] and interrupts could create inverse lock ordering between them. [ 20.775218][ T343] [ 20.775513][ T343] [ 20.775513][ T343] other info that might help us debug this: [ 20.775630][ T343] Possible interrupt unsafe locking scenario: [ 20.775630][ T343] [ 20.775750][ T343] CPU0 CPU1 [ 20.775830][ T343] ---- ---- [ 20.775907][ T343] lock(acaddr_hash_lock); [ 20.775987][ T343] local_irq_disable(); [ 20.776088][ T343] lock(&ndev->lock); [ 20.776190][ T343] lock(acaddr_hash_lock); [ 20.776288][ T343] [ 20.776348][ T343] lock(&ndev->lock); [ 20.776409][ T343] [ 20.776409][ T343] *** DEADLOCK *** [ 20.776409][ T343] [ 20.776530][ T343] 2 locks held by sysctl/343: [ 20.776611][ T343] #0: ff11000009b443e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 20.776756][ T343] #1: ffffffff8f28c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 20.776920][ T343] [ 20.776920][ T343] the shortest dependencies between 2nd lock and 1st lock: [ 20.777057][ T343] -> (&ndev->lock){++.-}-{3:3} { [ 20.777142][ T343] HARDIRQ-ON-W at: [ 20.777203][ T343] __lock_acquire+0x378/0xc10 [ 20.777308][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.777408][ T343] _raw_write_lock_bh+0x38/0x50 [ 20.777515][ T343] addrconf_permanent_addr+0x108/0x9c0 [ 20.777636][ T343] addrconf_notify+0x151/0xf30 [ 20.777737][ T343] notifier_call_chain+0xb0/0x320 [ 20.777838][ T343] __dev_notify_flags+0xde/0x280 [ 20.777939][ T343] netif_change_flags+0xfe/0x190 [ 20.778039][ T343] do_setlink.isra.0+0x1cc3/0x2750 [ 20.778145][ T343] rtnl_newlink+0x8d1/0xef0 [ 20.778245][ T343] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 20.778348][ T343] netlink_rcv_skb+0x14e/0x3a0 [ 20.778455][ T343] netlink_unicast+0x486/0x750 [ 20.778555][ T343] netlink_sendmsg+0x735/0xc60 [ 20.778654][ T343] ____sys_sendmsg+0x419/0x850 [ 20.778752][ T343] ___sys_sendmsg+0x14e/0x1d0 [ 20.778850][ T343] __sys_sendmsg+0x145/0x1f0 [ 20.778948][ T343] do_syscall_64+0x117/0x590 [ 20.779049][ T343] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.779168][ T343] HARDIRQ-ON-R at: [ 20.779227][ T343] __lock_acquire+0x378/0xc10 [ 20.779326][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.779428][ T343] _raw_read_lock_bh+0x44/0x80 [ 20.779524][ T343] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 20.779643][ T343] inet6_fill_link_af+0x5c/0xe0 [ 20.779741][ T343] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 20.779858][ T343] rtnl_getlink+0x9c9/0xeb0 [ 20.779957][ T343] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 20.780056][ T343] netlink_rcv_skb+0x14e/0x3a0 [ 20.780154][ T343] netlink_unicast+0x486/0x750 [ 20.780252][ T343] netlink_sendmsg+0x735/0xc60 [ 20.780351][ T343] ____sys_sendmsg+0x419/0x850 [ 20.780453][ T343] ___sys_sendmsg+0x14e/0x1d0 [ 20.780551][ T343] __sys_sendmsg+0x145/0x1f0 [ 20.780652][ T343] do_syscall_64+0x117/0x590 [ 20.780751][ T343] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.780869][ T343] IN-SOFTIRQ-R at: [ 20.780927][ T343] __lock_acquire+0x378/0xc10 [ 20.781024][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.781123][ T343] _raw_read_lock_bh+0x44/0x80 [ 20.781222][ T343] ipv6_get_lladdr+0xa8/0x3f0 [ 20.781321][ T343] ndisc_send_ns+0xf3/0x120 [ 20.781421][ T343] ndisc_solicit+0x314/0x480 [ 20.781519][ T343] neigh_probe+0xb3/0x100 [ 20.781618][ T343] __neigh_event_send+0x802/0x1070 [ 20.781716][ T343] neigh_resolve_output+0xbe/0x140 [ 20.781814][ T343] ip6_finish_output2+0x423/0x1300 [ 20.781911][ T343] ip6_finish_output+0x646/0xda0 [ 20.782008][ T343] ip6_output+0x23f/0x7f0 [ 20.782107][ T343] ip6_forward+0x10f4/0x2bd0 [ 20.782206][ T343] ipv6_rcv+0x3c1/0x5a0 [ 20.782305][ T343] __netif_receive_skb_one_core+0xfc/0x180 [ 20.782427][ T343] netif_receive_skb_internal+0xb0/0x330 [ 20.782542][ T343] netif_receive_skb+0x56/0x380 [ 20.782641][ T343] br_handle_frame_finish+0xc3b/0x1fb0 [bridge] [ 20.782773][ T343] br_handle_frame+0x739/0xf40 [bridge] [ 20.782896][ T343] __netif_receive_skb_core.constprop.0+0x536/0x2bc0 [ 20.783014][ T343] __netif_receive_skb_one_core+0xa2/0x180 [ 20.783134][ T343] process_backlog+0x2bc/0x1490 [ 20.783232][ T343] __napi_poll+0xa7/0x3b0 [ 20.783333][ T343] net_rx_action+0x513/0xf50 [ 20.783435][ T343] handle_softirqs+0x1d8/0x940 [ 20.783534][ T343] do_softirq+0xa9/0xe0 [ 20.783630][ T343] __local_bh_enable_ip+0x113/0x140 [ 20.783729][ T343] __neigh_event_send+0x30a/0x1070 [ 20.783827][ T343] neigh_resolve_output+0xbe/0x140 [ 20.783927][ T343] ip6_finish_output2+0x423/0x1300 [ 20.784024][ T343] ip6_finish_output+0x646/0xda0 [ 20.784122][ T343] ip6_output+0x23f/0x7f0 [ 20.784221][ T343] ip6_send_skb+0xee/0x350 [ 20.784317][ T343] rawv6_push_pending_frames+0x4cb/0xa90 [ 20.784439][ T343] rawv6_sendmsg+0x1434/0x1a50 [ 20.784538][ T343] __sys_sendto+0x2c9/0x400 [ 20.784637][ T343] __x64_sys_sendto+0xe4/0x1f0 [ 20.784733][ T343] do_syscall_64+0x117/0x590 [ 20.784830][ T343] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.784946][ T343] INITIAL USE at: [ 20.785006][ T343] __lock_acquire+0x378/0xc10 [ 20.785102][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.785200][ T343] _raw_write_lock_bh+0x38/0x50 [ 20.785299][ T343] addrconf_permanent_addr+0x108/0x9c0 [ 20.785415][ T343] addrconf_notify+0x151/0xf30 [ 20.785516][ T343] notifier_call_chain+0xb0/0x320 [ 20.785658][ T343] __dev_notify_flags+0xde/0x280 [ 20.785754][ T343] netif_change_flags+0xfe/0x190 [ 20.785851][ T343] do_setlink.isra.0+0x1cc3/0x2750 [ 20.785988][ T343] rtnl_newlink+0x8d1/0xef0 [ 20.786087][ T343] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 20.786182][ T343] netlink_rcv_skb+0x14e/0x3a0 [ 20.786322][ T343] netlink_unicast+0x486/0x750 [ 20.786422][ T343] netlink_sendmsg+0x735/0xc60 [ 20.786520][ T343] ____sys_sendmsg+0x419/0x850 [ 20.786619][ T343] ___sys_sendmsg+0x14e/0x1d0 [ 20.786758][ T343] __sys_sendmsg+0x145/0x1f0 [ 20.786854][ T343] do_syscall_64+0x117/0x590 [ 20.786952][ T343] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.787108][ T343] INITIAL READ USE at: [ 20.787184][ T343] __lock_acquire+0x378/0xc10 [ 20.787282][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.787443][ T343] _raw_read_lock_bh+0x44/0x80 [ 20.787542][ T343] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 20.787659][ T343] inet6_fill_link_af+0x5c/0xe0 [ 20.787800][ T343] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 20.787917][ T343] rtnl_getlink+0x9c9/0xeb0 [ 20.788015][ T343] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 20.788154][ T343] netlink_rcv_skb+0x14e/0x3a0 [ 20.788251][ T343] netlink_unicast+0x486/0x750 [ 20.788348][ T343] netlink_sendmsg+0x735/0xc60 [ 20.788491][ T343] ____sys_sendmsg+0x419/0x850 [ 20.788589][ T343] ___sys_sendmsg+0x14e/0x1d0 [ 20.788686][ T343] __sys_sendmsg+0x145/0x1f0 [ 20.788825][ T343] do_syscall_64+0x117/0x590 [ 20.788920][ T343] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.789037][ T343] } [ 20.789078][ T343] ... key at: [] __key.37+0x0/0x40 [ 20.789238][ T343] ... acquired at: [ 20.789297][ T343] __lock_acquire+0x508/0xc10 [ 20.789376][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.789459][ T343] _raw_spin_lock+0x33/0x40 [ 20.789575][ T343] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 20.789672][ T343] __ipv6_dev_ac_inc+0x57e/0x930 [ 20.789747][ T343] addrconf_join_anycast+0x1bc/0x260 [ 20.789867][ T343] __ipv6_ifa_notify+0x75b/0xad0 [ 20.789942][ T343] addrconf_dad_completed+0x14b/0xe10 [ 20.790020][ T343] addrconf_dad_work+0x3c1/0x930 [ 20.790096][ T343] process_one_work+0xdf8/0x1410 [ 20.790216][ T343] worker_thread+0x4f1/0xd60 [ 20.790296][ T343] kthread+0x367/0x460 [ 20.790355][ T343] ret_from_fork+0x474/0x6b0 [ 20.790437][ T343] ret_from_fork_asm+0x11/0x20 [ 20.790515][ T343] [ 20.790595][ T343] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 20.790674][ T343] HARDIRQ-ON-W at: [ 20.790731][ T343] __lock_acquire+0x378/0xc10 [ 20.790828][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.790965][ T343] _raw_spin_lock+0x33/0x40 [ 20.791061][ T343] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 20.791178][ T343] __ipv6_dev_ac_inc+0x57e/0x930 [ 20.791317][ T343] addrconf_join_anycast+0x1bc/0x260 [ 20.791415][ T343] __ipv6_ifa_notify+0x75b/0xad0 [ 20.791517][ T343] addrconf_dad_completed+0x14b/0xe10 [ 20.791657][ T343] addrconf_dad_work+0x3c1/0x930 [ 20.791755][ T343] process_one_work+0xdf8/0x1410 [ 20.791852][ T343] worker_thread+0x4f1/0xd60 [ 20.791991][ T343] kthread+0x367/0x460 [ 20.792070][ T343] ret_from_fork+0x474/0x6b0 [ 20.792167][ T343] ret_from_fork_asm+0x11/0x20 [ 20.792265][ T343] SOFTIRQ-ON-W at: [ 20.792364][ T343] __lock_acquire+0x378/0xc10 [ 20.792462][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.792558][ T343] _raw_spin_lock+0x33/0x40 [ 20.792697][ T343] __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.792793][ T343] addrconf_leave_anycast+0x1bc/0x260 [ 20.792890][ T343] dev_forward_change+0x3b3/0x850 [ 20.792986][ T343] addrconf_fixup_forwarding+0x2af/0x4d0 [ 20.793143][ T343] addrconf_sysctl_forward+0x209/0x2b0 [ 20.793238][ T343] proc_sys_call_handler+0x31b/0x480 [ 20.793336][ T343] new_sync_write+0x333/0x750 [ 20.793477][ T343] vfs_write+0x6a4/0xc10 [ 20.793574][ T343] ksys_write+0x116/0x250 [ 20.793670][ T343] do_syscall_64+0x117/0x590 [ 20.793807][ T343] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.793922][ T343] INITIAL USE at: [ 20.793980][ T343] __lock_acquire+0x378/0xc10 [ 20.794119][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.794216][ T343] _raw_spin_lock+0x33/0x40 [ 20.794311][ T343] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 20.794470][ T343] __ipv6_dev_ac_inc+0x57e/0x930 [ 20.794568][ T343] addrconf_join_anycast+0x1bc/0x260 [ 20.794664][ T343] __ipv6_ifa_notify+0x75b/0xad0 [ 20.794800][ T343] addrconf_dad_completed+0x14b/0xe10 [ 20.794898][ T343] addrconf_dad_work+0x3c1/0x930 [ 20.794995][ T343] process_one_work+0xdf8/0x1410 [ 20.795094][ T343] worker_thread+0x4f1/0xd60 [ 20.795232][ T343] kthread+0x367/0x460 [ 20.795309][ T343] ret_from_fork+0x474/0x6b0 [ 20.795404][ T343] ret_from_fork_asm+0x11/0x20 [ 20.795543][ T343] } [ 20.795581][ T343] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 20.795699][ T343] ... acquired at: [ 20.795755][ T343] mark_lock+0x1d7/0xa00 [ 20.795833][ T343] mark_usage+0x105/0x170 [ 20.795910][ T343] __lock_acquire+0x378/0xc10 [ 20.795986][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.796062][ T343] _raw_spin_lock+0x33/0x40 [ 20.796179][ T343] __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.796257][ T343] addrconf_leave_anycast+0x1bc/0x260 [ 20.796336][ T343] dev_forward_change+0x3b3/0x850 [ 20.796414][ T343] addrconf_fixup_forwarding+0x2af/0x4d0 [ 20.796556][ T343] addrconf_sysctl_forward+0x209/0x2b0 [ 20.796633][ T343] proc_sys_call_handler+0x31b/0x480 [ 20.796710][ T343] new_sync_write+0x333/0x750 [ 20.796787][ T343] vfs_write+0x6a4/0xc10 [ 20.796905][ T343] ksys_write+0x116/0x250 [ 20.796980][ T343] do_syscall_64+0x117/0x590 [ 20.797056][ T343] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.797151][ T343] [ 20.797229][ T343] [ 20.797229][ T343] stack backtrace: [ 20.797327][ T343] CPU: 2 UID: 0 PID: 343 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 20.797330][ T343] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 20.797332][ T343] Call Trace: [ 20.797334][ T343] [ 20.797335][ T343] dump_stack_lvl+0x6f/0xa0 [ 20.797339][ T343] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 20.797342][ T343] mark_lock_irq+0x989/0x9c0 [ 20.797345][ T343] mark_lock+0x1d7/0xa00 [ 20.797347][ T343] mark_usage+0x105/0x170 [ 20.797348][ T343] __lock_acquire+0x378/0xc10 [ 20.797350][ T343] lock_acquire.part.0+0xbc/0x260 [ 20.797352][ T343] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.797353][ T343] ? rcu_is_watching+0x15/0xd0 [ 20.797356][ T343] ? do_raw_read_unlock+0x70/0x70 [ 20.797358][ T343] ? lock_acquire+0x134/0x160 [ 20.797360][ T343] _raw_spin_lock+0x33/0x40 [ 20.797362][ T343] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.797363][ T343] __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.797365][ T343] addrconf_leave_anycast+0x1bc/0x260 [ 20.797367][ T343] ? find_held_lock+0x2b/0x80 [ 20.797370][ T343] ? __ipv6_isatap_ifid+0x210/0x210 [ 20.797371][ T343] ? mark_held_locks+0x40/0x70 [ 20.797373][ T343] ? lockdep_hardirqs_on+0x8c/0x130 [ 20.797375][ T343] dev_forward_change+0x3b3/0x850 [ 20.797378][ T343] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 20.797379][ T343] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 20.797382][ T343] addrconf_fixup_forwarding+0x2af/0x4d0 [ 20.797385][ T343] addrconf_sysctl_forward+0x209/0x2b0 [ 20.797387][ T343] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 20.797389][ T343] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 20.797391][ T343] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 20.797394][ T343] ? proc_sys_call_handler+0x25d/0x480 [ 20.797396][ T343] proc_sys_call_handler+0x31b/0x480 [ 20.797398][ T343] ? proc_sys_lookup+0x3d0/0x3d0 [ 20.797400][ T343] ? do_fault_around+0x300/0x5a0 [ 20.797403][ T343] ? find_held_lock+0x2b/0x80 [ 20.797405][ T343] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 20.797407][ T343] ? rcu_read_lock_any_held+0x3c/0x90 [ 20.797409][ T343] ? proc_sys_call_handler+0x480/0x480 [ 20.797411][ T343] new_sync_write+0x333/0x750 [ 20.797412][ T343] ? __lock_acquire+0x508/0xc10 [ 20.797414][ T343] ? new_sync_read+0x740/0x740 [ 20.797419][ T343] ? lock_acquire.part.0+0xbc/0x260 [ 20.797421][ T343] ? ksys_write+0x116/0x250 [ 20.797423][ T343] vfs_write+0x6a4/0xc10 [ 20.797425][ T343] ksys_write+0x116/0x250 [ 20.797426][ T343] ? __ia32_sys_read+0xc0/0xc0 [ 20.797428][ T343] ? rcu_is_watching+0x15/0xd0 [ 20.797429][ T343] ? rcu_is_watching+0x15/0xd0 [ 20.797431][ T343] do_syscall_64+0x117/0x590 [ 20.797432][ T343] ? trace_hardirqs_off+0xd/0x30 [ 20.797435][ T343] ? exc_page_fault+0xee/0x100 [ 20.797437][ T343] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.797439][ T343] RIP: 0033:0x7f377b98408e [ 20.797441][ T343] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 20.797443][ T343] RSP: 002b:00007ffe937d4c40 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 20.797446][ T343] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f377b98408e [ 20.797447][ T343] RDX: 0000000000000002 RSI: 000055795961b4b0 RDI: 0000000000000005 [ 20.797448][ T343] RBP: 00007ffe937d4c50 R08: 0000000000000000 R09: 0000000000000000 [ 20.797449][ T343] R10: 0000000000000000 R11: 0000000000000202 R12: 000055795961d5e0 [ 20.797449][ T343] R13: 000055795961b470 R14: 0000000000000002 R15: 0000000000000000 [ 20.797452][ T343] [ 20.921689][ T350] br1: port 1(veth1) entered disabled state [ 20.942126][ T351] veth1: left allmulticast mode [ 20.942260][ T351] veth1: left promiscuous mode [ 20.942405][ T351] br1: port 1(veth1) entered disabled state