[ 8.589151][ T186] ip (186) used greatest stack depth: 24272 bytes left [ 9.312603][ T213] 8021q: 802.1Q VLAN Support v1.8 [ 10.032127][ T246] br1: port 1(veth1) entered blocking state [ 10.032424][ T246] br1: port 1(veth1) entered disabled state [ 10.033007][ T246] veth1: entered allmulticast mode [ 10.039890][ T246] veth1: entered promiscuous mode [ 10.071083][ T92] br1: port 1(veth1) entered blocking state [ 10.071390][ T92] br1: port 1(veth1) entered forwarding state [ 20.851735][ T342] [ 20.851824][ T342] ======================================================== [ 20.851948][ T342] WARNING: possible irq lock inversion dependency detected [ 20.852065][ T342] 7.1.0-rc5-virtme #1 Not tainted [ 20.852142][ T342] -------------------------------------------------------- [ 20.852254][ T342] sysctl/342 just changed the state of lock: [ 20.852352][ T342] ffffffff8717e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.852497][ T342] but this lock was taken by another, SOFTIRQ-READ-safe lock in the past: [ 20.852613][ T342] (&ndev->lock){++.-}-{3:3} [ 20.852615][ T342] [ 20.852615][ T342] [ 20.852615][ T342] and interrupts could create inverse lock ordering between them. [ 20.852615][ T342] [ 20.852897][ T342] [ 20.852897][ T342] other info that might help us debug this: [ 20.853015][ T342] Possible interrupt unsafe locking scenario: [ 20.853015][ T342] [ 20.853129][ T342] CPU0 CPU1 [ 20.853207][ T342] ---- ---- [ 20.853286][ T342] lock(acaddr_hash_lock); [ 20.853366][ T342] local_irq_disable(); [ 20.853466][ T342] lock(&ndev->lock); [ 20.853566][ T342] lock(acaddr_hash_lock); [ 20.853662][ T342] [ 20.853720][ T342] lock(&ndev->lock); [ 20.853783][ T342] [ 20.853783][ T342] *** DEADLOCK *** [ 20.853783][ T342] [ 20.853899][ T342] 2 locks held by sysctl/342: [ 20.853976][ T342] #0: ff110000107c43e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 20.854117][ T342] #1: ffffffff8708c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 20.854273][ T342] [ 20.854273][ T342] the shortest dependencies between 2nd lock and 1st lock: [ 20.854407][ T342] -> (&ndev->lock){++.-}-{3:3} { [ 20.854486][ T342] HARDIRQ-ON-W at: [ 20.854548][ T342] __lock_acquire+0x378/0xc10 [ 20.854651][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.854751][ T342] _raw_write_lock_bh+0x38/0x50 [ 20.854849][ T342] addrconf_permanent_addr+0x108/0x9c0 [ 20.854964][ T342] addrconf_notify+0x151/0xf30 [ 20.855063][ T342] notifier_call_chain+0xb0/0x320 [ 20.855162][ T342] __dev_notify_flags+0xde/0x280 [ 20.855262][ T342] netif_change_flags+0xfe/0x190 [ 20.855358][ T342] do_setlink.isra.0+0x1cc3/0x2750 [ 20.855458][ T342] rtnl_newlink+0x8d1/0xef0 [ 20.855556][ T342] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 20.855652][ T342] netlink_rcv_skb+0x14e/0x3a0 [ 20.855756][ T342] netlink_unicast+0x486/0x750 [ 20.855852][ T342] netlink_sendmsg+0x735/0xc60 [ 20.855951][ T342] ____sys_sendmsg+0x419/0x850 [ 20.856048][ T342] ___sys_sendmsg+0x14e/0x1d0 [ 20.856144][ T342] __sys_sendmsg+0x145/0x1f0 [ 20.856239][ T342] do_syscall_64+0x117/0x590 [ 20.856334][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.856449][ T342] HARDIRQ-ON-R at: [ 20.856507][ T342] __lock_acquire+0x378/0xc10 [ 20.856603][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.856696][ T342] _raw_read_lock_bh+0x44/0x80 [ 20.856795][ T342] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 20.856910][ T342] inet6_fill_link_af+0x5c/0xe0 [ 20.857008][ T342] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 20.857124][ T342] rtnl_getlink+0x9c9/0xeb0 [ 20.857222][ T342] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 20.857316][ T342] netlink_rcv_skb+0x14e/0x3a0 [ 20.857413][ T342] netlink_unicast+0x486/0x750 [ 20.857509][ T342] netlink_sendmsg+0x735/0xc60 [ 20.857603][ T342] ____sys_sendmsg+0x419/0x850 [ 20.857698][ T342] ___sys_sendmsg+0x14e/0x1d0 [ 20.857798][ T342] __sys_sendmsg+0x145/0x1f0 [ 20.857894][ T342] do_syscall_64+0x117/0x590 [ 20.857989][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.858101][ T342] IN-SOFTIRQ-R at: [ 20.858160][ T342] __lock_acquire+0x378/0xc10 [ 20.858257][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.858353][ T342] _raw_read_lock_bh+0x44/0x80 [ 20.858446][ T342] ipv6_get_lladdr+0xa8/0x3f0 [ 20.858543][ T342] ndisc_send_ns+0xf3/0x120 [ 20.858640][ T342] ndisc_solicit+0x314/0x480 [ 20.858736][ T342] neigh_probe+0xb3/0x100 [ 20.858837][ T342] __neigh_event_send+0x802/0x1070 [ 20.858935][ T342] neigh_resolve_output+0xbe/0x140 [ 20.859031][ T342] ip6_finish_output2+0x423/0x1300 [ 20.859125][ T342] ip6_finish_output+0x646/0xda0 [ 20.859222][ T342] ip6_output+0x23f/0x7f0 [ 20.859319][ T342] ip6_forward+0x10f4/0x2bd0 [ 20.859414][ T342] ipv6_rcv+0x3c1/0x5a0 [ 20.859509][ T342] __netif_receive_skb_one_core+0xfc/0x180 [ 20.859623][ T342] netif_receive_skb_internal+0xb0/0x330 [ 20.859741][ T342] netif_receive_skb+0x56/0x380 [ 20.859838][ T342] br_handle_frame_finish+0xc3b/0x1fb0 [bridge] [ 20.859964][ T342] br_handle_frame+0x739/0xf40 [bridge] [ 20.860084][ T342] __netif_receive_skb_core.constprop.0+0x536/0x2bc0 [ 20.860201][ T342] __netif_receive_skb_one_core+0xa2/0x180 [ 20.860318][ T342] process_backlog+0x2bc/0x1490 [ 20.860416][ T342] __napi_poll+0xa7/0x3b0 [ 20.860511][ T342] net_rx_action+0x513/0xf50 [ 20.860605][ T342] handle_softirqs+0x1d8/0x940 [ 20.860702][ T342] do_softirq+0xa9/0xe0 [ 20.860804][ T342] __local_bh_enable_ip+0x113/0x140 [ 20.860902][ T342] __neigh_event_send+0x30a/0x1070 [ 20.860998][ T342] neigh_resolve_output+0xbe/0x140 [ 20.861093][ T342] ip6_finish_output2+0x423/0x1300 [ 20.861190][ T342] ip6_finish_output+0x646/0xda0 [ 20.861285][ T342] ip6_output+0x23f/0x7f0 [ 20.861383][ T342] ip6_send_skb+0xee/0x350 [ 20.861477][ T342] rawv6_push_pending_frames+0x4cb/0xa90 [ 20.861594][ T342] rawv6_sendmsg+0x1434/0x1a50 [ 20.861690][ T342] __sys_sendto+0x2c9/0x400 [ 20.861792][ T342] __x64_sys_sendto+0xe4/0x1f0 [ 20.861890][ T342] do_syscall_64+0x117/0x590 [ 20.861985][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.862099][ T342] INITIAL USE at: [ 20.862159][ T342] __lock_acquire+0x378/0xc10 [ 20.862254][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.862350][ T342] _raw_write_lock_bh+0x38/0x50 [ 20.862449][ T342] addrconf_permanent_addr+0x108/0x9c0 [ 20.862563][ T342] addrconf_notify+0x151/0xf30 [ 20.862659][ T342] notifier_call_chain+0xb0/0x320 [ 20.862760][ T342] __dev_notify_flags+0xde/0x280 [ 20.862855][ T342] netif_change_flags+0xfe/0x190 [ 20.862951][ T342] do_setlink.isra.0+0x1cc3/0x2750 [ 20.863047][ T342] rtnl_newlink+0x8d1/0xef0 [ 20.863144][ T342] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 20.863240][ T342] netlink_rcv_skb+0x14e/0x3a0 [ 20.863337][ T342] netlink_unicast+0x486/0x750 [ 20.863434][ T342] netlink_sendmsg+0x735/0xc60 [ 20.863530][ T342] ____sys_sendmsg+0x419/0x850 [ 20.863626][ T342] ___sys_sendmsg+0x14e/0x1d0 [ 20.863724][ T342] __sys_sendmsg+0x145/0x1f0 [ 20.863825][ T342] do_syscall_64+0x117/0x590 [ 20.863921][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.864037][ T342] INITIAL READ USE at: [ 20.864115][ T342] __lock_acquire+0x378/0xc10 [ 20.864212][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.864327][ T342] _raw_read_lock_bh+0x44/0x80 [ 20.864424][ T342] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 20.864539][ T342] inet6_fill_link_af+0x5c/0xe0 [ 20.864637][ T342] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 20.864756][ T342] rtnl_getlink+0x9c9/0xeb0 [ 20.864850][ T342] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 20.864946][ T342] netlink_rcv_skb+0x14e/0x3a0 [ 20.865042][ T342] netlink_unicast+0x486/0x750 [ 20.865140][ T342] netlink_sendmsg+0x735/0xc60 [ 20.865235][ T342] ____sys_sendmsg+0x419/0x850 [ 20.865330][ T342] ___sys_sendmsg+0x14e/0x1d0 [ 20.865426][ T342] __sys_sendmsg+0x145/0x1f0 [ 20.865523][ T342] do_syscall_64+0x117/0x590 [ 20.865620][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.865736][ T342] } [ 20.865778][ T342] ... key at: [] __key.37+0x0/0x40 [ 20.865897][ T342] ... acquired at: [ 20.865954][ T342] __lock_acquire+0x508/0xc10 [ 20.866032][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.866110][ T342] _raw_spin_lock+0x33/0x40 [ 20.866188][ T342] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 20.866284][ T342] __ipv6_dev_ac_inc+0x57e/0x930 [ 20.866358][ T342] addrconf_join_anycast+0x1bc/0x260 [ 20.866434][ T342] __ipv6_ifa_notify+0x75b/0xad0 [ 20.866512][ T342] addrconf_dad_completed+0x14b/0xe10 [ 20.866588][ T342] addrconf_dad_work+0x3c1/0x930 [ 20.866664][ T342] process_one_work+0xdf8/0x1410 [ 20.866745][ T342] worker_thread+0x4f1/0xd60 [ 20.866822][ T342] kthread+0x367/0x460 [ 20.866881][ T342] ret_from_fork+0x474/0x6b0 [ 20.866959][ T342] ret_from_fork_asm+0x11/0x20 [ 20.867037][ T342] [ 20.867077][ T342] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 20.867156][ T342] HARDIRQ-ON-W at: [ 20.867215][ T342] __lock_acquire+0x378/0xc10 [ 20.867311][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.867406][ T342] _raw_spin_lock+0x33/0x40 [ 20.867499][ T342] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 20.867612][ T342] __ipv6_dev_ac_inc+0x57e/0x930 [ 20.867709][ T342] addrconf_join_anycast+0x1bc/0x260 [ 20.867809][ T342] __ipv6_ifa_notify+0x75b/0xad0 [ 20.867904][ T342] addrconf_dad_completed+0x14b/0xe10 [ 20.868000][ T342] addrconf_dad_work+0x3c1/0x930 [ 20.868095][ T342] process_one_work+0xdf8/0x1410 [ 20.868192][ T342] worker_thread+0x4f1/0xd60 [ 20.868290][ T342] kthread+0x367/0x460 [ 20.868369][ T342] ret_from_fork+0x474/0x6b0 [ 20.868465][ T342] ret_from_fork_asm+0x11/0x20 [ 20.868562][ T342] SOFTIRQ-ON-W at: [ 20.868620][ T342] __lock_acquire+0x378/0xc10 [ 20.868719][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.868819][ T342] _raw_spin_lock+0x33/0x40 [ 20.868915][ T342] __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.869009][ T342] addrconf_leave_anycast+0x1bc/0x260 [ 20.869105][ T342] dev_forward_change+0x3b3/0x850 [ 20.869204][ T342] addrconf_fixup_forwarding+0x2af/0x4d0 [ 20.869319][ T342] addrconf_sysctl_forward+0x209/0x2b0 [ 20.869415][ T342] proc_sys_call_handler+0x31b/0x480 [ 20.869513][ T342] new_sync_write+0x333/0x750 [ 20.869608][ T342] vfs_write+0x6a4/0xc10 [ 20.869704][ T342] ksys_write+0x116/0x250 [ 20.869805][ T342] do_syscall_64+0x117/0x590 [ 20.869899][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.870013][ T342] INITIAL USE at: [ 20.870068][ T342] __lock_acquire+0x378/0xc10 [ 20.870163][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.870258][ T342] _raw_spin_lock+0x33/0x40 [ 20.870355][ T342] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 20.870469][ T342] __ipv6_dev_ac_inc+0x57e/0x930 [ 20.870564][ T342] addrconf_join_anycast+0x1bc/0x260 [ 20.870659][ T342] __ipv6_ifa_notify+0x75b/0xad0 [ 20.870761][ T342] addrconf_dad_completed+0x14b/0xe10 [ 20.870858][ T342] addrconf_dad_work+0x3c1/0x930 [ 20.870954][ T342] process_one_work+0xdf8/0x1410 [ 20.871048][ T342] worker_thread+0x4f1/0xd60 [ 20.871144][ T342] kthread+0x367/0x460 [ 20.871220][ T342] ret_from_fork+0x474/0x6b0 [ 20.871315][ T342] ret_from_fork_asm+0x11/0x20 [ 20.871412][ T342] } [ 20.871450][ T342] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 20.871563][ T342] ... acquired at: [ 20.871620][ T342] mark_lock+0x1d7/0xa00 [ 20.871697][ T342] mark_usage+0x105/0x170 [ 20.871805][ T342] __lock_acquire+0x378/0xc10 [ 20.871888][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.871965][ T342] _raw_spin_lock+0x33/0x40 [ 20.872041][ T342] __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.872117][ T342] addrconf_leave_anycast+0x1bc/0x260 [ 20.872194][ T342] dev_forward_change+0x3b3/0x850 [ 20.872272][ T342] addrconf_fixup_forwarding+0x2af/0x4d0 [ 20.872367][ T342] addrconf_sysctl_forward+0x209/0x2b0 [ 20.872443][ T342] proc_sys_call_handler+0x31b/0x480 [ 20.872519][ T342] new_sync_write+0x333/0x750 [ 20.872594][ T342] vfs_write+0x6a4/0xc10 [ 20.872669][ T342] ksys_write+0x116/0x250 [ 20.872755][ T342] do_syscall_64+0x117/0x590 [ 20.872837][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.872933][ T342] [ 20.872971][ T342] [ 20.872971][ T342] stack backtrace: [ 20.873069][ T342] CPU: 2 UID: 0 PID: 342 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 20.873071][ T342] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 20.873073][ T342] Call Trace: [ 20.873075][ T342] [ 20.873076][ T342] dump_stack_lvl+0x6f/0xa0 [ 20.873080][ T342] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 20.873083][ T342] mark_lock_irq+0x989/0x9c0 [ 20.873086][ T342] mark_lock+0x1d7/0xa00 [ 20.873088][ T342] mark_usage+0x105/0x170 [ 20.873089][ T342] __lock_acquire+0x378/0xc10 [ 20.873091][ T342] lock_acquire.part.0+0xbc/0x260 [ 20.873092][ T342] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.873094][ T342] ? rcu_is_watching+0x15/0xd0 [ 20.873097][ T342] ? do_raw_read_unlock+0x70/0x70 [ 20.873099][ T342] ? lock_acquire+0x134/0x160 [ 20.873101][ T342] _raw_spin_lock+0x33/0x40 [ 20.873102][ T342] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.873104][ T342] __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.873106][ T342] addrconf_leave_anycast+0x1bc/0x260 [ 20.873107][ T342] ? find_held_lock+0x2b/0x80 [ 20.873110][ T342] ? __ipv6_isatap_ifid+0x210/0x210 [ 20.873112][ T342] ? mark_held_locks+0x40/0x70 [ 20.873114][ T342] ? lockdep_hardirqs_on+0x8c/0x130 [ 20.873116][ T342] dev_forward_change+0x3b3/0x850 [ 20.873118][ T342] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 20.873120][ T342] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 20.873123][ T342] addrconf_fixup_forwarding+0x2af/0x4d0 [ 20.873125][ T342] addrconf_sysctl_forward+0x209/0x2b0 [ 20.873127][ T342] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 20.873129][ T342] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 20.873131][ T342] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 20.873134][ T342] ? proc_sys_call_handler+0x25d/0x480 [ 20.873137][ T342] proc_sys_call_handler+0x31b/0x480 [ 20.873139][ T342] ? proc_sys_lookup+0x3d0/0x3d0 [ 20.873141][ T342] ? rcu_read_unlock+0x1b/0x70 [ 20.873143][ T342] ? do_raw_spin_unlock+0x59/0x250 [ 20.873144][ T342] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 20.873146][ T342] ? rcu_read_lock_any_held+0x3c/0x90 [ 20.873148][ T342] ? proc_sys_call_handler+0x480/0x480 [ 20.873150][ T342] new_sync_write+0x333/0x750 [ 20.873152][ T342] ? __lock_acquire+0x508/0xc10 [ 20.873153][ T342] ? new_sync_read+0x740/0x740 [ 20.873155][ T342] ? lock_acquire.part.0+0xbc/0x260 [ 20.873156][ T342] ? ksys_write+0x116/0x250 [ 20.873158][ T342] vfs_write+0x6a4/0xc10 [ 20.873160][ T342] ksys_write+0x116/0x250 [ 20.873161][ T342] ? __ia32_sys_read+0xc0/0xc0 [ 20.873163][ T342] ? rcu_is_watching+0x15/0xd0 [ 20.873164][ T342] ? rcu_is_watching+0x15/0xd0 [ 20.873166][ T342] do_syscall_64+0x117/0x590 [ 20.873167][ T342] ? trace_hardirqs_off+0xd/0x30 [ 20.873170][ T342] ? exc_page_fault+0xee/0x100 [ 20.873172][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.873173][ T342] RIP: 0033:0x7f2f24af108e [ 20.873176][ T342] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 20.873177][ T342] RSP: 002b:00007ffeff9e49e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 20.873180][ T342] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f2f24af108e [ 20.873181][ T342] RDX: 0000000000000002 RSI: 0000562ee4b0f4b0 RDI: 0000000000000005 [ 20.873182][ T342] RBP: 00007ffeff9e49f0 R08: 0000000000000000 R09: 0000000000000000 [ 20.873183][ T342] R10: 0000000000000000 R11: 0000000000000202 R12: 0000562ee4b115e0 [ 20.873184][ T342] R13: 0000562ee4b0f470 R14: 0000000000000002 R15: 0000000000000000 [ 20.873186][ T342] [ 20.976762][ T349] br1: port 1(veth1) entered disabled state [ 20.993686][ T350] veth1: left allmulticast mode [ 20.993792][ T350] veth1: left promiscuous mode [ 20.993930][ T350] br1: port 1(veth1) entered disabled state