[ 9.258950][ T192] ip (192) used greatest stack depth: 24096 bytes left [ 9.843191][ T214] 8021q: 802.1Q VLAN Support v1.8 [ 10.664968][ T245] br1: port 1(veth1) entered blocking state [ 10.665253][ T245] br1: port 1(veth1) entered disabled state [ 10.665443][ T245] veth1: entered allmulticast mode [ 10.666953][ T245] veth1: entered promiscuous mode [ 10.701098][ T39] br1: port 1(veth1) entered blocking state [ 10.701360][ T39] br1: port 1(veth1) entered forwarding state [ 21.513424][ T342] [ 21.513532][ T342] ======================================================== [ 21.513703][ T342] WARNING: possible irq lock inversion dependency detected [ 21.513866][ T342] 7.1.0-rc5-virtme #1 Not tainted [ 21.513980][ T342] -------------------------------------------------------- [ 21.514140][ T342] sysctl/342 just changed the state of lock: [ 21.514274][ T342] ffffffffa6f7e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 21.514481][ T342] but this lock was taken by another, SOFTIRQ-READ-safe lock in the past: [ 21.514642][ T342] (&ndev->lock){++.-}-{3:3} [ 21.514647][ T342] [ 21.514647][ T342] [ 21.514647][ T342] and interrupts could create inverse lock ordering between them. [ 21.514647][ T342] [ 21.515046][ T342] [ 21.515046][ T342] other info that might help us debug this: [ 21.515207][ T342] Possible interrupt unsafe locking scenario: [ 21.515207][ T342] [ 21.515376][ T342] CPU0 CPU1 [ 21.515491][ T342] ---- ---- [ 21.515605][ T342] lock(acaddr_hash_lock); [ 21.515718][ T342] local_irq_disable(); [ 21.515855][ T342] lock(&ndev->lock); [ 21.515995][ T342] lock(acaddr_hash_lock); [ 21.516137][ T342] [ 21.516221][ T342] lock(&ndev->lock); [ 21.516305][ T342] [ 21.516305][ T342] *** DEADLOCK *** [ 21.516305][ T342] [ 21.516471][ T342] 2 locks held by sysctl/342: [ 21.516585][ T342] #0: ff11000009cec3e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 21.516787][ T342] #1: ffffffffa6e8c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 21.517007][ T342] [ 21.517007][ T342] the shortest dependencies between 2nd lock and 1st lock: [ 21.517196][ T342] -> (&ndev->lock){++.-}-{3:3} { [ 21.517314][ T342] HARDIRQ-ON-W at: [ 21.517399][ T342] __lock_acquire+0x378/0xc10 [ 21.517552][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.517688][ T342] _raw_write_lock_bh+0x38/0x50 [ 21.517825][ T342] addrconf_permanent_addr+0x108/0x9c0 [ 21.517992][ T342] addrconf_notify+0x151/0xf30 [ 21.518131][ T342] notifier_call_chain+0xb0/0x320 [ 21.518268][ T342] __dev_notify_flags+0xde/0x280 [ 21.518412][ T342] netif_change_flags+0xfe/0x190 [ 21.518553][ T342] do_setlink.isra.0+0x1cc3/0x2750 [ 21.518694][ T342] rtnl_newlink+0x8d1/0xef0 [ 21.518833][ T342] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 21.518979][ T342] netlink_rcv_skb+0x14e/0x3a0 [ 21.519124][ T342] netlink_unicast+0x486/0x750 [ 21.519260][ T342] netlink_sendmsg+0x735/0xc60 [ 21.519400][ T342] ____sys_sendmsg+0x419/0x850 [ 21.519546][ T342] ___sys_sendmsg+0x14e/0x1d0 [ 21.519684][ T342] __sys_sendmsg+0x145/0x1f0 [ 21.519823][ T342] do_syscall_64+0x117/0x590 [ 21.519965][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.520140][ T342] HARDIRQ-ON-R at: [ 21.520225][ T342] __lock_acquire+0x378/0xc10 [ 21.520362][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.520504][ T342] _raw_read_lock_bh+0x44/0x80 [ 21.520645][ T342] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 21.520810][ T342] inet6_fill_link_af+0x5c/0xe0 [ 21.520946][ T342] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 21.521113][ T342] rtnl_getlink+0x9c9/0xeb0 [ 21.521250][ T342] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 21.521387][ T342] netlink_rcv_skb+0x14e/0x3a0 [ 21.521527][ T342] netlink_unicast+0x486/0x750 [ 21.521663][ T342] netlink_sendmsg+0x735/0xc60 [ 21.521800][ T342] ____sys_sendmsg+0x419/0x850 [ 21.521940][ T342] ___sys_sendmsg+0x14e/0x1d0 [ 21.522078][ T342] __sys_sendmsg+0x145/0x1f0 [ 21.522214][ T342] do_syscall_64+0x117/0x590 [ 21.522352][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.522521][ T342] IN-SOFTIRQ-R at: [ 21.522605][ T342] __lock_acquire+0x378/0xc10 [ 21.522741][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.522878][ T342] _raw_read_lock_bh+0x44/0x80 [ 21.523015][ T342] ipv6_get_lladdr+0xa8/0x3f0 [ 21.523145][ T342] ndisc_send_ns+0xf3/0x120 [ 21.523282][ T342] ndisc_solicit+0x314/0x480 [ 21.523428][ T342] neigh_probe+0xb3/0x100 [ 21.523566][ T342] __neigh_event_send+0x802/0x1070 [ 21.523703][ T342] neigh_resolve_output+0xbe/0x140 [ 21.523838][ T342] ip6_finish_output2+0x423/0x1300 [ 21.523974][ T342] ip6_finish_output+0x646/0xda0 [ 21.524111][ T342] ip6_output+0x23f/0x7f0 [ 21.524250][ T342] ip6_forward+0x10f4/0x2bd0 [ 21.524389][ T342] ipv6_rcv+0x3c1/0x5a0 [ 21.524530][ T342] __netif_receive_skb_one_core+0xfc/0x180 [ 21.524693][ T342] netif_receive_skb_internal+0xb0/0x330 [ 21.524926][ T342] netif_receive_skb+0x56/0x380 [ 21.525064][ T342] br_handle_frame_finish+0xc3b/0x1fb0 [bridge] [ 21.525243][ T342] br_handle_frame+0x739/0xf40 [bridge] [ 21.525493][ T342] __netif_receive_skb_core.constprop.0+0x536/0x2bc0 [ 21.525660][ T342] __netif_receive_skb_one_core+0xa2/0x180 [ 21.525822][ T342] process_backlog+0x2bc/0x1490 [ 21.526024][ T342] __napi_poll+0xa7/0x3b0 [ 21.526163][ T342] net_rx_action+0x513/0xf50 [ 21.526302][ T342] handle_softirqs+0x1d8/0x940 [ 21.526512][ T342] do_softirq+0xa9/0xe0 [ 21.526649][ T342] __local_bh_enable_ip+0x113/0x140 [ 21.526785][ T342] __neigh_event_send+0x30a/0x1070 [ 21.526993][ T342] neigh_resolve_output+0xbe/0x140 [ 21.527134][ T342] ip6_finish_output2+0x423/0x1300 [ 21.527272][ T342] ip6_finish_output+0x646/0xda0 [ 21.527415][ T342] ip6_output+0x23f/0x7f0 [ 21.527623][ T342] ip6_send_skb+0xee/0x350 [ 21.527760][ T342] rawv6_push_pending_frames+0x4cb/0xa90 [ 21.527927][ T342] rawv6_sendmsg+0x1434/0x1a50 [ 21.528132][ T342] __sys_sendto+0x2c9/0x400 [ 21.528267][ T342] __x64_sys_sendto+0xe4/0x1f0 [ 21.528409][ T342] do_syscall_64+0x117/0x590 [ 21.528618][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.528781][ T342] INITIAL USE at: [ 21.528865][ T342] __lock_acquire+0x378/0xc10 [ 21.529072][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.529209][ T342] _raw_write_lock_bh+0x38/0x50 [ 21.529351][ T342] addrconf_permanent_addr+0x108/0x9c0 [ 21.529588][ T342] addrconf_notify+0x151/0xf30 [ 21.529726][ T342] notifier_call_chain+0xb0/0x320 [ 21.529864][ T342] __dev_notify_flags+0xde/0x280 [ 21.530069][ T342] netif_change_flags+0xfe/0x190 [ 21.530207][ T342] do_setlink.isra.0+0x1cc3/0x2750 [ 21.530345][ T342] rtnl_newlink+0x8d1/0xef0 [ 21.530488][ T342] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 21.530695][ T342] netlink_rcv_skb+0x14e/0x3a0 [ 21.530831][ T342] netlink_unicast+0x486/0x750 [ 21.530967][ T342] netlink_sendmsg+0x735/0xc60 [ 21.531173][ T342] ____sys_sendmsg+0x419/0x850 [ 21.531311][ T342] ___sys_sendmsg+0x14e/0x1d0 [ 21.531451][ T342] __sys_sendmsg+0x145/0x1f0 [ 21.531653][ T342] do_syscall_64+0x117/0x590 [ 21.531788][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.531950][ T342] INITIAL READ USE at: [ 21.532126][ T342] __lock_acquire+0x378/0xc10 [ 21.532265][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.532432][ T342] _raw_read_lock_bh+0x44/0x80 [ 21.532640][ T342] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 21.532805][ T342] inet6_fill_link_af+0x5c/0xe0 [ 21.532942][ T342] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 21.533175][ T342] rtnl_getlink+0x9c9/0xeb0 [ 21.533316][ T342] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 21.533459][ T342] netlink_rcv_skb+0x14e/0x3a0 [ 21.533665][ T342] netlink_unicast+0x486/0x750 [ 21.533802][ T342] netlink_sendmsg+0x735/0xc60 [ 21.533938][ T342] ____sys_sendmsg+0x419/0x850 [ 21.534145][ T342] ___sys_sendmsg+0x14e/0x1d0 [ 21.534283][ T342] __sys_sendmsg+0x145/0x1f0 [ 21.534424][ T342] do_syscall_64+0x117/0x590 [ 21.534563][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.534797][ T342] } [ 21.534855][ T342] ... key at: [] __key.37+0x0/0x40 [ 21.535022][ T342] ... acquired at: [ 21.535172][ T342] __lock_acquire+0x508/0xc10 [ 21.535281][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.535390][ T342] _raw_spin_lock+0x33/0x40 [ 21.535504][ T342] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 21.535639][ T342] __ipv6_dev_ac_inc+0x57e/0x930 [ 21.535744][ T342] addrconf_join_anycast+0x1bc/0x260 [ 21.535849][ T342] __ipv6_ifa_notify+0x75b/0xad0 [ 21.535957][ T342] addrconf_dad_completed+0x14b/0xe10 [ 21.536067][ T342] addrconf_dad_work+0x3c1/0x930 [ 21.536179][ T342] process_one_work+0xdf8/0x1410 [ 21.536290][ T342] worker_thread+0x4f1/0xd60 [ 21.536398][ T342] kthread+0x367/0x460 [ 21.536549][ T342] ret_from_fork+0x474/0x6b0 [ 21.536657][ T342] ret_from_fork_asm+0x11/0x20 [ 21.536765][ T342] [ 21.536821][ T342] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 21.536937][ T342] HARDIRQ-ON-W at: [ 21.537085][ T342] __lock_acquire+0x378/0xc10 [ 21.537224][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.537359][ T342] _raw_spin_lock+0x33/0x40 [ 21.537565][ T342] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 21.537728][ T342] __ipv6_dev_ac_inc+0x57e/0x930 [ 21.537863][ T342] addrconf_join_anycast+0x1bc/0x260 [ 21.538068][ T342] __ipv6_ifa_notify+0x75b/0xad0 [ 21.538207][ T342] addrconf_dad_completed+0x14b/0xe10 [ 21.538342][ T342] addrconf_dad_work+0x3c1/0x930 [ 21.538482][ T342] process_one_work+0xdf8/0x1410 [ 21.538687][ T342] worker_thread+0x4f1/0xd60 [ 21.538838][ T342] kthread+0x367/0x460 [ 21.538952][ T342] ret_from_fork+0x474/0x6b0 [ 21.539161][ T342] ret_from_fork_asm+0x11/0x20 [ 21.539298][ T342] SOFTIRQ-ON-W at: [ 21.539379][ T342] __lock_acquire+0x378/0xc10 [ 21.539520][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.539725][ T342] _raw_spin_lock+0x33/0x40 [ 21.539863][ T342] __ipv6_dev_ac_dec+0x236/0x5d0 [ 21.540000][ T342] addrconf_leave_anycast+0x1bc/0x260 [ 21.540206][ T342] dev_forward_change+0x3b3/0x850 [ 21.540347][ T342] addrconf_fixup_forwarding+0x2af/0x4d0 [ 21.540514][ T342] addrconf_sysctl_forward+0x209/0x2b0 [ 21.540721][ T342] proc_sys_call_handler+0x31b/0x480 [ 21.540858][ T342] new_sync_write+0x333/0x750 [ 21.540996][ T342] vfs_write+0x6a4/0xc10 [ 21.541203][ T342] ksys_write+0x116/0x250 [ 21.541340][ T342] do_syscall_64+0x117/0x590 [ 21.541482][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.541717][ T342] INITIAL USE at: [ 21.541799][ T342] __lock_acquire+0x378/0xc10 [ 21.541934][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.542070][ T342] _raw_spin_lock+0x33/0x40 [ 21.542274][ T342] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 21.542442][ T342] __ipv6_dev_ac_inc+0x57e/0x930 [ 21.542582][ T342] addrconf_join_anycast+0x1bc/0x260 [ 21.542718][ T342] __ipv6_ifa_notify+0x75b/0xad0 [ 21.542853][ T342] addrconf_dad_completed+0x14b/0xe10 [ 21.542988][ T342] addrconf_dad_work+0x3c1/0x930 [ 21.543198][ T342] process_one_work+0xdf8/0x1410 [ 21.543339][ T342] worker_thread+0x4f1/0xd60 [ 21.543481][ T342] kthread+0x367/0x460 [ 21.543661][ T342] ret_from_fork+0x474/0x6b0 [ 21.543803][ T342] ret_from_fork_asm+0x11/0x20 [ 21.543941][ T342] } [ 21.543996][ T342] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 21.544229][ T342] ... acquired at: [ 21.544309][ T342] mark_lock+0x1d7/0xa00 [ 21.544423][ T342] mark_usage+0x105/0x170 [ 21.544532][ T342] __lock_acquire+0x378/0xc10 [ 21.544707][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.544815][ T342] _raw_spin_lock+0x33/0x40 [ 21.544924][ T342] __ipv6_dev_ac_dec+0x236/0x5d0 [ 21.545034][ T342] addrconf_leave_anycast+0x1bc/0x260 [ 21.545211][ T342] dev_forward_change+0x3b3/0x850 [ 21.545319][ T342] addrconf_fixup_forwarding+0x2af/0x4d0 [ 21.545457][ T342] addrconf_sysctl_forward+0x209/0x2b0 [ 21.545570][ T342] proc_sys_call_handler+0x31b/0x480 [ 21.545747][ T342] new_sync_write+0x333/0x750 [ 21.545856][ T342] vfs_write+0x6a4/0xc10 [ 21.545967][ T342] ksys_write+0x116/0x250 [ 21.546075][ T342] do_syscall_64+0x117/0x590 [ 21.546250][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.546385][ T342] [ 21.546442][ T342] [ 21.546442][ T342] stack backtrace: [ 21.546577][ T342] CPU: 0 UID: 0 PID: 342 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 21.546581][ T342] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 21.546584][ T342] Call Trace: [ 21.546586][ T342] [ 21.546587][ T342] dump_stack_lvl+0x6f/0xa0 [ 21.546592][ T342] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 21.546597][ T342] mark_lock_irq+0x989/0x9c0 [ 21.546602][ T342] mark_lock+0x1d7/0xa00 [ 21.546604][ T342] mark_usage+0x105/0x170 [ 21.546606][ T342] __lock_acquire+0x378/0xc10 [ 21.546610][ T342] lock_acquire.part.0+0xbc/0x260 [ 21.546612][ T342] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 21.546615][ T342] ? rcu_is_watching+0x15/0xd0 [ 21.546619][ T342] ? do_raw_read_unlock+0x70/0x70 [ 21.546621][ T342] ? lock_acquire+0x134/0x160 [ 21.546624][ T342] _raw_spin_lock+0x33/0x40 [ 21.546627][ T342] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 21.546629][ T342] __ipv6_dev_ac_dec+0x236/0x5d0 [ 21.546632][ T342] addrconf_leave_anycast+0x1bc/0x260 [ 21.546635][ T342] ? find_held_lock+0x2b/0x80 [ 21.546638][ T342] ? __ipv6_isatap_ifid+0x210/0x210 [ 21.546641][ T342] ? mark_held_locks+0x40/0x70 [ 21.546643][ T342] ? lockdep_hardirqs_on+0x8c/0x130 [ 21.546647][ T342] dev_forward_change+0x3b3/0x850 [ 21.546650][ T342] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 21.546653][ T342] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 21.546657][ T342] addrconf_fixup_forwarding+0x2af/0x4d0 [ 21.546661][ T342] addrconf_sysctl_forward+0x209/0x2b0 [ 21.546664][ T342] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 21.546667][ T342] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 21.546670][ T342] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 21.546674][ T342] ? proc_sys_call_handler+0x25d/0x480 [ 21.546678][ T342] proc_sys_call_handler+0x31b/0x480 [ 21.546682][ T342] ? proc_sys_lookup+0x3d0/0x3d0 [ 21.546684][ T342] ? rcu_read_unlock+0x1b/0x70 [ 21.546688][ T342] ? do_raw_spin_unlock+0x59/0x250 [ 21.546690][ T342] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 21.546693][ T342] ? rcu_read_lock_any_held+0x3c/0x90 [ 21.546695][ T342] ? proc_sys_call_handler+0x480/0x480 [ 21.546698][ T342] new_sync_write+0x333/0x750 [ 21.546700][ T342] ? __lock_acquire+0x508/0xc10 [ 21.546703][ T342] ? new_sync_read+0x740/0x740 [ 21.546705][ T342] ? lock_acquire.part.0+0xbc/0x260 [ 21.546707][ T342] ? ksys_write+0x116/0x250 [ 21.546711][ T342] vfs_write+0x6a4/0xc10 [ 21.546714][ T342] ksys_write+0x116/0x250 [ 21.546716][ T342] ? __ia32_sys_read+0xc0/0xc0 [ 21.546719][ T342] ? rcu_is_watching+0x15/0xd0 [ 21.546721][ T342] ? rcu_is_watching+0x15/0xd0 [ 21.546724][ T342] do_syscall_64+0x117/0x590 [ 21.546726][ T342] ? trace_hardirqs_off+0xd/0x30 [ 21.546729][ T342] ? exc_page_fault+0xee/0x100 [ 21.546732][ T342] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.546735][ T342] RIP: 0033:0x7ff10ce0c08e [ 21.546738][ T342] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 21.546740][ T342] RSP: 002b:00007ffed7d759b0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 21.546744][ T342] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007ff10ce0c08e [ 21.546746][ T342] RDX: 0000000000000002 RSI: 0000564a1eba24b0 RDI: 0000000000000005 [ 21.546748][ T342] RBP: 00007ffed7d759c0 R08: 0000000000000000 R09: 0000000000000000 [ 21.546749][ T342] R10: 0000000000000000 R11: 0000000000000202 R12: 0000564a1eba45e0 [ 21.546750][ T342] R13: 0000564a1eba2470 R14: 0000000000000002 R15: 0000000000000000 [ 21.546754][ T342] [ 21.666292][ T349] br1: port 1(veth1) entered disabled state [ 21.678885][ T350] veth1: left allmulticast mode [ 21.679000][ T350] veth1: left promiscuous mode [ 21.679139][ T350] br1: port 1(veth1) entered disabled state