[ 264.811635][ T2213] gre: GRE over IPv4 demultiplexer driver [ 264.821276][ T2213] ip_gre: GRE over IPv4 tunneling driver [ 265.345621][ T2235] 8021q: 802.1Q VLAN Support v1.8 [ 339.408338][ T2465] [ 339.408424][ T2465] ======================================================== [ 339.408547][ T2465] WARNING: possible irq lock inversion dependency detected [ 339.408674][ T2465] 7.1.0-rc5-virtme #1 Not tainted [ 339.408755][ T2465] -------------------------------------------------------- [ 339.408875][ T2465] sysctl/2465 just changed the state of lock: [ 339.408972][ T2465] ffffffff9e57e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 339.409128][ T2465] but this lock was taken by another, SOFTIRQ-safe lock in the past: [ 339.409244][ T2465] (&ndev->lock){++--}-{3:3} [ 339.409247][ T2465] [ 339.409247][ T2465] [ 339.409247][ T2465] and interrupts could create inverse lock ordering between them. [ 339.409247][ T2465] [ 339.409526][ T2465] [ 339.409526][ T2465] other info that might help us debug this: [ 339.409645][ T2465] Possible interrupt unsafe locking scenario: [ 339.409645][ T2465] [ 339.409774][ T2465] CPU0 CPU1 [ 339.409853][ T2465] ---- ---- [ 339.409930][ T2465] lock(acaddr_hash_lock); [ 339.410014][ T2465] local_irq_disable(); [ 339.410109][ T2465] lock(&ndev->lock); [ 339.410206][ T2465] lock(acaddr_hash_lock); [ 339.410306][ T2465] [ 339.410364][ T2465] lock(&ndev->lock); [ 339.410426][ T2465] [ 339.410426][ T2465] *** DEADLOCK *** [ 339.410426][ T2465] [ 339.410539][ T2465] 2 locks held by sysctl/2465: [ 339.410620][ T2465] #0: ff110000052643e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 339.410762][ T2465] #1: ffffffff9e48c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 339.410921][ T2465] [ 339.410921][ T2465] the shortest dependencies between 2nd lock and 1st lock: [ 339.411058][ T2465] -> (&ndev->lock){++--}-{3:3} { [ 339.411140][ T2465] HARDIRQ-ON-W at: [ 339.411208][ T2465] __lock_acquire+0x378/0xc10 [ 339.411313][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.411415][ T2465] _raw_write_lock_bh+0x38/0x50 [ 339.411513][ T2465] addrconf_permanent_addr+0x108/0x9c0 [ 339.411631][ T2465] addrconf_notify+0x151/0xf30 [ 339.411729][ T2465] notifier_call_chain+0xb0/0x320 [ 339.411830][ T2465] __dev_notify_flags+0xde/0x280 [ 339.411933][ T2465] netif_change_flags+0xfe/0x190 [ 339.412030][ T2465] do_setlink.isra.0+0x1cc3/0x2750 [ 339.412134][ T2465] rtnl_newlink+0x8d1/0xef0 [ 339.412237][ T2465] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 339.412333][ T2465] netlink_rcv_skb+0x14e/0x3a0 [ 339.412431][ T2465] netlink_unicast+0x486/0x750 [ 339.412529][ T2465] netlink_sendmsg+0x735/0xc60 [ 339.412632][ T2465] ____sys_sendmsg+0x419/0x850 [ 339.412739][ T2465] ___sys_sendmsg+0x14e/0x1d0 [ 339.412838][ T2465] __sys_sendmsg+0x145/0x1f0 [ 339.412940][ T2465] do_syscall_64+0x117/0x590 [ 339.413041][ T2465] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 339.413165][ T2465] HARDIRQ-ON-R at: [ 339.413224][ T2465] __lock_acquire+0x378/0xc10 [ 339.413323][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.413428][ T2465] _raw_read_lock_bh+0x44/0x80 [ 339.413528][ T2465] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 339.413650][ T2465] inet6_fill_link_af+0x5c/0xe0 [ 339.413746][ T2465] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 339.413869][ T2465] rtnl_getlink+0x9c9/0xeb0 [ 339.413963][ T2465] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 339.414061][ T2465] netlink_rcv_skb+0x14e/0x3a0 [ 339.414165][ T2465] netlink_unicast+0x486/0x750 [ 339.414265][ T2465] netlink_sendmsg+0x735/0xc60 [ 339.414361][ T2465] ____sys_sendmsg+0x419/0x850 [ 339.414461][ T2465] ___sys_sendmsg+0x14e/0x1d0 [ 339.414559][ T2465] __sys_sendmsg+0x145/0x1f0 [ 339.414667][ T2465] do_syscall_64+0x117/0x590 [ 339.414767][ T2465] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 339.414882][ T2465] IN-SOFTIRQ-W at: [ 339.414939][ T2465] __lock_acquire+0x378/0xc10 [ 339.415037][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.415140][ T2465] _raw_write_lock+0x33/0x40 [ 339.415237][ T2465] addrconf_rs_timer+0xb0/0x770 [ 339.415333][ T2465] call_timer_fn+0x163/0x4f0 [ 339.415432][ T2465] __run_timers+0x68f/0xab0 [ 339.415529][ T2465] run_timer_softirq+0xf0/0x160 [ 339.415630][ T2465] handle_softirqs+0x1d8/0x940 [ 339.415728][ T2465] __irq_exit_rcu+0x103/0x1c0 [ 339.415821][ T2465] irq_exit_rcu+0xe/0x30 [ 339.415918][ T2465] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 339.416034][ T2465] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 339.416148][ T2465] pv_native_safe_halt+0xf/0x10 [ 339.416246][ T2465] default_idle+0x9/0x10 [ 339.416349][ T2465] default_idle_call+0x6e/0xb0 [ 339.416445][ T2465] cpuidle_idle_call.constprop.0+0x237/0x410 [ 339.416559][ T2465] do_idle+0xf5/0x160 [ 339.416658][ T2465] cpu_startup_entry+0x53/0x70 [ 339.416755][ T2465] start_secondary+0x204/0x2b0 [ 339.416852][ T2465] common_startup_64+0x13e/0x148 [ 339.416948][ T2465] IN-SOFTIRQ-R at: [ 339.417013][ T2465] __lock_acquire+0x378/0xc10 [ 339.417108][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.417212][ T2465] _raw_read_lock_bh+0x44/0x80 [ 339.417311][ T2465] ipv6_get_lladdr+0xa8/0x3f0 [ 339.417407][ T2465] addrconf_rs_timer+0x251/0x770 [ 339.417502][ T2465] call_timer_fn+0x163/0x4f0 [ 339.417609][ T2465] __run_timers+0x68f/0xab0 [ 339.417706][ T2465] run_timer_softirq+0xf0/0x160 [ 339.417810][ T2465] handle_softirqs+0x1d8/0x940 [ 339.417908][ T2465] __irq_exit_rcu+0x103/0x1c0 [ 339.418011][ T2465] irq_exit_rcu+0xe/0x30 [ 339.418105][ T2465] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 339.418220][ T2465] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 339.418337][ T2465] pv_native_safe_halt+0xf/0x10 [ 339.418433][ T2465] default_idle+0x9/0x10 [ 339.418528][ T2465] default_idle_call+0x6e/0xb0 [ 339.418628][ T2465] cpuidle_idle_call.constprop.0+0x237/0x410 [ 339.418743][ T2465] do_idle+0xf5/0x160 [ 339.418841][ T2465] cpu_startup_entry+0x53/0x70 [ 339.418938][ T2465] start_secondary+0x204/0x2b0 [ 339.419034][ T2465] common_startup_64+0x13e/0x148 [ 339.419130][ T2465] INITIAL USE at: [ 339.419189][ T2465] __lock_acquire+0x378/0xc10 [ 339.419285][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.419383][ T2465] _raw_write_lock_bh+0x38/0x50 [ 339.419480][ T2465] addrconf_permanent_addr+0x108/0x9c0 [ 339.419597][ T2465] addrconf_notify+0x151/0xf30 [ 339.419695][ T2465] notifier_call_chain+0xb0/0x320 [ 339.419791][ T2465] __dev_notify_flags+0xde/0x280 [ 339.419891][ T2465] netif_change_flags+0xfe/0x190 [ 339.419991][ T2465] do_setlink.isra.0+0x1cc3/0x2750 [ 339.420087][ T2465] rtnl_newlink+0x8d1/0xef0 [ 339.420186][ T2465] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 339.420281][ T2465] netlink_rcv_skb+0x14e/0x3a0 [ 339.420376][ T2465] netlink_unicast+0x486/0x750 [ 339.420473][ T2465] netlink_sendmsg+0x735/0xc60 [ 339.420567][ T2465] ____sys_sendmsg+0x419/0x850 [ 339.420666][ T2465] ___sys_sendmsg+0x14e/0x1d0 [ 339.420775][ T2465] __sys_sendmsg+0x145/0x1f0 [ 339.420876][ T2465] do_syscall_64+0x117/0x590 [ 339.420979][ T2465] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 339.421094][ T2465] INITIAL READ USE at: [ 339.421171][ T2465] __lock_acquire+0x378/0xc10 [ 339.421265][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.421384][ T2465] _raw_read_lock_bh+0x44/0x80 [ 339.421480][ T2465] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 339.421599][ T2465] inet6_fill_link_af+0x5c/0xe0 [ 339.421695][ T2465] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 339.421809][ T2465] rtnl_getlink+0x9c9/0xeb0 [ 339.421905][ T2465] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 339.422001][ T2465] netlink_rcv_skb+0x14e/0x3a0 [ 339.422099][ T2465] netlink_unicast+0x486/0x750 [ 339.422194][ T2465] netlink_sendmsg+0x735/0xc60 [ 339.422289][ T2465] ____sys_sendmsg+0x419/0x850 [ 339.422385][ T2465] ___sys_sendmsg+0x14e/0x1d0 [ 339.422480][ T2465] __sys_sendmsg+0x145/0x1f0 [ 339.422576][ T2465] do_syscall_64+0x117/0x590 [ 339.422673][ T2465] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 339.422787][ T2465] } [ 339.422828][ T2465] ... key at: [] __key.37+0x0/0x40 [ 339.422946][ T2465] ... acquired at: [ 339.423009][ T2465] __lock_acquire+0x508/0xc10 [ 339.423087][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.423163][ T2465] _raw_spin_lock+0x33/0x40 [ 339.423241][ T2465] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 339.423335][ T2465] __ipv6_dev_ac_inc+0x57e/0x930 [ 339.423411][ T2465] addrconf_join_anycast+0x1bc/0x260 [ 339.423496][ T2465] dev_forward_change+0x2be/0x850 [ 339.423582][ T2465] addrconf_fixup_forwarding+0x2af/0x4d0 [ 339.423680][ T2465] addrconf_sysctl_forward+0x209/0x2b0 [ 339.423756][ T2465] proc_sys_call_handler+0x31b/0x480 [ 339.423835][ T2465] new_sync_write+0x333/0x750 [ 339.423919][ T2465] vfs_write+0x6a4/0xc10 [ 339.423997][ T2465] ksys_write+0x116/0x250 [ 339.424072][ T2465] do_syscall_64+0x117/0x590 [ 339.424149][ T2465] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 339.424251][ T2465] [ 339.424289][ T2465] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 339.424371][ T2465] HARDIRQ-ON-W at: [ 339.424430][ T2465] __lock_acquire+0x378/0xc10 [ 339.424526][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.424632][ T2465] _raw_spin_lock+0x33/0x40 [ 339.424730][ T2465] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 339.424843][ T2465] __ipv6_dev_ac_inc+0x57e/0x930 [ 339.424941][ T2465] addrconf_join_anycast+0x1bc/0x260 [ 339.425044][ T2465] dev_forward_change+0x2be/0x850 [ 339.425140][ T2465] addrconf_fixup_forwarding+0x2af/0x4d0 [ 339.425255][ T2465] addrconf_sysctl_forward+0x209/0x2b0 [ 339.425350][ T2465] proc_sys_call_handler+0x31b/0x480 [ 339.425446][ T2465] new_sync_write+0x333/0x750 [ 339.425545][ T2465] vfs_write+0x6a4/0xc10 [ 339.425645][ T2465] ksys_write+0x116/0x250 [ 339.425741][ T2465] do_syscall_64+0x117/0x590 [ 339.425838][ T2465] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 339.425961][ T2465] SOFTIRQ-ON-W at: [ 339.426019][ T2465] __lock_acquire+0x378/0xc10 [ 339.426114][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.426209][ T2465] _raw_spin_lock+0x33/0x40 [ 339.426304][ T2465] __ipv6_dev_ac_dec+0x236/0x5d0 [ 339.426402][ T2465] addrconf_leave_anycast+0x1bc/0x260 [ 339.426497][ T2465] dev_forward_change+0x3b3/0x850 [ 339.426595][ T2465] addrconf_fixup_forwarding+0x2af/0x4d0 [ 339.426710][ T2465] addrconf_sysctl_forward+0x209/0x2b0 [ 339.426806][ T2465] proc_sys_call_handler+0x31b/0x480 [ 339.426903][ T2465] new_sync_write+0x333/0x750 [ 339.426999][ T2465] vfs_write+0x6a4/0xc10 [ 339.427093][ T2465] ksys_write+0x116/0x250 [ 339.427188][ T2465] do_syscall_64+0x117/0x590 [ 339.427289][ T2465] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 339.427406][ T2465] INITIAL USE at: [ 339.427465][ T2465] __lock_acquire+0x378/0xc10 [ 339.427613][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.427713][ T2465] _raw_spin_lock+0x33/0x40 [ 339.427808][ T2465] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 339.427963][ T2465] __ipv6_dev_ac_inc+0x57e/0x930 [ 339.428060][ T2465] addrconf_join_anycast+0x1bc/0x260 [ 339.428163][ T2465] dev_forward_change+0x2be/0x850 [ 339.428299][ T2465] addrconf_fixup_forwarding+0x2af/0x4d0 [ 339.428414][ T2465] addrconf_sysctl_forward+0x209/0x2b0 [ 339.428509][ T2465] proc_sys_call_handler+0x31b/0x480 [ 339.428650][ T2465] new_sync_write+0x333/0x750 [ 339.428746][ T2465] vfs_write+0x6a4/0xc10 [ 339.428842][ T2465] ksys_write+0x116/0x250 [ 339.428978][ T2465] do_syscall_64+0x117/0x590 [ 339.429073][ T2465] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 339.429189][ T2465] } [ 339.429228][ T2465] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 339.429386][ T2465] ... acquired at: [ 339.429443][ T2465] mark_lock+0x1d7/0xa00 [ 339.429520][ T2465] mark_usage+0x105/0x170 [ 339.429600][ T2465] __lock_acquire+0x378/0xc10 [ 339.429720][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.429796][ T2465] _raw_spin_lock+0x33/0x40 [ 339.429880][ T2465] __ipv6_dev_ac_dec+0x236/0x5d0 [ 339.429966][ T2465] addrconf_leave_anycast+0x1bc/0x260 [ 339.430086][ T2465] dev_forward_change+0x3b3/0x850 [ 339.430163][ T2465] addrconf_fixup_forwarding+0x2af/0x4d0 [ 339.430258][ T2465] addrconf_sysctl_forward+0x209/0x2b0 [ 339.430334][ T2465] proc_sys_call_handler+0x31b/0x480 [ 339.430451][ T2465] new_sync_write+0x333/0x750 [ 339.430535][ T2465] vfs_write+0x6a4/0xc10 [ 339.430615][ T2465] ksys_write+0x116/0x250 [ 339.430690][ T2465] do_syscall_64+0x117/0x590 [ 339.430805][ T2465] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 339.430907][ T2465] [ 339.430947][ T2465] [ 339.430947][ T2465] stack backtrace: [ 339.431044][ T2465] CPU: 3 UID: 0 PID: 2465 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 339.431047][ T2465] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 339.431048][ T2465] Call Trace: [ 339.431050][ T2465] [ 339.431051][ T2465] dump_stack_lvl+0x6f/0xa0 [ 339.431056][ T2465] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 339.431059][ T2465] mark_lock_irq+0x989/0x9c0 [ 339.431061][ T2465] mark_lock+0x1d7/0xa00 [ 339.431063][ T2465] mark_usage+0x105/0x170 [ 339.431065][ T2465] __lock_acquire+0x378/0xc10 [ 339.431067][ T2465] lock_acquire.part.0+0xbc/0x260 [ 339.431068][ T2465] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 339.431070][ T2465] ? rcu_is_watching+0x15/0xd0 [ 339.431072][ T2465] ? do_raw_read_unlock+0x70/0x70 [ 339.431074][ T2465] ? lock_acquire+0x134/0x160 [ 339.431076][ T2465] _raw_spin_lock+0x33/0x40 [ 339.431078][ T2465] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 339.431079][ T2465] __ipv6_dev_ac_dec+0x236/0x5d0 [ 339.431081][ T2465] addrconf_leave_anycast+0x1bc/0x260 [ 339.431083][ T2465] ? find_held_lock+0x2b/0x80 [ 339.431085][ T2465] ? __ipv6_isatap_ifid+0x210/0x210 [ 339.431087][ T2465] ? mark_held_locks+0x40/0x70 [ 339.431089][ T2465] ? lockdep_hardirqs_on+0x8c/0x130 [ 339.431091][ T2465] dev_forward_change+0x3b3/0x850 [ 339.431093][ T2465] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 339.431094][ T2465] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 339.431097][ T2465] addrconf_fixup_forwarding+0x2af/0x4d0 [ 339.431099][ T2465] addrconf_sysctl_forward+0x209/0x2b0 [ 339.431101][ T2465] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 339.431104][ T2465] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 339.431106][ T2465] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 339.431109][ T2465] ? proc_sys_call_handler+0x25d/0x480 [ 339.431111][ T2465] proc_sys_call_handler+0x31b/0x480 [ 339.431113][ T2465] ? proc_sys_lookup+0x3d0/0x3d0 [ 339.431115][ T2465] ? rcu_read_unlock+0x1b/0x70 [ 339.431117][ T2465] ? do_raw_spin_unlock+0x59/0x250 [ 339.431119][ T2465] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 339.431121][ T2465] ? rcu_read_lock_any_held+0x3c/0x90 [ 339.431122][ T2465] ? proc_sys_call_handler+0x480/0x480 [ 339.431124][ T2465] new_sync_write+0x333/0x750 [ 339.431126][ T2465] ? __lock_acquire+0x508/0xc10 [ 339.431127][ T2465] ? new_sync_read+0x740/0x740 [ 339.431129][ T2465] ? lock_acquire.part.0+0xbc/0x260 [ 339.431130][ T2465] ? ksys_write+0x116/0x250 [ 339.431132][ T2465] vfs_write+0x6a4/0xc10 [ 339.431134][ T2465] ksys_write+0x116/0x250 [ 339.431136][ T2465] ? __ia32_sys_read+0xc0/0xc0 [ 339.431137][ T2465] ? rcu_is_watching+0x15/0xd0 [ 339.431138][ T2465] ? rcu_is_watching+0x15/0xd0 [ 339.431140][ T2465] do_syscall_64+0x117/0x590 [ 339.431142][ T2465] ? trace_hardirqs_off+0xd/0x30 [ 339.431145][ T2465] ? exc_page_fault+0xee/0x100 [ 339.431146][ T2465] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 339.431148][ T2465] RIP: 0033:0x7fa60bc5808e [ 339.431150][ T2465] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 339.431152][ T2465] RSP: 002b:00007ffc395f1200 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 339.431155][ T2465] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007fa60bc5808e [ 339.431156][ T2465] RDX: 0000000000000002 RSI: 000055bca67754b0 RDI: 0000000000000005 [ 339.431157][ T2465] RBP: 00007ffc395f1210 R08: 0000000000000000 R09: 0000000000000000 [ 339.431158][ T2465] R10: 0000000000000000 R11: 0000000000000202 R12: 000055bca67775e0 [ 339.431159][ T2465] R13: 000055bca6775470 R14: 0000000000000002 R15: 0000000000000000 [ 339.431161][ T2465]