[ 8.867104][ T186] ip (186) used greatest stack depth: 24240 bytes left [ 9.020573][ T197] ip (197) used greatest stack depth: 24128 bytes left [ 10.234422][ T246] 8021q: 802.1Q VLAN Support v1.8 [ 10.542157][ T258] gre: GRE over IPv4 demultiplexer driver [ 10.554915][ T258] ip_gre: GRE over IPv4 tunneling driver [ 12.081113][ T319] GACT probability NOT on [ 30.956518][ T473] [ 30.956629][ T473] ======================================================== [ 30.956802][ T473] WARNING: possible irq lock inversion dependency detected [ 30.956967][ T473] 7.1.0-rc5-virtme #1 Not tainted [ 30.957082][ T473] -------------------------------------------------------- [ 30.957245][ T473] sysctl/473 just changed the state of lock: [ 30.957392][ T473] ffffffffa0f7e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 30.957608][ T473] but this lock was taken by another, SOFTIRQ-safe lock in the past: [ 30.957776][ T473] (&ndev->lock){++-.}-{3:3} [ 30.957780][ T473] [ 30.957780][ T473] [ 30.957780][ T473] and interrupts could create inverse lock ordering between them. [ 30.957780][ T473] [ 30.958181][ T473] [ 30.958181][ T473] other info that might help us debug this: [ 30.958348][ T473] Possible interrupt unsafe locking scenario: [ 30.958348][ T473] [ 30.958518][ T473] CPU0 CPU1 [ 30.958630][ T473] ---- ---- [ 30.958739][ T473] lock(acaddr_hash_lock); [ 30.958851][ T473] local_irq_disable(); [ 30.958979][ T473] lock(&ndev->lock); [ 30.959116][ T473] lock(acaddr_hash_lock); [ 30.959253][ T473] [ 30.959334][ T473] lock(&ndev->lock); [ 30.959426][ T473] [ 30.959426][ T473] *** DEADLOCK *** [ 30.959426][ T473] [ 30.959589][ T473] 2 locks held by sysctl/473: [ 30.959700][ T473] #0: ff11000010c6c3e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 30.959900][ T473] #1: ffffffffa0e8c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 30.960122][ T473] [ 30.960122][ T473] the shortest dependencies between 2nd lock and 1st lock: [ 30.960311][ T473] -> (&ndev->lock){++-.}-{3:3} { [ 30.960434][ T473] HARDIRQ-ON-W at: [ 30.960523][ T473] __lock_acquire+0x378/0xc10 [ 30.960669][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.960807][ T473] _raw_write_lock_bh+0x38/0x50 [ 30.960947][ T473] addrconf_permanent_addr+0x108/0x9c0 [ 30.961112][ T473] addrconf_notify+0x151/0xf30 [ 30.961261][ T473] notifier_call_chain+0xb0/0x320 [ 30.961411][ T473] __dev_notify_flags+0xde/0x280 [ 30.961552][ T473] netif_change_flags+0xfe/0x190 [ 30.961690][ T473] do_setlink.isra.0+0x1cc3/0x2750 [ 30.961836][ T473] rtnl_newlink+0x8d1/0xef0 [ 30.961978][ T473] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 30.962120][ T473] netlink_rcv_skb+0x14e/0x3a0 [ 30.962262][ T473] netlink_unicast+0x486/0x750 [ 30.962405][ T473] netlink_sendmsg+0x735/0xc60 [ 30.962547][ T473] ____sys_sendmsg+0x419/0x850 [ 30.962692][ T473] ___sys_sendmsg+0x14e/0x1d0 [ 30.962834][ T473] __sys_sendmsg+0x145/0x1f0 [ 30.962975][ T473] do_syscall_64+0x117/0x590 [ 30.963120][ T473] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 30.963290][ T473] HARDIRQ-ON-R at: [ 30.963380][ T473] __lock_acquire+0x378/0xc10 [ 30.963520][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.963664][ T473] _raw_read_lock_bh+0x44/0x80 [ 30.963804][ T473] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 30.963972][ T473] inet6_fill_link_af+0x5c/0xe0 [ 30.964115][ T473] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 30.964285][ T473] rtnl_getlink+0x9c9/0xeb0 [ 30.964432][ T473] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 30.964576][ T473] netlink_rcv_skb+0x14e/0x3a0 [ 30.964720][ T473] netlink_unicast+0x486/0x750 [ 30.964860][ T473] netlink_sendmsg+0x735/0xc60 [ 30.964998][ T473] ____sys_sendmsg+0x419/0x850 [ 30.965137][ T473] ___sys_sendmsg+0x14e/0x1d0 [ 30.965279][ T473] __sys_sendmsg+0x145/0x1f0 [ 30.965426][ T473] do_syscall_64+0x117/0x590 [ 30.965565][ T473] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 30.965731][ T473] IN-SOFTIRQ-W at: [ 30.965817][ T473] __lock_acquire+0x378/0xc10 [ 30.965956][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.966095][ T473] _raw_write_lock+0x33/0x40 [ 30.966235][ T473] addrconf_rs_timer+0xb0/0x770 [ 30.966382][ T473] call_timer_fn+0x163/0x4f0 [ 30.966524][ T473] __run_timers+0x68f/0xab0 [ 30.966663][ T473] run_timer_softirq+0xf0/0x160 [ 30.966803][ T473] handle_softirqs+0x1d8/0x940 [ 30.966944][ T473] __irq_exit_rcu+0x103/0x1c0 [ 30.967088][ T473] irq_exit_rcu+0xe/0x30 [ 30.967229][ T473] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 30.967403][ T473] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 30.967571][ T473] pv_native_safe_halt+0xf/0x10 [ 30.967711][ T473] default_idle+0x9/0x10 [ 30.967852][ T473] default_idle_call+0x6e/0xb0 [ 30.967991][ T473] cpuidle_idle_call.constprop.0+0x237/0x410 [ 30.968159][ T473] do_idle+0xf5/0x160 [ 30.968299][ T473] cpu_startup_entry+0x53/0x70 [ 30.968443][ T473] start_secondary+0x204/0x2b0 [ 30.968587][ T473] common_startup_64+0x13e/0x148 [ 30.968729][ T473] INITIAL USE at: [ 30.968813][ T473] __lock_acquire+0x378/0xc10 [ 30.968953][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.969093][ T473] _raw_write_lock_bh+0x38/0x50 [ 30.969235][ T473] addrconf_permanent_addr+0x108/0x9c0 [ 30.969409][ T473] addrconf_notify+0x151/0xf30 [ 30.969550][ T473] notifier_call_chain+0xb0/0x320 [ 30.969691][ T473] __dev_notify_flags+0xde/0x280 [ 30.969831][ T473] netif_change_flags+0xfe/0x190 [ 30.969969][ T473] do_setlink.isra.0+0x1cc3/0x2750 [ 30.970109][ T473] rtnl_newlink+0x8d1/0xef0 [ 30.970249][ T473] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 30.970393][ T473] netlink_rcv_skb+0x14e/0x3a0 [ 30.970535][ T473] netlink_unicast+0x486/0x750 [ 30.970675][ T473] netlink_sendmsg+0x735/0xc60 [ 30.970817][ T473] ____sys_sendmsg+0x419/0x850 [ 30.970957][ T473] ___sys_sendmsg+0x14e/0x1d0 [ 30.971097][ T473] __sys_sendmsg+0x145/0x1f0 [ 30.971237][ T473] do_syscall_64+0x117/0x590 [ 30.971381][ T473] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 30.971548][ T473] INITIAL READ USE at: [ 30.971663][ T473] __lock_acquire+0x378/0xc10 [ 30.971803][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.971971][ T473] _raw_read_lock_bh+0x44/0x80 [ 30.972112][ T473] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 30.972279][ T473] inet6_fill_link_af+0x5c/0xe0 [ 30.972423][ T473] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 30.972587][ T473] rtnl_getlink+0x9c9/0xeb0 [ 30.972727][ T473] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 30.972866][ T473] netlink_rcv_skb+0x14e/0x3a0 [ 30.973006][ T473] netlink_unicast+0x486/0x750 [ 30.973149][ T473] netlink_sendmsg+0x735/0xc60 [ 30.973287][ T473] ____sys_sendmsg+0x419/0x850 [ 30.973431][ T473] ___sys_sendmsg+0x14e/0x1d0 [ 30.973571][ T473] __sys_sendmsg+0x145/0x1f0 [ 30.973709][ T473] do_syscall_64+0x117/0x590 [ 30.973852][ T473] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 30.974018][ T473] } [ 30.974076][ T473] ... key at: [] __key.37+0x0/0x40 [ 30.974247][ T473] ... acquired at: [ 30.974336][ T473] __lock_acquire+0x508/0xc10 [ 30.974452][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.974566][ T473] _raw_spin_lock+0x33/0x40 [ 30.974678][ T473] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 30.974816][ T473] __ipv6_dev_ac_inc+0x57e/0x930 [ 30.974927][ T473] addrconf_join_anycast+0x1bc/0x260 [ 30.975037][ T473] dev_forward_change+0x2be/0x850 [ 30.975150][ T473] addrconf_fixup_forwarding+0x2af/0x4d0 [ 30.975286][ T473] addrconf_sysctl_forward+0x209/0x2b0 [ 30.975404][ T473] proc_sys_call_handler+0x31b/0x480 [ 30.975518][ T473] new_sync_write+0x333/0x750 [ 30.975633][ T473] vfs_write+0x6a4/0xc10 [ 30.975742][ T473] ksys_write+0x116/0x250 [ 30.975851][ T473] do_syscall_64+0x117/0x590 [ 30.975961][ T473] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 30.976096][ T473] [ 30.976153][ T473] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 30.976270][ T473] HARDIRQ-ON-W at: [ 30.976353][ T473] __lock_acquire+0x378/0xc10 [ 30.976495][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.976632][ T473] _raw_spin_lock+0x33/0x40 [ 30.976772][ T473] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 30.976939][ T473] __ipv6_dev_ac_inc+0x57e/0x930 [ 30.977082][ T473] addrconf_join_anycast+0x1bc/0x260 [ 30.977221][ T473] dev_forward_change+0x2be/0x850 [ 30.977364][ T473] addrconf_fixup_forwarding+0x2af/0x4d0 [ 30.977531][ T473] addrconf_sysctl_forward+0x209/0x2b0 [ 30.977672][ T473] proc_sys_call_handler+0x31b/0x480 [ 30.977815][ T473] new_sync_write+0x333/0x750 [ 30.977957][ T473] vfs_write+0x6a4/0xc10 [ 30.978095][ T473] ksys_write+0x116/0x250 [ 30.978235][ T473] do_syscall_64+0x117/0x590 [ 30.978380][ T473] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 30.978549][ T473] SOFTIRQ-ON-W at: [ 30.978633][ T473] __lock_acquire+0x378/0xc10 [ 30.978771][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.978911][ T473] _raw_spin_lock+0x33/0x40 [ 30.979050][ T473] __ipv6_dev_ac_dec+0x236/0x5d0 [ 30.979189][ T473] addrconf_leave_anycast+0x1bc/0x260 [ 30.979329][ T473] dev_forward_change+0x3b3/0x850 [ 30.979474][ T473] addrconf_fixup_forwarding+0x2af/0x4d0 [ 30.979641][ T473] addrconf_sysctl_forward+0x209/0x2b0 [ 30.979779][ T473] proc_sys_call_handler+0x31b/0x480 [ 30.979921][ T473] new_sync_write+0x333/0x750 [ 30.980062][ T473] vfs_write+0x6a4/0xc10 [ 30.980204][ T473] ksys_write+0x116/0x250 [ 30.980344][ T473] do_syscall_64+0x117/0x590 [ 30.980488][ T473] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 30.980656][ T473] INITIAL USE at: [ 30.980742][ T473] __lock_acquire+0x378/0xc10 [ 30.980881][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.981022][ T473] _raw_spin_lock+0x33/0x40 [ 30.981162][ T473] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 30.981329][ T473] __ipv6_dev_ac_inc+0x57e/0x930 [ 30.981471][ T473] addrconf_join_anycast+0x1bc/0x260 [ 30.981611][ T473] dev_forward_change+0x2be/0x850 [ 30.981752][ T473] addrconf_fixup_forwarding+0x2af/0x4d0 [ 30.981917][ T473] addrconf_sysctl_forward+0x209/0x2b0 [ 30.982056][ T473] proc_sys_call_handler+0x31b/0x480 [ 30.982196][ T473] new_sync_write+0x333/0x750 [ 30.982335][ T473] vfs_write+0x6a4/0xc10 [ 30.982481][ T473] ksys_write+0x116/0x250 [ 30.982618][ T473] do_syscall_64+0x117/0x590 [ 30.982755][ T473] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 30.982919][ T473] } [ 30.982976][ T473] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 30.983145][ T473] ... acquired at: [ 30.983231][ T473] mark_lock+0x1d7/0xa00 [ 30.983341][ T473] mark_usage+0x105/0x170 [ 30.983455][ T473] __lock_acquire+0x378/0xc10 [ 30.983566][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.983675][ T473] _raw_spin_lock+0x33/0x40 [ 30.983786][ T473] __ipv6_dev_ac_dec+0x236/0x5d0 [ 30.983896][ T473] addrconf_leave_anycast+0x1bc/0x260 [ 30.984006][ T473] dev_forward_change+0x3b3/0x850 [ 30.984119][ T473] addrconf_fixup_forwarding+0x2af/0x4d0 [ 30.984256][ T473] addrconf_sysctl_forward+0x209/0x2b0 [ 30.984371][ T473] proc_sys_call_handler+0x31b/0x480 [ 30.984483][ T473] new_sync_write+0x333/0x750 [ 30.984594][ T473] vfs_write+0x6a4/0xc10 [ 30.984705][ T473] ksys_write+0x116/0x250 [ 30.984816][ T473] do_syscall_64+0x117/0x590 [ 30.984929][ T473] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 30.985066][ T473] [ 30.985123][ T473] [ 30.985123][ T473] stack backtrace: [ 30.985263][ T473] CPU: 2 UID: 0 PID: 473 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 30.985267][ T473] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 30.985270][ T473] Call Trace: [ 30.985272][ T473] [ 30.985274][ T473] dump_stack_lvl+0x6f/0xa0 [ 30.985280][ T473] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 30.985285][ T473] mark_lock_irq+0x989/0x9c0 [ 30.985289][ T473] mark_lock+0x1d7/0xa00 [ 30.985292][ T473] mark_usage+0x105/0x170 [ 30.985295][ T473] __lock_acquire+0x378/0xc10 [ 30.985298][ T473] lock_acquire.part.0+0xbc/0x260 [ 30.985301][ T473] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 30.985303][ T473] ? rcu_is_watching+0x15/0xd0 [ 30.985307][ T473] ? do_raw_read_unlock+0x70/0x70 [ 30.985309][ T473] ? lock_acquire+0x134/0x160 [ 30.985312][ T473] _raw_spin_lock+0x33/0x40 [ 30.985315][ T473] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 30.985317][ T473] __ipv6_dev_ac_dec+0x236/0x5d0 [ 30.985321][ T473] addrconf_leave_anycast+0x1bc/0x260 [ 30.985323][ T473] ? find_held_lock+0x2b/0x80 [ 30.985327][ T473] ? __ipv6_isatap_ifid+0x210/0x210 [ 30.985329][ T473] ? mark_held_locks+0x40/0x70 [ 30.985332][ T473] ? lockdep_hardirqs_on+0x8c/0x130 [ 30.985335][ T473] dev_forward_change+0x3b3/0x850 [ 30.985338][ T473] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 30.985341][ T473] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 30.985346][ T473] addrconf_fixup_forwarding+0x2af/0x4d0 [ 30.985350][ T473] addrconf_sysctl_forward+0x209/0x2b0 [ 30.985353][ T473] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 30.985356][ T473] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 30.985363][ T473] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 30.985367][ T473] ? proc_sys_call_handler+0x25d/0x480 [ 30.985371][ T473] proc_sys_call_handler+0x31b/0x480 [ 30.985374][ T473] ? proc_sys_lookup+0x3d0/0x3d0 [ 30.985377][ T473] ? do_fault_around+0x300/0x5a0 [ 30.985380][ T473] ? find_held_lock+0x2b/0x80 [ 30.985383][ T473] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 30.985386][ T473] ? rcu_read_lock_any_held+0x3c/0x90 [ 30.985389][ T473] ? proc_sys_call_handler+0x480/0x480 [ 30.985392][ T473] new_sync_write+0x333/0x750 [ 30.985395][ T473] ? __lock_acquire+0x508/0xc10 [ 30.985397][ T473] ? new_sync_read+0x740/0x740 [ 30.985400][ T473] ? lock_acquire.part.0+0xbc/0x260 [ 30.985402][ T473] ? ksys_write+0x116/0x250 [ 30.985406][ T473] vfs_write+0x6a4/0xc10 [ 30.985409][ T473] ksys_write+0x116/0x250 [ 30.985412][ T473] ? __ia32_sys_read+0xc0/0xc0 [ 30.985414][ T473] ? rcu_is_watching+0x15/0xd0 [ 30.985416][ T473] ? rcu_is_watching+0x15/0xd0 [ 30.985419][ T473] do_syscall_64+0x117/0x590 [ 30.985422][ T473] ? trace_hardirqs_off+0xd/0x30 [ 30.985425][ T473] ? exc_page_fault+0xee/0x100 [ 30.985428][ T473] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 30.985431][ T473] RIP: 0033:0x7f9ad780408e [ 30.985434][ T473] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 30.985437][ T473] RSP: 002b:00007ffdc042d6c0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 30.985441][ T473] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f9ad780408e [ 30.985443][ T473] RDX: 0000000000000002 RSI: 0000557c247224b0 RDI: 0000000000000005 [ 30.985444][ T473] RBP: 00007ffdc042d6d0 R08: 0000000000000000 R09: 0000000000000000 [ 30.985446][ T473] R10: 0000000000000000 R11: 0000000000000202 R12: 0000557c247245e0 [ 30.985447][ T473] R13: 0000557c24722470 R14: 0000000000000002 R15: 0000000000000000 [ 30.985451][ T473]