[ 8.335325][ T185] ip (185) used greatest stack depth: 24496 bytes left [ 8.454241][ T191] ip (191) used greatest stack depth: 24488 bytes left [ 9.463629][ T235] 8021q: 802.1Q VLAN Support v1.8 [ 9.697983][ T247] gre: GRE over IPv4 demultiplexer driver [ 9.711269][ T247] ip_gre: GRE over IPv4 tunneling driver [ 9.769413][ T251] ip (251) used greatest stack depth: 24240 bytes left [ 10.570981][ T290] ip (290) used greatest stack depth: 23840 bytes left [ 10.962340][ T306] GACT probability NOT on [ 29.085502][ T460] [ 29.085586][ T460] ======================================================== [ 29.085708][ T460] WARNING: possible irq lock inversion dependency detected [ 29.085827][ T460] 7.1.0-rc5-virtme #1 Not tainted [ 29.085906][ T460] -------------------------------------------------------- [ 29.086027][ T460] sysctl/460 just changed the state of lock: [ 29.086124][ T460] ffffffffa977e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 29.086274][ T460] but this lock was taken by another, SOFTIRQ-safe lock in the past: [ 29.086394][ T460] (&ndev->lock){++-.}-{3:3} [ 29.086397][ T460] [ 29.086397][ T460] [ 29.086397][ T460] and interrupts could create inverse lock ordering between them. [ 29.086397][ T460] [ 29.086690][ T460] [ 29.086690][ T460] other info that might help us debug this: [ 29.086811][ T460] Possible interrupt unsafe locking scenario: [ 29.086811][ T460] [ 29.086928][ T460] CPU0 CPU1 [ 29.087011][ T460] ---- ---- [ 29.087094][ T460] lock(acaddr_hash_lock); [ 29.087173][ T460] local_irq_disable(); [ 29.087275][ T460] lock(&ndev->lock); [ 29.087377][ T460] lock(acaddr_hash_lock); [ 29.087473][ T460] [ 29.087534][ T460] lock(&ndev->lock); [ 29.087596][ T460] [ 29.087596][ T460] *** DEADLOCK *** [ 29.087596][ T460] [ 29.087718][ T460] 2 locks held by sysctl/460: [ 29.087801][ T460] #0: ff1100000a0543e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 29.087951][ T460] #1: ffffffffa968c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 29.088121][ T460] [ 29.088121][ T460] the shortest dependencies between 2nd lock and 1st lock: [ 29.088255][ T460] -> (&ndev->lock){++-.}-{3:3} { [ 29.088337][ T460] HARDIRQ-ON-W at: [ 29.088402][ T460] __lock_acquire+0x378/0xc10 [ 29.088506][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.088604][ T460] _raw_write_lock_bh+0x38/0x50 [ 29.088704][ T460] addrconf_permanent_addr+0x108/0x9c0 [ 29.088826][ T460] addrconf_notify+0x151/0xf30 [ 29.088929][ T460] notifier_call_chain+0xb0/0x320 [ 29.089031][ T460] __dev_notify_flags+0xde/0x280 [ 29.089137][ T460] netif_change_flags+0xfe/0x190 [ 29.089238][ T460] do_setlink.isra.0+0x1cc3/0x2750 [ 29.089335][ T460] rtnl_newlink+0x8d1/0xef0 [ 29.089434][ T460] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 29.089538][ T460] netlink_rcv_skb+0x14e/0x3a0 [ 29.089641][ T460] netlink_unicast+0x486/0x750 [ 29.089739][ T460] netlink_sendmsg+0x735/0xc60 [ 29.089842][ T460] ____sys_sendmsg+0x419/0x850 [ 29.089955][ T460] ___sys_sendmsg+0x14e/0x1d0 [ 29.090058][ T460] __sys_sendmsg+0x145/0x1f0 [ 29.090162][ T460] do_syscall_64+0x117/0x590 [ 29.090262][ T460] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 29.090381][ T460] HARDIRQ-ON-R at: [ 29.090440][ T460] __lock_acquire+0x378/0xc10 [ 29.090536][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.090636][ T460] _raw_read_lock_bh+0x44/0x80 [ 29.090735][ T460] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 29.090861][ T460] inet6_fill_link_af+0x5c/0xe0 [ 29.090970][ T460] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 29.091093][ T460] rtnl_getlink+0x9c9/0xeb0 [ 29.091196][ T460] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 29.091298][ T460] netlink_rcv_skb+0x14e/0x3a0 [ 29.091400][ T460] netlink_unicast+0x486/0x750 [ 29.091496][ T460] netlink_sendmsg+0x735/0xc60 [ 29.091596][ T460] ____sys_sendmsg+0x419/0x850 [ 29.091700][ T460] ___sys_sendmsg+0x14e/0x1d0 [ 29.091796][ T460] __sys_sendmsg+0x145/0x1f0 [ 29.091894][ T460] do_syscall_64+0x117/0x590 [ 29.091998][ T460] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 29.092120][ T460] IN-SOFTIRQ-W at: [ 29.092179][ T460] __lock_acquire+0x378/0xc10 [ 29.092277][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.092373][ T460] _raw_write_lock+0x33/0x40 [ 29.092471][ T460] addrconf_rs_timer+0xb0/0x770 [ 29.092575][ T460] call_timer_fn+0x163/0x4f0 [ 29.092672][ T460] __run_timers+0x68f/0xab0 [ 29.092769][ T460] run_timer_softirq+0xf0/0x160 [ 29.092867][ T460] handle_softirqs+0x1d8/0x940 [ 29.092966][ T460] __irq_exit_rcu+0x103/0x1c0 [ 29.093064][ T460] irq_exit_rcu+0xe/0x30 [ 29.093160][ T460] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 29.093274][ T460] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 29.093389][ T460] pv_native_safe_halt+0xf/0x10 [ 29.093486][ T460] default_idle+0x9/0x10 [ 29.093582][ T460] default_idle_call+0x6e/0xb0 [ 29.093680][ T460] cpuidle_idle_call.constprop.0+0x237/0x410 [ 29.093797][ T460] do_idle+0xf5/0x160 [ 29.093894][ T460] cpu_startup_entry+0x53/0x70 [ 29.093994][ T460] start_secondary+0x204/0x2b0 [ 29.094092][ T460] common_startup_64+0x13e/0x148 [ 29.094193][ T460] INITIAL USE at: [ 29.094250][ T460] __lock_acquire+0x378/0xc10 [ 29.094347][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.094444][ T460] _raw_write_lock_bh+0x38/0x50 [ 29.094540][ T460] addrconf_permanent_addr+0x108/0x9c0 [ 29.094663][ T460] addrconf_notify+0x151/0xf30 [ 29.094760][ T460] notifier_call_chain+0xb0/0x320 [ 29.094857][ T460] __dev_notify_flags+0xde/0x280 [ 29.094964][ T460] netif_change_flags+0xfe/0x190 [ 29.095059][ T460] do_setlink.isra.0+0x1cc3/0x2750 [ 29.095158][ T460] rtnl_newlink+0x8d1/0xef0 [ 29.095253][ T460] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 29.095349][ T460] netlink_rcv_skb+0x14e/0x3a0 [ 29.095446][ T460] netlink_unicast+0x486/0x750 [ 29.095547][ T460] netlink_sendmsg+0x735/0xc60 [ 29.095644][ T460] ____sys_sendmsg+0x419/0x850 [ 29.095743][ T460] ___sys_sendmsg+0x14e/0x1d0 [ 29.095848][ T460] __sys_sendmsg+0x145/0x1f0 [ 29.095943][ T460] do_syscall_64+0x117/0x590 [ 29.096039][ T460] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 29.096157][ T460] INITIAL READ USE at: [ 29.096233][ T460] __lock_acquire+0x378/0xc10 [ 29.096331][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.096446][ T460] _raw_read_lock_bh+0x44/0x80 [ 29.096542][ T460] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 29.096661][ T460] inet6_fill_link_af+0x5c/0xe0 [ 29.096760][ T460] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 29.096877][ T460] rtnl_getlink+0x9c9/0xeb0 [ 29.096979][ T460] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 29.097076][ T460] netlink_rcv_skb+0x14e/0x3a0 [ 29.097174][ T460] netlink_unicast+0x486/0x750 [ 29.097270][ T460] netlink_sendmsg+0x735/0xc60 [ 29.097367][ T460] ____sys_sendmsg+0x419/0x850 [ 29.097463][ T460] ___sys_sendmsg+0x14e/0x1d0 [ 29.097559][ T460] __sys_sendmsg+0x145/0x1f0 [ 29.097656][ T460] do_syscall_64+0x117/0x590 [ 29.097760][ T460] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 29.097878][ T460] } [ 29.097918][ T460] ... key at: [] __key.37+0x0/0x40 [ 29.098047][ T460] ... acquired at: [ 29.098107][ T460] __lock_acquire+0x508/0xc10 [ 29.098185][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.098262][ T460] _raw_spin_lock+0x33/0x40 [ 29.098339][ T460] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 29.098434][ T460] __ipv6_dev_ac_inc+0x57e/0x930 [ 29.098509][ T460] addrconf_join_anycast+0x1bc/0x260 [ 29.098585][ T460] dev_forward_change+0x2be/0x850 [ 29.098661][ T460] addrconf_fixup_forwarding+0x2af/0x4d0 [ 29.098757][ T460] addrconf_sysctl_forward+0x209/0x2b0 [ 29.098833][ T460] proc_sys_call_handler+0x31b/0x480 [ 29.098913][ T460] new_sync_write+0x333/0x750 [ 29.098993][ T460] vfs_write+0x6a4/0xc10 [ 29.099070][ T460] ksys_write+0x116/0x250 [ 29.099150][ T460] do_syscall_64+0x117/0x590 [ 29.099225][ T460] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 29.099325][ T460] [ 29.099368][ T460] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 29.099448][ T460] HARDIRQ-ON-W at: [ 29.099506][ T460] __lock_acquire+0x378/0xc10 [ 29.099602][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.099699][ T460] _raw_spin_lock+0x33/0x40 [ 29.099797][ T460] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 29.099912][ T460] __ipv6_dev_ac_inc+0x57e/0x930 [ 29.100013][ T460] addrconf_join_anycast+0x1bc/0x260 [ 29.100108][ T460] dev_forward_change+0x2be/0x850 [ 29.100203][ T460] addrconf_fixup_forwarding+0x2af/0x4d0 [ 29.100318][ T460] addrconf_sysctl_forward+0x209/0x2b0 [ 29.100413][ T460] proc_sys_call_handler+0x31b/0x480 [ 29.100510][ T460] new_sync_write+0x333/0x750 [ 29.100609][ T460] vfs_write+0x6a4/0xc10 [ 29.100706][ T460] ksys_write+0x116/0x250 [ 29.100802][ T460] do_syscall_64+0x117/0x590 [ 29.100897][ T460] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 29.101015][ T460] SOFTIRQ-ON-W at: [ 29.101074][ T460] __lock_acquire+0x378/0xc10 [ 29.101171][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.101268][ T460] _raw_spin_lock+0x33/0x40 [ 29.101364][ T460] __ipv6_dev_ac_dec+0x236/0x5d0 [ 29.101461][ T460] addrconf_leave_anycast+0x1bc/0x260 [ 29.101600][ T460] dev_forward_change+0x3b3/0x850 [ 29.101697][ T460] addrconf_fixup_forwarding+0x2af/0x4d0 [ 29.101814][ T460] addrconf_sysctl_forward+0x209/0x2b0 [ 29.101956][ T460] proc_sys_call_handler+0x31b/0x480 [ 29.102054][ T460] new_sync_write+0x333/0x750 [ 29.102150][ T460] vfs_write+0x6a4/0xc10 [ 29.102245][ T460] ksys_write+0x116/0x250 [ 29.102380][ T460] do_syscall_64+0x117/0x590 [ 29.102474][ T460] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 29.102589][ T460] INITIAL USE at: [ 29.102687][ T460] __lock_acquire+0x378/0xc10 [ 29.102784][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.102883][ T460] _raw_spin_lock+0x33/0x40 [ 29.103022][ T460] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 29.103138][ T460] __ipv6_dev_ac_inc+0x57e/0x930 [ 29.103235][ T460] addrconf_join_anycast+0x1bc/0x260 [ 29.103373][ T460] dev_forward_change+0x2be/0x850 [ 29.103469][ T460] addrconf_fixup_forwarding+0x2af/0x4d0 [ 29.103597][ T460] addrconf_sysctl_forward+0x209/0x2b0 [ 29.103732][ T460] proc_sys_call_handler+0x31b/0x480 [ 29.103851][ T460] new_sync_write+0x333/0x750 [ 29.103951][ T460] vfs_write+0x6a4/0xc10 [ 29.104086][ T460] ksys_write+0x116/0x250 [ 29.104183][ T460] do_syscall_64+0x117/0x590 [ 29.104283][ T460] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 29.104436][ T460] } [ 29.104474][ T460] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 29.104589][ T460] ... acquired at: [ 29.104645][ T460] mark_lock+0x1d7/0xa00 [ 29.104724][ T460] mark_usage+0x105/0x170 [ 29.104841][ T460] __lock_acquire+0x378/0xc10 [ 29.104918][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.104998][ T460] _raw_spin_lock+0x33/0x40 [ 29.105074][ T460] __ipv6_dev_ac_dec+0x236/0x5d0 [ 29.105190][ T460] addrconf_leave_anycast+0x1bc/0x260 [ 29.105267][ T460] dev_forward_change+0x3b3/0x850 [ 29.105345][ T460] addrconf_fixup_forwarding+0x2af/0x4d0 [ 29.105481][ T460] addrconf_sysctl_forward+0x209/0x2b0 [ 29.105557][ T460] proc_sys_call_handler+0x31b/0x480 [ 29.105634][ T460] new_sync_write+0x333/0x750 [ 29.105715][ T460] vfs_write+0x6a4/0xc10 [ 29.105831][ T460] ksys_write+0x116/0x250 [ 29.105907][ T460] do_syscall_64+0x117/0x590 [ 29.105990][ T460] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 29.106088][ T460] [ 29.106126][ T460] [ 29.106126][ T460] stack backtrace: [ 29.106225][ T460] CPU: 3 UID: 0 PID: 460 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 29.106227][ T460] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 29.106229][ T460] Call Trace: [ 29.106231][ T460] [ 29.106232][ T460] dump_stack_lvl+0x6f/0xa0 [ 29.106237][ T460] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 29.106240][ T460] mark_lock_irq+0x989/0x9c0 [ 29.106243][ T460] mark_lock+0x1d7/0xa00 [ 29.106244][ T460] mark_usage+0x105/0x170 [ 29.106246][ T460] __lock_acquire+0x378/0xc10 [ 29.106248][ T460] lock_acquire.part.0+0xbc/0x260 [ 29.106249][ T460] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 29.106251][ T460] ? rcu_is_watching+0x15/0xd0 [ 29.106254][ T460] ? do_raw_read_unlock+0x70/0x70 [ 29.106256][ T460] ? lock_acquire+0x134/0x160 [ 29.106258][ T460] _raw_spin_lock+0x33/0x40 [ 29.106259][ T460] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 29.106260][ T460] __ipv6_dev_ac_dec+0x236/0x5d0 [ 29.106262][ T460] addrconf_leave_anycast+0x1bc/0x260 [ 29.106264][ T460] ? find_held_lock+0x2b/0x80 [ 29.106267][ T460] ? __ipv6_isatap_ifid+0x210/0x210 [ 29.106268][ T460] ? mark_held_locks+0x40/0x70 [ 29.106270][ T460] ? lockdep_hardirqs_on+0x8c/0x130 [ 29.106272][ T460] dev_forward_change+0x3b3/0x850 [ 29.106274][ T460] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 29.106276][ T460] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 29.106278][ T460] addrconf_fixup_forwarding+0x2af/0x4d0 [ 29.106281][ T460] addrconf_sysctl_forward+0x209/0x2b0 [ 29.106283][ T460] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 29.106285][ T460] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 29.106287][ T460] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 29.106290][ T460] ? proc_sys_call_handler+0x25d/0x480 [ 29.106292][ T460] proc_sys_call_handler+0x31b/0x480 [ 29.106294][ T460] ? proc_sys_lookup+0x3d0/0x3d0 [ 29.106296][ T460] ? rcu_read_unlock+0x1b/0x70 [ 29.106299][ T460] ? do_raw_spin_unlock+0x59/0x250 [ 29.106300][ T460] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 29.106302][ T460] ? rcu_read_lock_any_held+0x3c/0x90 [ 29.106304][ T460] ? proc_sys_call_handler+0x480/0x480 [ 29.106306][ T460] new_sync_write+0x333/0x750 [ 29.106307][ T460] ? __lock_acquire+0x508/0xc10 [ 29.106308][ T460] ? new_sync_read+0x740/0x740 [ 29.106310][ T460] ? lock_acquire.part.0+0xbc/0x260 [ 29.106311][ T460] ? ksys_write+0x116/0x250 [ 29.106313][ T460] vfs_write+0x6a4/0xc10 [ 29.106315][ T460] ksys_write+0x116/0x250 [ 29.106316][ T460] ? __ia32_sys_read+0xc0/0xc0 [ 29.106318][ T460] ? rcu_is_watching+0x15/0xd0 [ 29.106319][ T460] ? rcu_is_watching+0x15/0xd0 [ 29.106321][ T460] do_syscall_64+0x117/0x590 [ 29.106322][ T460] ? trace_hardirqs_off+0xd/0x30 [ 29.106325][ T460] ? exc_page_fault+0xee/0x100 [ 29.106327][ T460] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 29.106328][ T460] RIP: 0033:0x7f85bc8a708e [ 29.106331][ T460] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 29.106333][ T460] RSP: 002b:00007ffc9c5faf60 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 29.106336][ T460] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f85bc8a708e [ 29.106337][ T460] RDX: 0000000000000002 RSI: 000055e7ad2e54b0 RDI: 0000000000000005 [ 29.106338][ T460] RBP: 00007ffc9c5faf70 R08: 0000000000000000 R09: 0000000000000000 [ 29.106338][ T460] R10: 0000000000000000 R11: 0000000000000202 R12: 000055e7ad2e75e0 [ 29.106339][ T460] R13: 000055e7ad2e5470 R14: 0000000000000002 R15: 0000000000000000 [ 29.106341][ T460]