[ 8.658707][ T205] ip (205) used greatest stack depth: 24536 bytes left [ 8.812405][ T213] ip (213) used greatest stack depth: 24352 bytes left [ 9.864254][ T260] gre: GRE over IPv4 demultiplexer driver [ 9.872429][ T260] ip_gre: GRE over IPv4 tunneling driver [ 10.348502][ T283] 8021q: 802.1Q VLAN Support v1.8 [ 11.213103][ T322] GACT probability NOT on [ 11.582287][ T338] ip (338) used greatest stack depth: 23856 bytes left [ 82.384089][ T514] [ 82.384176][ T514] ======================================================== [ 82.384300][ T514] WARNING: possible irq lock inversion dependency detected [ 82.384426][ T514] 7.1.0-rc5-virtme #1 Not tainted [ 82.384504][ T514] -------------------------------------------------------- [ 82.384622][ T514] sysctl/514 just changed the state of lock: [ 82.384720][ T514] ffffffff8f77e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 82.384864][ T514] but this lock was taken by another, SOFTIRQ-safe lock in the past: [ 82.384981][ T514] (&ndev->lock){++-.}-{3:3} [ 82.384983][ T514] [ 82.384983][ T514] [ 82.384983][ T514] and interrupts could create inverse lock ordering between them. [ 82.384983][ T514] [ 82.385268][ T514] [ 82.385268][ T514] other info that might help us debug this: [ 82.385387][ T514] Possible interrupt unsafe locking scenario: [ 82.385387][ T514] [ 82.385507][ T514] CPU0 CPU1 [ 82.385589][ T514] ---- ---- [ 82.385667][ T514] lock(acaddr_hash_lock); [ 82.385746][ T514] local_irq_disable(); [ 82.385848][ T514] lock(&ndev->lock); [ 82.385947][ T514] lock(acaddr_hash_lock); [ 82.386045][ T514] [ 82.386104][ T514] lock(&ndev->lock); [ 82.386164][ T514] [ 82.386164][ T514] *** DEADLOCK *** [ 82.386164][ T514] [ 82.386278][ T514] 2 locks held by sysctl/514: [ 82.386357][ T514] #0: ff11000009b443e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 82.386509][ T514] #1: ffffffff8f68c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 82.386672][ T514] [ 82.386672][ T514] the shortest dependencies between 2nd lock and 1st lock: [ 82.386813][ T514] -> (&ndev->lock){++-.}-{3:3} { [ 82.386895][ T514] HARDIRQ-ON-W at: [ 82.386955][ T514] __lock_acquire+0x378/0xc10 [ 82.387057][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.387154][ T514] _raw_write_lock_bh+0x38/0x50 [ 82.387257][ T514] addrconf_permanent_addr+0x108/0x9c0 [ 82.387380][ T514] addrconf_notify+0x151/0xf30 [ 82.387488][ T514] notifier_call_chain+0xb0/0x320 [ 82.387598][ T514] __dev_notify_flags+0xde/0x280 [ 82.387696][ T514] netif_change_flags+0xfe/0x190 [ 82.387798][ T514] do_setlink.isra.0+0x1cc3/0x2750 [ 82.387900][ T514] rtnl_newlink+0x8d1/0xef0 [ 82.388006][ T514] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 82.388109][ T514] netlink_rcv_skb+0x14e/0x3a0 [ 82.388208][ T514] netlink_unicast+0x486/0x750 [ 82.388310][ T514] netlink_sendmsg+0x735/0xc60 [ 82.388413][ T514] ____sys_sendmsg+0x419/0x850 [ 82.388517][ T514] ___sys_sendmsg+0x14e/0x1d0 [ 82.388617][ T514] __sys_sendmsg+0x145/0x1f0 [ 82.388717][ T514] do_syscall_64+0x117/0x590 [ 82.388822][ T514] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 82.388946][ T514] HARDIRQ-ON-R at: [ 82.389008][ T514] __lock_acquire+0x378/0xc10 [ 82.389113][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.389215][ T514] _raw_read_lock_bh+0x44/0x80 [ 82.389312][ T514] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 82.389434][ T514] inet6_fill_link_af+0x5c/0xe0 [ 82.389537][ T514] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 82.389662][ T514] rtnl_getlink+0x9c9/0xeb0 [ 82.389765][ T514] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 82.389870][ T514] netlink_rcv_skb+0x14e/0x3a0 [ 82.389973][ T514] netlink_unicast+0x486/0x750 [ 82.390071][ T514] netlink_sendmsg+0x735/0xc60 [ 82.390172][ T514] ____sys_sendmsg+0x419/0x850 [ 82.390270][ T514] ___sys_sendmsg+0x14e/0x1d0 [ 82.390372][ T514] __sys_sendmsg+0x145/0x1f0 [ 82.390473][ T514] do_syscall_64+0x117/0x590 [ 82.390570][ T514] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 82.390685][ T514] IN-SOFTIRQ-W at: [ 82.390743][ T514] __lock_acquire+0x378/0xc10 [ 82.390839][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.390947][ T514] _raw_write_lock+0x33/0x40 [ 82.391050][ T514] addrconf_rs_timer+0xb0/0x770 [ 82.391147][ T514] call_timer_fn+0x163/0x4f0 [ 82.391246][ T514] __run_timers+0x68f/0xab0 [ 82.391348][ T514] run_timer_softirq+0xf0/0x160 [ 82.391448][ T514] handle_softirqs+0x1d8/0x940 [ 82.391547][ T514] __irq_exit_rcu+0x103/0x1c0 [ 82.391648][ T514] irq_exit_rcu+0xe/0x30 [ 82.391751][ T514] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 82.391866][ T514] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 82.391987][ T514] pv_native_safe_halt+0xf/0x10 [ 82.392086][ T514] default_idle+0x9/0x10 [ 82.392187][ T514] default_idle_call+0x6e/0xb0 [ 82.392283][ T514] cpuidle_idle_call.constprop.0+0x237/0x410 [ 82.392411][ T514] do_idle+0xf5/0x160 [ 82.392519][ T514] cpu_startup_entry+0x53/0x70 [ 82.392624][ T514] start_secondary+0x204/0x2b0 [ 82.392722][ T514] common_startup_64+0x13e/0x148 [ 82.392827][ T514] INITIAL USE at: [ 82.392885][ T514] __lock_acquire+0x378/0xc10 [ 82.392984][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.393084][ T514] _raw_write_lock_bh+0x38/0x50 [ 82.393183][ T514] addrconf_permanent_addr+0x108/0x9c0 [ 82.393299][ T514] addrconf_notify+0x151/0xf30 [ 82.393400][ T514] notifier_call_chain+0xb0/0x320 [ 82.393500][ T514] __dev_notify_flags+0xde/0x280 [ 82.393597][ T514] netif_change_flags+0xfe/0x190 [ 82.393696][ T514] do_setlink.isra.0+0x1cc3/0x2750 [ 82.393800][ T514] rtnl_newlink+0x8d1/0xef0 [ 82.393898][ T514] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 82.393994][ T514] netlink_rcv_skb+0x14e/0x3a0 [ 82.394093][ T514] netlink_unicast+0x486/0x750 [ 82.394189][ T514] netlink_sendmsg+0x735/0xc60 [ 82.394287][ T514] ____sys_sendmsg+0x419/0x850 [ 82.394384][ T514] ___sys_sendmsg+0x14e/0x1d0 [ 82.394484][ T514] __sys_sendmsg+0x145/0x1f0 [ 82.394584][ T514] do_syscall_64+0x117/0x590 [ 82.394682][ T514] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 82.394798][ T514] INITIAL READ USE at: [ 82.394874][ T514] __lock_acquire+0x378/0xc10 [ 82.394971][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.395095][ T514] _raw_read_lock_bh+0x44/0x80 [ 82.395195][ T514] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 82.395311][ T514] inet6_fill_link_af+0x5c/0xe0 [ 82.395414][ T514] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 82.395528][ T514] rtnl_getlink+0x9c9/0xeb0 [ 82.395624][ T514] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 82.395720][ T514] netlink_rcv_skb+0x14e/0x3a0 [ 82.395817][ T514] netlink_unicast+0x486/0x750 [ 82.395926][ T514] netlink_sendmsg+0x735/0xc60 [ 82.396023][ T514] ____sys_sendmsg+0x419/0x850 [ 82.396119][ T514] ___sys_sendmsg+0x14e/0x1d0 [ 82.396216][ T514] __sys_sendmsg+0x145/0x1f0 [ 82.396311][ T514] do_syscall_64+0x117/0x590 [ 82.396417][ T514] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 82.396533][ T514] } [ 82.396573][ T514] ... key at: [] __key.37+0x0/0x40 [ 82.396692][ T514] ... acquired at: [ 82.396751][ T514] __lock_acquire+0x508/0xc10 [ 82.396832][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.396909][ T514] _raw_spin_lock+0x33/0x40 [ 82.396987][ T514] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 82.397083][ T514] __ipv6_dev_ac_inc+0x57e/0x930 [ 82.397160][ T514] addrconf_join_anycast+0x1bc/0x260 [ 82.397236][ T514] dev_forward_change+0x2be/0x850 [ 82.397314][ T514] addrconf_fixup_forwarding+0x2af/0x4d0 [ 82.397423][ T514] addrconf_sysctl_forward+0x209/0x2b0 [ 82.397508][ T514] proc_sys_call_handler+0x31b/0x480 [ 82.397587][ T514] new_sync_write+0x333/0x750 [ 82.397664][ T514] vfs_write+0x6a4/0xc10 [ 82.397741][ T514] ksys_write+0x116/0x250 [ 82.397825][ T514] do_syscall_64+0x117/0x590 [ 82.397906][ T514] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 82.398003][ T514] [ 82.398044][ T514] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 82.398122][ T514] HARDIRQ-ON-W at: [ 82.398180][ T514] __lock_acquire+0x378/0xc10 [ 82.398277][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.398374][ T514] _raw_spin_lock+0x33/0x40 [ 82.398473][ T514] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 82.398596][ T514] __ipv6_dev_ac_inc+0x57e/0x930 [ 82.398693][ T514] addrconf_join_anycast+0x1bc/0x260 [ 82.398788][ T514] dev_forward_change+0x2be/0x850 [ 82.398884][ T514] addrconf_fixup_forwarding+0x2af/0x4d0 [ 82.398997][ T514] addrconf_sysctl_forward+0x209/0x2b0 [ 82.399100][ T514] proc_sys_call_handler+0x31b/0x480 [ 82.399198][ T514] new_sync_write+0x333/0x750 [ 82.399295][ T514] vfs_write+0x6a4/0xc10 [ 82.399397][ T514] ksys_write+0x116/0x250 [ 82.399506][ T514] do_syscall_64+0x117/0x590 [ 82.399607][ T514] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 82.399723][ T514] SOFTIRQ-ON-W at: [ 82.399781][ T514] __lock_acquire+0x378/0xc10 [ 82.399877][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.399973][ T514] _raw_spin_lock+0x33/0x40 [ 82.400070][ T514] __ipv6_dev_ac_dec+0x236/0x5d0 [ 82.400166][ T514] addrconf_leave_anycast+0x1bc/0x260 [ 82.400266][ T514] dev_forward_change+0x3b3/0x850 [ 82.400363][ T514] addrconf_fixup_forwarding+0x2af/0x4d0 [ 82.400484][ T514] addrconf_sysctl_forward+0x209/0x2b0 [ 82.400581][ T514] proc_sys_call_handler+0x31b/0x480 [ 82.400678][ T514] new_sync_write+0x333/0x750 [ 82.400779][ T514] vfs_write+0x6a4/0xc10 [ 82.400876][ T514] ksys_write+0x116/0x250 [ 82.400972][ T514] do_syscall_64+0x117/0x590 [ 82.401072][ T514] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 82.401186][ T514] INITIAL USE at: [ 82.401243][ T514] __lock_acquire+0x378/0xc10 [ 82.401341][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.401440][ T514] _raw_spin_lock+0x33/0x40 [ 82.401541][ T514] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 82.401656][ T514] __ipv6_dev_ac_inc+0x57e/0x930 [ 82.401751][ T514] addrconf_join_anycast+0x1bc/0x260 [ 82.401848][ T514] dev_forward_change+0x2be/0x850 [ 82.401953][ T514] addrconf_fixup_forwarding+0x2af/0x4d0 [ 82.402068][ T514] addrconf_sysctl_forward+0x209/0x2b0 [ 82.402164][ T514] proc_sys_call_handler+0x31b/0x480 [ 82.402261][ T514] new_sync_write+0x333/0x750 [ 82.402357][ T514] vfs_write+0x6a4/0xc10 [ 82.402467][ T514] ksys_write+0x116/0x250 [ 82.402563][ T514] do_syscall_64+0x117/0x590 [ 82.402663][ T514] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 82.402777][ T514] } [ 82.402816][ T514] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 82.402931][ T514] ... acquired at: [ 82.402989][ T514] mark_lock+0x1d7/0xa00 [ 82.403065][ T514] mark_usage+0x105/0x170 [ 82.403146][ T514] __lock_acquire+0x378/0xc10 [ 82.403221][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.403297][ T514] _raw_spin_lock+0x33/0x40 [ 82.403374][ T514] __ipv6_dev_ac_dec+0x236/0x5d0 [ 82.403453][ T514] addrconf_leave_anycast+0x1bc/0x260 [ 82.403532][ T514] dev_forward_change+0x3b3/0x850 [ 82.403608][ T514] addrconf_fixup_forwarding+0x2af/0x4d0 [ 82.403703][ T514] addrconf_sysctl_forward+0x209/0x2b0 [ 82.403790][ T514] proc_sys_call_handler+0x31b/0x480 [ 82.403866][ T514] new_sync_write+0x333/0x750 [ 82.403943][ T514] vfs_write+0x6a4/0xc10 [ 82.404020][ T514] ksys_write+0x116/0x250 [ 82.404097][ T514] do_syscall_64+0x117/0x590 [ 82.404174][ T514] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 82.404269][ T514] [ 82.404308][ T514] [ 82.404308][ T514] stack backtrace: [ 82.404418][ T514] CPU: 0 UID: 0 PID: 514 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 82.404420][ T514] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 82.404422][ T514] Call Trace: [ 82.404424][ T514] [ 82.404425][ T514] dump_stack_lvl+0x6f/0xa0 [ 82.404430][ T514] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 82.404433][ T514] mark_lock_irq+0x989/0x9c0 [ 82.404435][ T514] mark_lock+0x1d7/0xa00 [ 82.404437][ T514] mark_usage+0x105/0x170 [ 82.404438][ T514] __lock_acquire+0x378/0xc10 [ 82.404440][ T514] lock_acquire.part.0+0xbc/0x260 [ 82.404442][ T514] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 82.404444][ T514] ? rcu_is_watching+0x15/0xd0 [ 82.404446][ T514] ? do_raw_read_unlock+0x70/0x70 [ 82.404448][ T514] ? lock_acquire+0x134/0x160 [ 82.404450][ T514] _raw_spin_lock+0x33/0x40 [ 82.404451][ T514] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 82.404453][ T514] __ipv6_dev_ac_dec+0x236/0x5d0 [ 82.404455][ T514] addrconf_leave_anycast+0x1bc/0x260 [ 82.404456][ T514] ? find_held_lock+0x2b/0x80 [ 82.404459][ T514] ? __ipv6_isatap_ifid+0x210/0x210 [ 82.404461][ T514] ? mark_held_locks+0x40/0x70 [ 82.404462][ T514] ? lockdep_hardirqs_on+0x8c/0x130 [ 82.404464][ T514] dev_forward_change+0x3b3/0x850 [ 82.404466][ T514] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 82.404468][ T514] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 82.404471][ T514] addrconf_fixup_forwarding+0x2af/0x4d0 [ 82.404473][ T514] addrconf_sysctl_forward+0x209/0x2b0 [ 82.404475][ T514] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 82.404477][ T514] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 82.404479][ T514] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 82.404482][ T514] ? proc_sys_call_handler+0x25d/0x480 [ 82.404484][ T514] proc_sys_call_handler+0x31b/0x480 [ 82.404486][ T514] ? proc_sys_lookup+0x3d0/0x3d0 [ 82.404488][ T514] ? rcu_read_unlock+0x1b/0x70 [ 82.404491][ T514] ? do_raw_spin_unlock+0x59/0x250 [ 82.404492][ T514] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 82.404494][ T514] ? rcu_read_lock_any_held+0x3c/0x90 [ 82.404496][ T514] ? proc_sys_call_handler+0x480/0x480 [ 82.404498][ T514] new_sync_write+0x333/0x750 [ 82.404499][ T514] ? __lock_acquire+0x508/0xc10 [ 82.404501][ T514] ? new_sync_read+0x740/0x740 [ 82.404502][ T514] ? lock_acquire.part.0+0xbc/0x260 [ 82.404504][ T514] ? ksys_write+0x116/0x250 [ 82.404506][ T514] vfs_write+0x6a4/0xc10 [ 82.404508][ T514] ksys_write+0x116/0x250 [ 82.404509][ T514] ? __ia32_sys_read+0xc0/0xc0 [ 82.404510][ T514] ? rcu_is_watching+0x15/0xd0 [ 82.404512][ T514] ? rcu_is_watching+0x15/0xd0 [ 82.404514][ T514] do_syscall_64+0x117/0x590 [ 82.404515][ T514] ? trace_hardirqs_off+0xd/0x30 [ 82.404518][ T514] ? exc_page_fault+0xee/0x100 [ 82.404520][ T514] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 82.404521][ T514] RIP: 0033:0x7f62d23fc08e [ 82.404524][ T514] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 82.404526][ T514] RSP: 002b:00007ffc0528a590 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 82.404528][ T514] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f62d23fc08e [ 82.404530][ T514] RDX: 0000000000000002 RSI: 000055d7d80e64b0 RDI: 0000000000000005 [ 82.404530][ T514] RBP: 00007ffc0528a5a0 R08: 0000000000000000 R09: 0000000000000000 [ 82.404531][ T514] R10: 0000000000000000 R11: 0000000000000202 R12: 000055d7d80e85e0 [ 82.404532][ T514] R13: 000055d7d80e6470 R14: 0000000000000002 R15: 0000000000000000 [ 82.404534][ T514]