[ 8.960772][ T186] ip (186) used greatest stack depth: 24432 bytes left [ 50.706613][ T2738] [ 50.706705][ T2738] ======================================================== [ 50.706838][ T2738] WARNING: possible irq lock inversion dependency detected [ 50.706961][ T2738] 7.1.0-rc5-virtme #1 Not tainted [ 50.707041][ T2738] -------------------------------------------------------- [ 50.707168][ T2738] sysctl/2738 just changed the state of lock: [ 50.707269][ T2738] ffffffffad97e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 50.707425][ T2738] but this lock was taken by another, SOFTIRQ-READ-safe lock in the past: [ 50.707546][ T2738] (&ndev->lock){++.-}-{3:3} [ 50.707549][ T2738] [ 50.707549][ T2738] [ 50.707549][ T2738] and interrupts could create inverse lock ordering between them. [ 50.707549][ T2738] [ 50.707853][ T2738] [ 50.707853][ T2738] other info that might help us debug this: [ 50.707977][ T2738] Possible interrupt unsafe locking scenario: [ 50.707977][ T2738] [ 50.708099][ T2738] CPU0 CPU1 [ 50.708183][ T2738] ---- ---- [ 50.708264][ T2738] lock(acaddr_hash_lock); [ 50.708345][ T2738] local_irq_disable(); [ 50.708449][ T2738] lock(&ndev->lock); [ 50.708547][ T2738] lock(acaddr_hash_lock); [ 50.708647][ T2738] [ 50.708709][ T2738] lock(&ndev->lock); [ 50.708779][ T2738] [ 50.708779][ T2738] *** DEADLOCK *** [ 50.708779][ T2738] [ 50.708905][ T2738] 2 locks held by sysctl/2738: [ 50.708993][ T2738] #0: ff11000009aa43e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 50.709141][ T2738] #1: ffffffffad88c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 50.709305][ T2738] [ 50.709305][ T2738] the shortest dependencies between 2nd lock and 1st lock: [ 50.709447][ T2738] -> (&ndev->lock){++.-}-{3:3} { [ 50.709532][ T2738] HARDIRQ-ON-W at: [ 50.709596][ T2738] __lock_acquire+0x378/0xc10 [ 50.709705][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.709815][ T2738] _raw_write_lock_bh+0x38/0x50 [ 50.709920][ T2738] addrconf_permanent_addr+0x108/0x9c0 [ 50.710046][ T2738] addrconf_notify+0x151/0xf30 [ 50.710151][ T2738] notifier_call_chain+0xb0/0x320 [ 50.710256][ T2738] __dev_notify_flags+0xde/0x280 [ 50.710361][ T2738] netif_change_flags+0xfe/0x190 [ 50.710465][ T2738] do_setlink.isra.0+0x1cc3/0x2750 [ 50.710572][ T2738] rtnl_newlink+0x8d1/0xef0 [ 50.710674][ T2738] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 50.710780][ T2738] netlink_rcv_skb+0x14e/0x3a0 [ 50.710887][ T2738] netlink_unicast+0x486/0x750 [ 50.710990][ T2738] netlink_sendmsg+0x735/0xc60 [ 50.711094][ T2738] ____sys_sendmsg+0x419/0x850 [ 50.711195][ T2738] ___sys_sendmsg+0x14e/0x1d0 [ 50.711300][ T2738] __sys_sendmsg+0x145/0x1f0 [ 50.711401][ T2738] do_syscall_64+0x117/0x590 [ 50.711505][ T2738] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 50.711625][ T2738] HARDIRQ-ON-R at: [ 50.711689][ T2738] __lock_acquire+0x378/0xc10 [ 50.711793][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.711893][ T2738] _raw_read_lock_bh+0x44/0x80 [ 50.711999][ T2738] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 50.712121][ T2738] inet6_fill_link_af+0x5c/0xe0 [ 50.712221][ T2738] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 50.712346][ T2738] rtnl_getlink+0x9c9/0xeb0 [ 50.712448][ T2738] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 50.712548][ T2738] netlink_rcv_skb+0x14e/0x3a0 [ 50.712646][ T2738] netlink_unicast+0x486/0x750 [ 50.712750][ T2738] netlink_sendmsg+0x735/0xc60 [ 50.712856][ T2738] ____sys_sendmsg+0x419/0x850 [ 50.712959][ T2738] ___sys_sendmsg+0x14e/0x1d0 [ 50.713077][ T2738] __sys_sendmsg+0x145/0x1f0 [ 50.713177][ T2738] do_syscall_64+0x117/0x590 [ 50.713278][ T2738] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 50.713397][ T2738] IN-SOFTIRQ-R at: [ 50.713459][ T2738] __lock_acquire+0x378/0xc10 [ 50.713562][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.713663][ T2738] _raw_read_lock_bh+0x44/0x80 [ 50.713766][ T2738] ipv6_get_lladdr+0xa8/0x3f0 [ 50.713867][ T2738] ndisc_send_ns+0xf3/0x120 [ 50.713968][ T2738] ndisc_solicit+0x314/0x480 [ 50.714069][ T2738] neigh_probe+0xb3/0x100 [ 50.714171][ T2738] __neigh_event_send+0x802/0x1070 [ 50.714273][ T2738] neigh_resolve_output+0xbe/0x140 [ 50.714380][ T2738] ip6_finish_output2+0x423/0x1300 [ 50.714482][ T2738] ip6_finish_output+0x646/0xda0 [ 50.714584][ T2738] ip6_output+0x23f/0x7f0 [ 50.714685][ T2738] ip6_forward+0x10f4/0x2bd0 [ 50.714792][ T2738] ipv6_rcv+0x3c1/0x5a0 [ 50.714897][ T2738] __netif_receive_skb_one_core+0xfc/0x180 [ 50.715019][ T2738] process_backlog+0x2bc/0x1490 [ 50.715118][ T2738] __napi_poll+0xa7/0x3b0 [ 50.715218][ T2738] net_rx_action+0x513/0xf50 [ 50.715324][ T2738] handle_softirqs+0x1d8/0x940 [ 50.715424][ T2738] do_softirq+0xa9/0xe0 [ 50.715524][ T2738] __local_bh_enable_ip+0x113/0x140 [ 50.715623][ T2738] __neigh_event_send+0x30a/0x1070 [ 50.715724][ T2738] neigh_resolve_output+0xbe/0x140 [ 50.715828][ T2738] ip6_finish_output2+0x423/0x1300 [ 50.715929][ T2738] ip6_finish_output+0x646/0xda0 [ 50.716030][ T2738] ip6_output+0x23f/0x7f0 [ 50.716130][ T2738] ip6_send_skb+0xee/0x350 [ 50.716230][ T2738] rawv6_push_pending_frames+0x4cb/0xa90 [ 50.716350][ T2738] rawv6_sendmsg+0x1434/0x1a50 [ 50.716451][ T2738] __sys_sendto+0x2c9/0x400 [ 50.716556][ T2738] __x64_sys_sendto+0xe4/0x1f0 [ 50.716656][ T2738] do_syscall_64+0x117/0x590 [ 50.716760][ T2738] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 50.716878][ T2738] INITIAL USE at: [ 50.716938][ T2738] __lock_acquire+0x378/0xc10 [ 50.717040][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.717137][ T2738] _raw_write_lock_bh+0x38/0x50 [ 50.717242][ T2738] addrconf_permanent_addr+0x108/0x9c0 [ 50.717362][ T2738] addrconf_notify+0x151/0xf30 [ 50.717461][ T2738] notifier_call_chain+0xb0/0x320 [ 50.717560][ T2738] __dev_notify_flags+0xde/0x280 [ 50.717659][ T2738] netif_change_flags+0xfe/0x190 [ 50.717765][ T2738] do_setlink.isra.0+0x1cc3/0x2750 [ 50.717864][ T2738] rtnl_newlink+0x8d1/0xef0 [ 50.717963][ T2738] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 50.718067][ T2738] netlink_rcv_skb+0x14e/0x3a0 [ 50.718167][ T2738] netlink_unicast+0x486/0x750 [ 50.718266][ T2738] netlink_sendmsg+0x735/0xc60 [ 50.718365][ T2738] ____sys_sendmsg+0x419/0x850 [ 50.718467][ T2738] ___sys_sendmsg+0x14e/0x1d0 [ 50.718569][ T2738] __sys_sendmsg+0x145/0x1f0 [ 50.718670][ T2738] do_syscall_64+0x117/0x590 [ 50.718775][ T2738] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 50.718892][ T2738] INITIAL READ USE at: [ 50.718975][ T2738] __lock_acquire+0x378/0xc10 [ 50.719080][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.719207][ T2738] _raw_read_lock_bh+0x44/0x80 [ 50.719316][ T2738] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 50.719442][ T2738] inet6_fill_link_af+0x5c/0xe0 [ 50.719543][ T2738] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 50.719663][ T2738] rtnl_getlink+0x9c9/0xeb0 [ 50.719775][ T2738] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 50.719875][ T2738] netlink_rcv_skb+0x14e/0x3a0 [ 50.719985][ T2738] netlink_unicast+0x486/0x750 [ 50.720092][ T2738] netlink_sendmsg+0x735/0xc60 [ 50.720195][ T2738] ____sys_sendmsg+0x419/0x850 [ 50.720301][ T2738] ___sys_sendmsg+0x14e/0x1d0 [ 50.720405][ T2738] __sys_sendmsg+0x145/0x1f0 [ 50.720513][ T2738] do_syscall_64+0x117/0x590 [ 50.720618][ T2738] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 50.720746][ T2738] } [ 50.720795][ T2738] ... key at: [] __key.37+0x0/0x40 [ 50.720926][ T2738] ... acquired at: [ 50.720986][ T2738] __lock_acquire+0x508/0xc10 [ 50.721067][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.721145][ T2738] _raw_spin_lock+0x33/0x40 [ 50.721224][ T2738] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 50.721322][ T2738] __ipv6_dev_ac_inc+0x57e/0x930 [ 50.721401][ T2738] addrconf_join_anycast+0x1bc/0x260 [ 50.721481][ T2738] __ipv6_ifa_notify+0x75b/0xad0 [ 50.721565][ T2738] addrconf_dad_completed+0x14b/0xe10 [ 50.721649][ T2738] addrconf_dad_work+0x3c1/0x930 [ 50.721732][ T2738] process_one_work+0xdf8/0x1410 [ 50.721829][ T2738] worker_thread+0x4f1/0xd60 [ 50.721915][ T2738] kthread+0x367/0x460 [ 50.721979][ T2738] ret_from_fork+0x474/0x6b0 [ 50.722064][ T2738] ret_from_fork_asm+0x11/0x20 [ 50.722150][ T2738] [ 50.722194][ T2738] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 50.722281][ T2738] HARDIRQ-ON-W at: [ 50.722345][ T2738] __lock_acquire+0x378/0xc10 [ 50.722450][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.722550][ T2738] _raw_spin_lock+0x33/0x40 [ 50.722647][ T2738] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 50.722778][ T2738] __ipv6_dev_ac_inc+0x57e/0x930 [ 50.722878][ T2738] addrconf_join_anycast+0x1bc/0x260 [ 50.722984][ T2738] __ipv6_ifa_notify+0x75b/0xad0 [ 50.723088][ T2738] addrconf_dad_completed+0x14b/0xe10 [ 50.723194][ T2738] addrconf_dad_work+0x3c1/0x930 [ 50.723299][ T2738] process_one_work+0xdf8/0x1410 [ 50.723406][ T2738] worker_thread+0x4f1/0xd60 [ 50.723513][ T2738] kthread+0x367/0x460 [ 50.723599][ T2738] ret_from_fork+0x474/0x6b0 [ 50.723704][ T2738] ret_from_fork_asm+0x11/0x20 [ 50.723817][ T2738] SOFTIRQ-ON-W at: [ 50.723879][ T2738] __lock_acquire+0x378/0xc10 [ 50.723987][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.724093][ T2738] _raw_spin_lock+0x33/0x40 [ 50.724199][ T2738] __ipv6_dev_ac_dec+0x236/0x5d0 [ 50.724307][ T2738] addrconf_leave_anycast+0x1bc/0x260 [ 50.724413][ T2738] dev_forward_change+0x3b3/0x850 [ 50.724521][ T2738] addrconf_fixup_forwarding+0x2af/0x4d0 [ 50.724695][ T2738] addrconf_sysctl_forward+0x209/0x2b0 [ 50.724804][ T2738] proc_sys_call_handler+0x31b/0x480 [ 50.724914][ T2738] new_sync_write+0x333/0x750 [ 50.725064][ T2738] vfs_write+0x6a4/0xc10 [ 50.725169][ T2738] ksys_write+0x116/0x250 [ 50.725270][ T2738] do_syscall_64+0x117/0x590 [ 50.725417][ T2738] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 50.725539][ T2738] INITIAL USE at: [ 50.725601][ T2738] __lock_acquire+0x378/0xc10 [ 50.725748][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.725855][ T2738] _raw_spin_lock+0x33/0x40 [ 50.725956][ T2738] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 50.726125][ T2738] __ipv6_dev_ac_inc+0x57e/0x930 [ 50.726236][ T2738] addrconf_join_anycast+0x1bc/0x260 [ 50.726342][ T2738] __ipv6_ifa_notify+0x75b/0xad0 [ 50.726488][ T2738] addrconf_dad_completed+0x14b/0xe10 [ 50.726593][ T2738] addrconf_dad_work+0x3c1/0x930 [ 50.726696][ T2738] process_one_work+0xdf8/0x1410 [ 50.726812][ T2738] worker_thread+0x4f1/0xd60 [ 50.726961][ T2738] kthread+0x367/0x460 [ 50.727044][ T2738] ret_from_fork+0x474/0x6b0 [ 50.727144][ T2738] ret_from_fork_asm+0x11/0x20 [ 50.727284][ T2738] } [ 50.727324][ T2738] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 50.727445][ T2738] ... acquired at: [ 50.727507][ T2738] mark_lock+0x1d7/0xa00 [ 50.727634][ T2738] mark_usage+0x105/0x170 [ 50.727716][ T2738] __lock_acquire+0x378/0xc10 [ 50.727803][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.727889][ T2738] _raw_spin_lock+0x33/0x40 [ 50.728020][ T2738] __ipv6_dev_ac_dec+0x236/0x5d0 [ 50.728104][ T2738] addrconf_leave_anycast+0x1bc/0x260 [ 50.728190][ T2738] dev_forward_change+0x3b3/0x850 [ 50.728275][ T2738] addrconf_fixup_forwarding+0x2af/0x4d0 [ 50.728419][ T2738] addrconf_sysctl_forward+0x209/0x2b0 [ 50.728500][ T2738] proc_sys_call_handler+0x31b/0x480 [ 50.728579][ T2738] new_sync_write+0x333/0x750 [ 50.728658][ T2738] vfs_write+0x6a4/0xc10 [ 50.728784][ T2738] ksys_write+0x116/0x250 [ 50.728864][ T2738] do_syscall_64+0x117/0x590 [ 50.728950][ T2738] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 50.729049][ T2738] [ 50.729131][ T2738] [ 50.729131][ T2738] stack backtrace: [ 50.729237][ T2738] CPU: 0 UID: 0 PID: 2738 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 50.729240][ T2738] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 50.729241][ T2738] Call Trace: [ 50.729243][ T2738] [ 50.729245][ T2738] dump_stack_lvl+0x6f/0xa0 [ 50.729249][ T2738] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 50.729252][ T2738] mark_lock_irq+0x989/0x9c0 [ 50.729255][ T2738] mark_lock+0x1d7/0xa00 [ 50.729256][ T2738] mark_usage+0x105/0x170 [ 50.729258][ T2738] __lock_acquire+0x378/0xc10 [ 50.729260][ T2738] lock_acquire.part.0+0xbc/0x260 [ 50.729261][ T2738] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 50.729263][ T2738] ? rcu_is_watching+0x15/0xd0 [ 50.729266][ T2738] ? do_raw_read_unlock+0x70/0x70 [ 50.729268][ T2738] ? lock_acquire+0x134/0x160 [ 50.729270][ T2738] _raw_spin_lock+0x33/0x40 [ 50.729271][ T2738] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 50.729273][ T2738] __ipv6_dev_ac_dec+0x236/0x5d0 [ 50.729275][ T2738] addrconf_leave_anycast+0x1bc/0x260 [ 50.729276][ T2738] ? find_held_lock+0x2b/0x80 [ 50.729279][ T2738] ? __ipv6_isatap_ifid+0x210/0x210 [ 50.729281][ T2738] ? mark_held_locks+0x40/0x70 [ 50.729282][ T2738] ? lockdep_hardirqs_on+0x8c/0x130 [ 50.729285][ T2738] dev_forward_change+0x3b3/0x850 [ 50.729287][ T2738] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 50.729289][ T2738] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 50.729291][ T2738] addrconf_fixup_forwarding+0x2af/0x4d0 [ 50.729294][ T2738] addrconf_sysctl_forward+0x209/0x2b0 [ 50.729296][ T2738] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 50.729298][ T2738] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 50.729300][ T2738] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 50.729303][ T2738] ? proc_sys_call_handler+0x25d/0x480 [ 50.729305][ T2738] proc_sys_call_handler+0x31b/0x480 [ 50.729307][ T2738] ? proc_sys_lookup+0x3d0/0x3d0 [ 50.729309][ T2738] ? rcu_read_unlock+0x1b/0x70 [ 50.729312][ T2738] ? do_raw_spin_unlock+0x59/0x250 [ 50.729313][ T2738] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 50.729315][ T2738] ? rcu_read_lock_any_held+0x3c/0x90 [ 50.729317][ T2738] ? proc_sys_call_handler+0x480/0x480 [ 50.729319][ T2738] new_sync_write+0x333/0x750 [ 50.729321][ T2738] ? __lock_acquire+0x508/0xc10 [ 50.729323][ T2738] ? new_sync_read+0x740/0x740 [ 50.729326][ T2738] ? lock_acquire.part.0+0xbc/0x260 [ 50.729328][ T2738] ? ksys_write+0x116/0x250 [ 50.729331][ T2738] vfs_write+0x6a4/0xc10 [ 50.729333][ T2738] ksys_write+0x116/0x250 [ 50.729335][ T2738] ? __ia32_sys_read+0xc0/0xc0 [ 50.729336][ T2738] ? rcu_is_watching+0x15/0xd0 [ 50.729338][ T2738] ? rcu_is_watching+0x15/0xd0 [ 50.729339][ T2738] do_syscall_64+0x117/0x590 [ 50.729341][ T2738] ? trace_hardirqs_off+0xd/0x30 [ 50.729344][ T2738] ? exc_page_fault+0xee/0x100 [ 50.729345][ T2738] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 50.729347][ T2738] RIP: 0033:0x7f0bf051708e [ 50.729350][ T2738] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 50.729352][ T2738] RSP: 002b:00007ffd5be79b80 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 50.729355][ T2738] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f0bf051708e [ 50.729356][ T2738] RDX: 0000000000000002 RSI: 00005637f6a4a4b0 RDI: 0000000000000005 [ 50.729357][ T2738] RBP: 00007ffd5be79b90 R08: 0000000000000000 R09: 0000000000000000 [ 50.729358][ T2738] R10: 0000000000000000 R11: 0000000000000202 R12: 00005637f6a4c5e0 [ 50.729359][ T2738] R13: 00005637f6a4a470 R14: 0000000000000002 R15: 0000000000000000 [ 50.729361][ T2738]