[ 17.159004][ T292] [ 17.159099][ T292] ======================================================== [ 17.159223][ T292] WARNING: possible irq lock inversion dependency detected [ 17.159338][ T292] 7.1.0-rc5-virtme #1 Not tainted [ 17.159419][ T292] -------------------------------------------------------- [ 17.159532][ T292] sysctl/292 just changed the state of lock: [ 17.159631][ T292] ffffffffae77e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 17.159781][ T292] but this lock was taken by another, SOFTIRQ-READ-safe lock in the past: [ 17.159909][ T292] (&ndev->lock){++.-}-{3:3} [ 17.159911][ T292] [ 17.159911][ T292] [ 17.159911][ T292] and interrupts could create inverse lock ordering between them. [ 17.159911][ T292] [ 17.160198][ T292] [ 17.160198][ T292] other info that might help us debug this: [ 17.160316][ T292] Possible interrupt unsafe locking scenario: [ 17.160316][ T292] [ 17.160430][ T292] CPU0 CPU1 [ 17.160509][ T292] ---- ---- [ 17.160587][ T292] lock(acaddr_hash_lock); [ 17.160668][ T292] local_irq_disable(); [ 17.160764][ T292] lock(&ndev->lock); [ 17.160866][ T292] lock(acaddr_hash_lock); [ 17.160965][ T292] [ 17.161025][ T292] lock(&ndev->lock); [ 17.161085][ T292] [ 17.161085][ T292] *** DEADLOCK *** [ 17.161085][ T292] [ 17.161204][ T292] 2 locks held by sysctl/292: [ 17.161282][ T292] #0: ff1100000a0743e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 17.161420][ T292] #1: ffffffffae68c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 17.161572][ T292] [ 17.161572][ T292] the shortest dependencies between 2nd lock and 1st lock: [ 17.161707][ T292] -> (&ndev->lock){++.-}-{3:3} { [ 17.161792][ T292] HARDIRQ-ON-W at: [ 17.161852][ T292] __lock_acquire+0x378/0xc10 [ 17.161953][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.162054][ T292] _raw_write_lock_bh+0x38/0x50 [ 17.162154][ T292] addrconf_permanent_addr+0x108/0x9c0 [ 17.162273][ T292] addrconf_notify+0x151/0xf30 [ 17.162370][ T292] notifier_call_chain+0xb0/0x320 [ 17.162475][ T292] __dev_notify_flags+0xde/0x280 [ 17.162572][ T292] netif_change_flags+0xfe/0x190 [ 17.162669][ T292] do_setlink.isra.0+0x1cc3/0x2750 [ 17.162777][ T292] rtnl_newlink+0x8d1/0xef0 [ 17.162873][ T292] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 17.162970][ T292] netlink_rcv_skb+0x14e/0x3a0 [ 17.163075][ T292] netlink_unicast+0x486/0x750 [ 17.163173][ T292] netlink_sendmsg+0x735/0xc60 [ 17.163270][ T292] ____sys_sendmsg+0x419/0x850 [ 17.163366][ T292] ___sys_sendmsg+0x14e/0x1d0 [ 17.163461][ T292] __sys_sendmsg+0x145/0x1f0 [ 17.163559][ T292] do_syscall_64+0x117/0x590 [ 17.163655][ T292] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 17.163769][ T292] HARDIRQ-ON-R at: [ 17.163830][ T292] __lock_acquire+0x378/0xc10 [ 17.163930][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.164031][ T292] _raw_read_lock_bh+0x44/0x80 [ 17.164126][ T292] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 17.164251][ T292] inet6_fill_link_af+0x5c/0xe0 [ 17.164349][ T292] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 17.164463][ T292] rtnl_getlink+0x9c9/0xeb0 [ 17.164562][ T292] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 17.164658][ T292] netlink_rcv_skb+0x14e/0x3a0 [ 17.164754][ T292] netlink_unicast+0x486/0x750 [ 17.164854][ T292] netlink_sendmsg+0x735/0xc60 [ 17.164956][ T292] ____sys_sendmsg+0x419/0x850 [ 17.165054][ T292] ___sys_sendmsg+0x14e/0x1d0 [ 17.165154][ T292] __sys_sendmsg+0x145/0x1f0 [ 17.165254][ T292] do_syscall_64+0x117/0x590 [ 17.165351][ T292] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 17.165466][ T292] IN-SOFTIRQ-R at: [ 17.165524][ T292] __lock_acquire+0x378/0xc10 [ 17.165621][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.165716][ T292] _raw_read_lock_bh+0x44/0x80 [ 17.165819][ T292] ipv6_get_lladdr+0xa8/0x3f0 [ 17.165917][ T292] ndisc_send_ns+0xf3/0x120 [ 17.166023][ T292] ndisc_solicit+0x314/0x480 [ 17.166121][ T292] neigh_probe+0xb3/0x100 [ 17.166217][ T292] __neigh_event_send+0x802/0x1070 [ 17.166314][ T292] neigh_resolve_output+0xbe/0x140 [ 17.166416][ T292] ip6_finish_output2+0x423/0x1300 [ 17.166520][ T292] ip6_finish_output+0x646/0xda0 [ 17.166620][ T292] ip6_output+0x23f/0x7f0 [ 17.166722][ T292] ip6_forward+0x10f4/0x2bd0 [ 17.166825][ T292] ipv6_rcv+0x3c1/0x5a0 [ 17.166920][ T292] __netif_receive_skb_one_core+0xfc/0x180 [ 17.167045][ T292] process_backlog+0x2bc/0x1490 [ 17.167148][ T292] __napi_poll+0xa7/0x3b0 [ 17.167245][ T292] net_rx_action+0x513/0xf50 [ 17.167342][ T292] handle_softirqs+0x1d8/0x940 [ 17.167439][ T292] do_softirq+0xa9/0xe0 [ 17.167535][ T292] __local_bh_enable_ip+0x113/0x140 [ 17.167629][ T292] __neigh_event_send+0x30a/0x1070 [ 17.167723][ T292] neigh_resolve_output+0xbe/0x140 [ 17.167821][ T292] ip6_finish_output2+0x423/0x1300 [ 17.167916][ T292] ip6_finish_output+0x646/0xda0 [ 17.168011][ T292] ip6_output+0x23f/0x7f0 [ 17.168105][ T292] ip6_send_skb+0xee/0x350 [ 17.168199][ T292] rawv6_push_pending_frames+0x4cb/0xa90 [ 17.168331][ T292] rawv6_sendmsg+0x1434/0x1a50 [ 17.168432][ T292] __sys_sendto+0x2c9/0x400 [ 17.168527][ T292] __x64_sys_sendto+0xe4/0x1f0 [ 17.168622][ T292] do_syscall_64+0x117/0x590 [ 17.168717][ T292] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 17.168836][ T292] INITIAL USE at: [ 17.168894][ T292] __lock_acquire+0x378/0xc10 [ 17.168989][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.169084][ T292] _raw_write_lock_bh+0x38/0x50 [ 17.169179][ T292] addrconf_permanent_addr+0x108/0x9c0 [ 17.169293][ T292] addrconf_notify+0x151/0xf30 [ 17.169430][ T292] notifier_call_chain+0xb0/0x320 [ 17.169526][ T292] __dev_notify_flags+0xde/0x280 [ 17.169629][ T292] netif_change_flags+0xfe/0x190 [ 17.169762][ T292] do_setlink.isra.0+0x1cc3/0x2750 [ 17.169866][ T292] rtnl_newlink+0x8d1/0xef0 [ 17.169961][ T292] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 17.170057][ T292] netlink_rcv_skb+0x14e/0x3a0 [ 17.170192][ T292] netlink_unicast+0x486/0x750 [ 17.170289][ T292] netlink_sendmsg+0x735/0xc60 [ 17.170384][ T292] ____sys_sendmsg+0x419/0x850 [ 17.170528][ T292] ___sys_sendmsg+0x14e/0x1d0 [ 17.170625][ T292] __sys_sendmsg+0x145/0x1f0 [ 17.170719][ T292] do_syscall_64+0x117/0x590 [ 17.170860][ T292] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 17.170977][ T292] INITIAL READ USE at: [ 17.171053][ T292] __lock_acquire+0x378/0xc10 [ 17.171187][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.171307][ T292] _raw_read_lock_bh+0x44/0x80 [ 17.171402][ T292] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 17.171557][ T292] inet6_fill_link_af+0x5c/0xe0 [ 17.171657][ T292] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 17.171771][ T292] rtnl_getlink+0x9c9/0xeb0 [ 17.171914][ T292] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 17.172009][ T292] netlink_rcv_skb+0x14e/0x3a0 [ 17.172103][ T292] netlink_unicast+0x486/0x750 [ 17.172237][ T292] netlink_sendmsg+0x735/0xc60 [ 17.172332][ T292] ____sys_sendmsg+0x419/0x850 [ 17.172429][ T292] ___sys_sendmsg+0x14e/0x1d0 [ 17.172568][ T292] __sys_sendmsg+0x145/0x1f0 [ 17.172663][ T292] do_syscall_64+0x117/0x590 [ 17.172757][ T292] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 17.172914][ T292] } [ 17.172954][ T292] ... key at: [] __key.37+0x0/0x40 [ 17.173076][ T292] ... acquired at: [ 17.173135][ T292] __lock_acquire+0x508/0xc10 [ 17.173213][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.173328][ T292] _raw_spin_lock+0x33/0x40 [ 17.173405][ T292] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 17.173498][ T292] __ipv6_dev_ac_inc+0x57e/0x930 [ 17.173618][ T292] addrconf_join_anycast+0x1bc/0x260 [ 17.173694][ T292] __ipv6_ifa_notify+0x75b/0xad0 [ 17.173781][ T292] addrconf_dad_completed+0x14b/0xe10 [ 17.173861][ T292] addrconf_dad_work+0x3c1/0x930 [ 17.173975][ T292] process_one_work+0xdf8/0x1410 [ 17.174052][ T292] worker_thread+0x4f1/0xd60 [ 17.174129][ T292] kthread+0x367/0x460 [ 17.174187][ T292] ret_from_fork+0x474/0x6b0 [ 17.174272][ T292] ret_from_fork_asm+0x11/0x20 [ 17.174388][ T292] [ 17.174428][ T292] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 17.174506][ T292] HARDIRQ-ON-W at: [ 17.174563][ T292] __lock_acquire+0x378/0xc10 [ 17.174702][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.174801][ T292] _raw_spin_lock+0x33/0x40 [ 17.174896][ T292] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 17.175048][ T292] __ipv6_dev_ac_inc+0x57e/0x930 [ 17.175142][ T292] addrconf_join_anycast+0x1bc/0x260 [ 17.175237][ T292] __ipv6_ifa_notify+0x75b/0xad0 [ 17.175373][ T292] addrconf_dad_completed+0x14b/0xe10 [ 17.175484][ T292] addrconf_dad_work+0x3c1/0x930 [ 17.175579][ T292] process_one_work+0xdf8/0x1410 [ 17.175683][ T292] worker_thread+0x4f1/0xd60 [ 17.175821][ T292] kthread+0x367/0x460 [ 17.175897][ T292] ret_from_fork+0x474/0x6b0 [ 17.175999][ T292] ret_from_fork_asm+0x11/0x20 [ 17.176135][ T292] SOFTIRQ-ON-W at: [ 17.176193][ T292] __lock_acquire+0x378/0xc10 [ 17.176297][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.176393][ T292] _raw_spin_lock+0x33/0x40 [ 17.176529][ T292] __ipv6_dev_ac_dec+0x236/0x5d0 [ 17.176625][ T292] addrconf_leave_anycast+0x1bc/0x260 [ 17.176720][ T292] dev_forward_change+0x3b3/0x850 [ 17.176864][ T292] addrconf_fixup_forwarding+0x2af/0x4d0 [ 17.176977][ T292] addrconf_sysctl_forward+0x209/0x2b0 [ 17.177072][ T292] proc_sys_call_handler+0x31b/0x480 [ 17.177211][ T292] new_sync_write+0x333/0x750 [ 17.177306][ T292] vfs_write+0x6a4/0xc10 [ 17.177400][ T292] ksys_write+0x116/0x250 [ 17.177536][ T292] do_syscall_64+0x117/0x590 [ 17.177631][ T292] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 17.177744][ T292] INITIAL USE at: [ 17.177848][ T292] __lock_acquire+0x378/0xc10 [ 17.177953][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.178046][ T292] _raw_spin_lock+0x33/0x40 [ 17.178150][ T292] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 17.178307][ T292] __ipv6_dev_ac_inc+0x57e/0x930 [ 17.178402][ T292] addrconf_join_anycast+0x1bc/0x260 [ 17.178505][ T292] __ipv6_ifa_notify+0x75b/0xad0 [ 17.178649][ T292] addrconf_dad_completed+0x14b/0xe10 [ 17.178744][ T292] addrconf_dad_work+0x3c1/0x930 [ 17.178843][ T292] process_one_work+0xdf8/0x1410 [ 17.178984][ T292] worker_thread+0x4f1/0xd60 [ 17.179079][ T292] kthread+0x367/0x460 [ 17.179154][ T292] ret_from_fork+0x474/0x6b0 [ 17.179289][ T292] ret_from_fork_asm+0x11/0x20 [ 17.179385][ T292] } [ 17.179422][ T292] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 17.179544][ T292] ... acquired at: [ 17.179647][ T292] mark_lock+0x1d7/0xa00 [ 17.179723][ T292] mark_usage+0x105/0x170 [ 17.179811][ T292] __lock_acquire+0x378/0xc10 [ 17.179886][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.180001][ T292] _raw_spin_lock+0x33/0x40 [ 17.180075][ T292] __ipv6_dev_ac_dec+0x236/0x5d0 [ 17.180155][ T292] addrconf_leave_anycast+0x1bc/0x260 [ 17.180233][ T292] dev_forward_change+0x3b3/0x850 [ 17.180350][ T292] addrconf_fixup_forwarding+0x2af/0x4d0 [ 17.180445][ T292] addrconf_sysctl_forward+0x209/0x2b0 [ 17.180520][ T292] proc_sys_call_handler+0x31b/0x480 [ 17.180600][ T292] new_sync_write+0x333/0x750 [ 17.180715][ T292] vfs_write+0x6a4/0xc10 [ 17.180795][ T292] ksys_write+0x116/0x250 [ 17.180871][ T292] do_syscall_64+0x117/0x590 [ 17.180947][ T292] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 17.181088][ T292] [ 17.181126][ T292] [ 17.181126][ T292] stack backtrace: [ 17.181220][ T292] CPU: 3 UID: 0 PID: 292 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 17.181224][ T292] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 17.181226][ T292] Call Trace: [ 17.181227][ T292] [ 17.181229][ T292] dump_stack_lvl+0x6f/0xa0 [ 17.181233][ T292] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 17.181236][ T292] mark_lock_irq+0x989/0x9c0 [ 17.181239][ T292] mark_lock+0x1d7/0xa00 [ 17.181240][ T292] mark_usage+0x105/0x170 [ 17.181242][ T292] __lock_acquire+0x378/0xc10 [ 17.181244][ T292] lock_acquire.part.0+0xbc/0x260 [ 17.181245][ T292] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 17.181247][ T292] ? rcu_is_watching+0x15/0xd0 [ 17.181250][ T292] ? do_raw_read_unlock+0x70/0x70 [ 17.181252][ T292] ? lock_acquire+0x134/0x160 [ 17.181254][ T292] _raw_spin_lock+0x33/0x40 [ 17.181255][ T292] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 17.181257][ T292] __ipv6_dev_ac_dec+0x236/0x5d0 [ 17.181259][ T292] addrconf_leave_anycast+0x1bc/0x260 [ 17.181260][ T292] ? find_held_lock+0x2b/0x80 [ 17.181263][ T292] ? __ipv6_isatap_ifid+0x210/0x210 [ 17.181265][ T292] ? mark_held_locks+0x40/0x70 [ 17.181266][ T292] ? lockdep_hardirqs_on+0x8c/0x130 [ 17.181269][ T292] dev_forward_change+0x3b3/0x850 [ 17.181271][ T292] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 17.181273][ T292] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 17.181276][ T292] addrconf_fixup_forwarding+0x2af/0x4d0 [ 17.181278][ T292] addrconf_sysctl_forward+0x209/0x2b0 [ 17.181280][ T292] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 17.181282][ T292] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 17.181284][ T292] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 17.181287][ T292] ? proc_sys_call_handler+0x25d/0x480 [ 17.181290][ T292] proc_sys_call_handler+0x31b/0x480 [ 17.181292][ T292] ? proc_sys_lookup+0x3d0/0x3d0 [ 17.181294][ T292] ? rcu_read_unlock+0x1b/0x70 [ 17.181296][ T292] ? do_raw_spin_unlock+0x59/0x250 [ 17.181298][ T292] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 17.181300][ T292] ? rcu_read_lock_any_held+0x3c/0x90 [ 17.181302][ T292] ? proc_sys_call_handler+0x480/0x480 [ 17.181304][ T292] new_sync_write+0x333/0x750 [ 17.181305][ T292] ? __lock_acquire+0x508/0xc10 [ 17.181307][ T292] ? new_sync_read+0x740/0x740 [ 17.181308][ T292] ? lock_acquire.part.0+0xbc/0x260 [ 17.181309][ T292] ? ksys_write+0x116/0x250 [ 17.181312][ T292] vfs_write+0x6a4/0xc10 [ 17.181313][ T292] ksys_write+0x116/0x250 [ 17.181315][ T292] ? __ia32_sys_read+0xc0/0xc0 [ 17.181316][ T292] ? rcu_is_watching+0x15/0xd0 [ 17.181318][ T292] ? rcu_is_watching+0x15/0xd0 [ 17.181320][ T292] do_syscall_64+0x117/0x590 [ 17.181321][ T292] ? trace_hardirqs_off+0xd/0x30 [ 17.181324][ T292] ? exc_page_fault+0xee/0x100 [ 17.181326][ T292] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 17.181327][ T292] RIP: 0033:0x7f34e773908e [ 17.181330][ T292] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 17.181332][ T292] RSP: 002b:00007ffe60b9cef0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 17.181334][ T292] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f34e773908e [ 17.181336][ T292] RDX: 0000000000000002 RSI: 000056302810e4b0 RDI: 0000000000000005 [ 17.181337][ T292] RBP: 00007ffe60b9cf00 R08: 0000000000000000 R09: 0000000000000000 [ 17.181338][ T292] R10: 0000000000000000 R11: 0000000000000202 R12: 00005630281105e0 [ 17.181338][ T292] R13: 000056302810e470 R14: 0000000000000002 R15: 0000000000000000 [ 17.181341][ T292]