[ 9.812274][ T218] veth0: entered allmulticast mode [ 9.821206][ T218] veth1: entered allmulticast mode [ 9.821518][ T218] veth2: entered allmulticast mode [ 9.821807][ T218] veth3: entered allmulticast mode [ 18.336821][ T310] GACT probability NOT on [ 19.987531][ T443] [ 19.987614][ T443] ======================================================== [ 19.987732][ T443] WARNING: possible irq lock inversion dependency detected [ 19.987846][ T443] 7.1.0-rc5-virtme #1 Not tainted [ 19.987927][ T443] -------------------------------------------------------- [ 19.988048][ T443] sysctl/443 just changed the state of lock: [ 19.988143][ T443] ffffffffb5f7e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 19.988294][ T443] but this lock was taken by another, SOFTIRQ-READ-safe lock in the past: [ 19.988414][ T443] (&ndev->lock){++.-}-{3:3} [ 19.988417][ T443] [ 19.988417][ T443] [ 19.988417][ T443] and interrupts could create inverse lock ordering between them. [ 19.988417][ T443] [ 19.988704][ T443] [ 19.988704][ T443] other info that might help us debug this: [ 19.988819][ T443] Possible interrupt unsafe locking scenario: [ 19.988819][ T443] [ 19.988935][ T443] CPU0 CPU1 [ 19.989016][ T443] ---- ---- [ 19.989094][ T443] lock(acaddr_hash_lock); [ 19.989174][ T443] local_irq_disable(); [ 19.989319][ T443] lock(&ndev->lock); [ 19.989418][ T443] lock(acaddr_hash_lock); [ 19.989515][ T443] [ 19.989613][ T443] lock(&ndev->lock); [ 19.989674][ T443] [ 19.989674][ T443] *** DEADLOCK *** [ 19.989674][ T443] [ 19.989789][ T443] 2 locks held by sysctl/443: [ 19.989867][ T443] #0: ff11000009bd43e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 19.990054][ T443] #1: ffffffffb5e8c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 19.990215][ T443] [ 19.990215][ T443] the shortest dependencies between 2nd lock and 1st lock: [ 19.990390][ T443] -> (&ndev->lock){++.-}-{3:3} { [ 19.990472][ T443] HARDIRQ-ON-W at: [ 19.990533][ T443] __lock_acquire+0x378/0xc10 [ 19.990676][ T443] lock_acquire.part.0+0xbc/0x260 [ 19.990774][ T443] _raw_write_lock_bh+0x38/0x50 [ 19.990872][ T443] addrconf_permanent_addr+0x108/0x9c0 [ 19.991032][ T443] addrconf_notify+0x151/0xf30 [ 19.991129][ T443] notifier_call_chain+0xb0/0x320 [ 19.991234][ T443] __dev_notify_flags+0xde/0x280 [ 19.991331][ T443] netif_change_flags+0xfe/0x190 [ 19.991469][ T443] do_setlink.isra.0+0x1cc3/0x2750 [ 19.991569][ T443] rtnl_newlink+0x8d1/0xef0 [ 19.991669][ T443] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 19.991807][ T443] netlink_rcv_skb+0x14e/0x3a0 [ 19.991905][ T443] netlink_unicast+0x486/0x750 [ 19.992005][ T443] netlink_sendmsg+0x735/0xc60 [ 19.992146][ T443] ____sys_sendmsg+0x419/0x850 [ 19.992248][ T443] ___sys_sendmsg+0x14e/0x1d0 [ 19.992347][ T443] __sys_sendmsg+0x145/0x1f0 [ 19.992485][ T443] do_syscall_64+0x117/0x590 [ 19.992586][ T443] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 19.992705][ T443] HARDIRQ-ON-R at: [ 19.992764][ T443] __lock_acquire+0x378/0xc10 [ 19.992902][ T443] lock_acquire.part.0+0xbc/0x260 [ 19.993001][ T443] _raw_read_lock_bh+0x44/0x80 [ 19.993098][ T443] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 19.993259][ T443] inet6_fill_link_af+0x5c/0xe0 [ 19.993357][ T443] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 19.993474][ T443] rtnl_getlink+0x9c9/0xeb0 [ 19.993616][ T443] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 19.993713][ T443] netlink_rcv_skb+0x14e/0x3a0 [ 19.993807][ T443] netlink_unicast+0x486/0x750 [ 19.993946][ T443] netlink_sendmsg+0x735/0xc60 [ 19.994044][ T443] ____sys_sendmsg+0x419/0x850 [ 19.994141][ T443] ___sys_sendmsg+0x14e/0x1d0 [ 19.994283][ T443] __sys_sendmsg+0x145/0x1f0 [ 19.994381][ T443] do_syscall_64+0x117/0x590 [ 19.994479][ T443] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 19.994637][ T443] IN-SOFTIRQ-R at: [ 19.994694][ T443] __lock_acquire+0x378/0xc10 [ 19.994791][ T443] lock_acquire.part.0+0xbc/0x260 [ 19.994888][ T443] _raw_read_lock_bh+0x44/0x80 [ 19.995028][ T443] ipv6_get_lladdr+0xa8/0x3f0 [ 19.995125][ T443] ndisc_send_ns+0xf3/0x120 [ 19.995228][ T443] ndisc_solicit+0x314/0x480 [ 19.995367][ T443] neigh_probe+0xb3/0x100 [ 19.995465][ T443] __neigh_event_send+0x802/0x1070 [ 19.995562][ T443] neigh_resolve_output+0xbe/0x140 [ 19.995703][ T443] ip6_finish_output2+0x423/0x1300 [ 19.995800][ T443] ip6_finish_output+0x646/0xda0 [ 19.995897][ T443] ip6_output+0x23f/0x7f0 [ 19.996037][ T443] ip6_forward+0x10f4/0x2bd0 [ 19.996134][ T443] ipv6_rcv+0x3c1/0x5a0 [ 19.996258][ T443] __netif_receive_skb_one_core+0xfc/0x180 [ 19.996417][ T443] process_backlog+0x2bc/0x1490 [ 19.996513][ T443] __napi_poll+0xa7/0x3b0 [ 19.996611][ T443] net_rx_action+0x513/0xf50 [ 19.996749][ T443] handle_softirqs+0x1d8/0x940 [ 19.996848][ T443] do_softirq+0xa9/0xe0 [ 19.996948][ T443] __local_bh_enable_ip+0x113/0x140 [ 19.997045][ T443] __neigh_event_send+0x30a/0x1070 [ 19.997186][ T443] neigh_resolve_output+0xbe/0x140 [ 19.997284][ T443] ip6_finish_output2+0x423/0x1300 [ 19.997381][ T443] ip6_finish_output+0x646/0xda0 [ 19.997521][ T443] ip6_output+0x23f/0x7f0 [ 19.997622][ T443] ip6_send_skb+0xee/0x350 [ 19.997720][ T443] rawv6_push_pending_frames+0x4cb/0xa90 [ 19.997876][ T443] rawv6_sendmsg+0x1434/0x1a50 [ 19.997975][ T443] __sys_sendto+0x2c9/0x400 [ 19.998072][ T443] __x64_sys_sendto+0xe4/0x1f0 [ 19.998218][ T443] do_syscall_64+0x117/0x590 [ 19.998315][ T443] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 19.998430][ T443] INITIAL USE at: [ 19.998530][ T443] __lock_acquire+0x378/0xc10 [ 19.998628][ T443] lock_acquire.part.0+0xbc/0x260 [ 19.998725][ T443] _raw_write_lock_bh+0x38/0x50 [ 19.998824][ T443] addrconf_permanent_addr+0x108/0x9c0 [ 19.998985][ T443] addrconf_notify+0x151/0xf30 [ 19.999082][ T443] notifier_call_chain+0xb0/0x320 [ 19.999183][ T443] __dev_notify_flags+0xde/0x280 [ 19.999322][ T443] netif_change_flags+0xfe/0x190 [ 19.999421][ T443] do_setlink.isra.0+0x1cc3/0x2750 [ 19.999520][ T443] rtnl_newlink+0x8d1/0xef0 [ 19.999661][ T443] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 19.999761][ T443] netlink_rcv_skb+0x14e/0x3a0 [ 19.999860][ T443] netlink_unicast+0x486/0x750 [ 20.000001][ T443] netlink_sendmsg+0x735/0xc60 [ 20.000100][ T443] ____sys_sendmsg+0x419/0x850 [ 20.000203][ T443] ___sys_sendmsg+0x14e/0x1d0 [ 20.000342][ T443] __sys_sendmsg+0x145/0x1f0 [ 20.000440][ T443] do_syscall_64+0x117/0x590 [ 20.000538][ T443] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.000699][ T443] INITIAL READ USE at: [ 20.000779][ T443] __lock_acquire+0x378/0xc10 [ 20.000878][ T443] lock_acquire.part.0+0xbc/0x260 [ 20.001039][ T443] _raw_read_lock_bh+0x44/0x80 [ 20.001137][ T443] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 20.001260][ T443] inet6_fill_link_af+0x5c/0xe0 [ 20.001399][ T443] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 20.001519][ T443] rtnl_getlink+0x9c9/0xeb0 [ 20.001616][ T443] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 20.001758][ T443] netlink_rcv_skb+0x14e/0x3a0 [ 20.001858][ T443] netlink_unicast+0x486/0x750 [ 20.001957][ T443] netlink_sendmsg+0x735/0xc60 [ 20.002056][ T443] ____sys_sendmsg+0x419/0x850 [ 20.002201][ T443] ___sys_sendmsg+0x14e/0x1d0 [ 20.002300][ T443] __sys_sendmsg+0x145/0x1f0 [ 20.002399][ T443] do_syscall_64+0x117/0x590 [ 20.002540][ T443] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.002659][ T443] } [ 20.002702][ T443] ... key at: [] __key.37+0x0/0x40 [ 20.002865][ T443] ... acquired at: [ 20.002925][ T443] __lock_acquire+0x508/0xc10 [ 20.003008][ T443] lock_acquire.part.0+0xbc/0x260 [ 20.003087][ T443] _raw_spin_lock+0x33/0x40 [ 20.003213][ T443] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 20.003311][ T443] __ipv6_dev_ac_inc+0x57e/0x930 [ 20.003388][ T443] addrconf_join_anycast+0x1bc/0x260 [ 20.003467][ T443] __ipv6_ifa_notify+0x75b/0xad0 [ 20.003587][ T443] addrconf_dad_completed+0x14b/0xe10 [ 20.003666][ T443] addrconf_dad_work+0x3c1/0x930 [ 20.003744][ T443] process_one_work+0xdf8/0x1410 [ 20.003824][ T443] worker_thread+0x4f1/0xd60 [ 20.003944][ T443] kthread+0x367/0x460 [ 20.004004][ T443] ret_from_fork+0x474/0x6b0 [ 20.004084][ T443] ret_from_fork_asm+0x11/0x20 [ 20.004165][ T443] [ 20.004210][ T443] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 20.004336][ T443] HARDIRQ-ON-W at: [ 20.004396][ T443] __lock_acquire+0x378/0xc10 [ 20.004497][ T443] lock_acquire.part.0+0xbc/0x260 [ 20.004594][ T443] _raw_spin_lock+0x33/0x40 [ 20.004737][ T443] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 20.004858][ T443] __ipv6_dev_ac_inc+0x57e/0x930 [ 20.004959][ T443] addrconf_join_anycast+0x1bc/0x260 [ 20.005102][ T443] __ipv6_ifa_notify+0x75b/0xad0 [ 20.005205][ T443] addrconf_dad_completed+0x14b/0xe10 [ 20.005306][ T443] addrconf_dad_work+0x3c1/0x930 [ 20.005449][ T443] process_one_work+0xdf8/0x1410 [ 20.005551][ T443] worker_thread+0x4f1/0xd60 [ 20.005651][ T443] kthread+0x367/0x460 [ 20.005772][ T443] ret_from_fork+0x474/0x6b0 [ 20.005871][ T443] ret_from_fork_asm+0x11/0x20 [ 20.005972][ T443] SOFTIRQ-ON-W at: [ 20.006032][ T443] __lock_acquire+0x378/0xc10 [ 20.006173][ T443] lock_acquire.part.0+0xbc/0x260 [ 20.006277][ T443] _raw_spin_lock+0x33/0x40 [ 20.006377][ T443] __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.006518][ T443] addrconf_leave_anycast+0x1bc/0x260 [ 20.006616][ T443] dev_forward_change+0x3b3/0x850 [ 20.006718][ T443] addrconf_fixup_forwarding+0x2af/0x4d0 [ 20.006877][ T443] addrconf_sysctl_forward+0x209/0x2b0 [ 20.006978][ T443] proc_sys_call_handler+0x31b/0x480 [ 20.007079][ T443] new_sync_write+0x333/0x750 [ 20.007227][ T443] vfs_write+0x6a4/0xc10 [ 20.007327][ T443] ksys_write+0x116/0x250 [ 20.007429][ T443] do_syscall_64+0x117/0x590 [ 20.007570][ T443] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.007690][ T443] INITIAL USE at: [ 20.007749][ T443] __lock_acquire+0x378/0xc10 [ 20.007849][ T443] lock_acquire.part.0+0xbc/0x260 [ 20.007993][ T443] _raw_spin_lock+0x33/0x40 [ 20.008095][ T443] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 20.008216][ T443] __ipv6_dev_ac_inc+0x57e/0x930 [ 20.008357][ T443] addrconf_join_anycast+0x1bc/0x260 [ 20.008456][ T443] __ipv6_ifa_notify+0x75b/0xad0 [ 20.008556][ T443] addrconf_dad_completed+0x14b/0xe10 [ 20.008699][ T443] addrconf_dad_work+0x3c1/0x930 [ 20.008798][ T443] process_one_work+0xdf8/0x1410 [ 20.008898][ T443] worker_thread+0x4f1/0xd60 [ 20.009045][ T443] kthread+0x367/0x460 [ 20.009129][ T443] ret_from_fork+0x474/0x6b0 [ 20.009235][ T443] ret_from_fork_asm+0x11/0x20 [ 20.009334][ T443] } [ 20.009416][ T443] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 20.009536][ T443] ... acquired at: [ 20.009593][ T443] mark_lock+0x1d7/0xa00 [ 20.009671][ T443] mark_usage+0x105/0x170 [ 20.009790][ T443] __lock_acquire+0x378/0xc10 [ 20.009870][ T443] lock_acquire.part.0+0xbc/0x260 [ 20.009952][ T443] _raw_spin_lock+0x33/0x40 [ 20.010031][ T443] __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.010152][ T443] addrconf_leave_anycast+0x1bc/0x260 [ 20.010234][ T443] dev_forward_change+0x3b3/0x850 [ 20.010312][ T443] addrconf_fixup_forwarding+0x2af/0x4d0 [ 20.010409][ T443] addrconf_sysctl_forward+0x209/0x2b0 [ 20.010529][ T443] proc_sys_call_handler+0x31b/0x480 [ 20.010608][ T443] new_sync_write+0x333/0x750 [ 20.010686][ T443] vfs_write+0x6a4/0xc10 [ 20.010767][ T443] ksys_write+0x116/0x250 [ 20.010887][ T443] do_syscall_64+0x117/0x590 [ 20.010967][ T443] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.011066][ T443] [ 20.011106][ T443] [ 20.011106][ T443] stack backtrace: [ 20.011254][ T443] CPU: 2 UID: 0 PID: 443 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 20.011257][ T443] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 20.011259][ T443] Call Trace: [ 20.011260][ T443] [ 20.011262][ T443] dump_stack_lvl+0x6f/0xa0 [ 20.011266][ T443] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 20.011269][ T443] mark_lock_irq+0x989/0x9c0 [ 20.011272][ T443] mark_lock+0x1d7/0xa00 [ 20.011274][ T443] mark_usage+0x105/0x170 [ 20.011275][ T443] __lock_acquire+0x378/0xc10 [ 20.011277][ T443] lock_acquire.part.0+0xbc/0x260 [ 20.011279][ T443] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.011281][ T443] ? rcu_is_watching+0x15/0xd0 [ 20.011284][ T443] ? do_raw_read_unlock+0x70/0x70 [ 20.011286][ T443] ? lock_acquire+0x134/0x160 [ 20.011288][ T443] _raw_spin_lock+0x33/0x40 [ 20.011289][ T443] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.011291][ T443] __ipv6_dev_ac_dec+0x236/0x5d0 [ 20.011293][ T443] addrconf_leave_anycast+0x1bc/0x260 [ 20.011294][ T443] ? find_held_lock+0x2b/0x80 [ 20.011297][ T443] ? __ipv6_isatap_ifid+0x210/0x210 [ 20.011299][ T443] ? mark_held_locks+0x40/0x70 [ 20.011300][ T443] ? lockdep_hardirqs_on+0x8c/0x130 [ 20.011303][ T443] dev_forward_change+0x3b3/0x850 [ 20.011305][ T443] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 20.011307][ T443] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 20.011309][ T443] addrconf_fixup_forwarding+0x2af/0x4d0 [ 20.011312][ T443] addrconf_sysctl_forward+0x209/0x2b0 [ 20.011314][ T443] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 20.011316][ T443] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 20.011318][ T443] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 20.011321][ T443] ? proc_sys_call_handler+0x25d/0x480 [ 20.011324][ T443] proc_sys_call_handler+0x31b/0x480 [ 20.011326][ T443] ? proc_sys_lookup+0x3d0/0x3d0 [ 20.011328][ T443] ? rcu_read_unlock+0x1b/0x70 [ 20.011330][ T443] ? do_raw_spin_unlock+0x59/0x250 [ 20.011332][ T443] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 20.011334][ T443] ? rcu_read_lock_any_held+0x3c/0x90 [ 20.011336][ T443] ? proc_sys_call_handler+0x480/0x480 [ 20.011338][ T443] new_sync_write+0x333/0x750 [ 20.011339][ T443] ? __lock_acquire+0x508/0xc10 [ 20.011341][ T443] ? new_sync_read+0x740/0x740 [ 20.011343][ T443] ? lock_acquire.part.0+0xbc/0x260 [ 20.011344][ T443] ? ksys_write+0x116/0x250 [ 20.011346][ T443] vfs_write+0x6a4/0xc10 [ 20.011348][ T443] ksys_write+0x116/0x250 [ 20.011349][ T443] ? __ia32_sys_read+0xc0/0xc0 [ 20.011351][ T443] ? rcu_is_watching+0x15/0xd0 [ 20.011352][ T443] ? rcu_is_watching+0x15/0xd0 [ 20.011354][ T443] do_syscall_64+0x117/0x590 [ 20.011356][ T443] ? trace_hardirqs_off+0xd/0x30 [ 20.011359][ T443] ? exc_page_fault+0xee/0x100 [ 20.011361][ T443] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 20.011362][ T443] RIP: 0033:0x7f03bfe3b08e [ 20.011366][ T443] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 20.011367][ T443] RSP: 002b:00007ffe906626f0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 20.011370][ T443] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f03bfe3b08e [ 20.011372][ T443] RDX: 0000000000000002 RSI: 0000559ed5dfa4b0 RDI: 0000000000000005 [ 20.011373][ T443] RBP: 00007ffe90662700 R08: 0000000000000000 R09: 0000000000000000 [ 20.011374][ T443] R10: 0000000000000000 R11: 0000000000000202 R12: 0000559ed5dfc5e0 [ 20.011374][ T443] R13: 0000559ed5dfa470 R14: 0000000000000002 R15: 0000000000000000 [ 20.011377][ T443] [ 20.568866][ T218] veth0: left allmulticast mode [ 20.569087][ T218] veth1: left allmulticast mode [ 20.569245][ T218] veth2: left allmulticast mode [ 20.569396][ T218] veth3: left allmulticast mode