[ 30.534068][ T573] veth0: entered allmulticast mode [ 30.534657][ T573] veth1: entered allmulticast mode [ 30.534941][ T573] veth2: entered allmulticast mode [ 30.535228][ T573] veth3: entered allmulticast mode [ 30.535507][ T573] veth4: entered allmulticast mode [ 30.535774][ T573] veth5: entered allmulticast mode [ 38.585482][ T759] mausezahn (759) used greatest stack depth: 23904 bytes left [ 40.458810][ T907] [ 40.458894][ T907] ======================================================== [ 40.458999][ T907] WARNING: possible irq lock inversion dependency detected [ 40.459101][ T907] 7.1.0-rc5-virtme #1 Not tainted [ 40.459172][ T907] -------------------------------------------------------- [ 40.459271][ T907] sysctl/907 just changed the state of lock: [ 40.459362][ T907] ffffffffb2d7e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 40.459487][ T907] but this lock was taken by another, SOFTIRQ-safe lock in the past: [ 40.459588][ T907] (&ndev->lock){++--}-{3:3} [ 40.459590][ T907] [ 40.459590][ T907] [ 40.459590][ T907] and interrupts could create inverse lock ordering between them. [ 40.459590][ T907] [ 40.459839][ T907] [ 40.459839][ T907] other info that might help us debug this: [ 40.459940][ T907] Possible interrupt unsafe locking scenario: [ 40.459940][ T907] [ 40.460036][ T907] CPU0 CPU1 [ 40.460103][ T907] ---- ---- [ 40.460169][ T907] lock(acaddr_hash_lock); [ 40.460238][ T907] local_irq_disable(); [ 40.460329][ T907] lock(&ndev->lock); [ 40.460413][ T907] lock(acaddr_hash_lock); [ 40.460498][ T907] [ 40.460553][ T907] lock(&ndev->lock); [ 40.460605][ T907] [ 40.460605][ T907] *** DEADLOCK *** [ 40.460605][ T907] [ 40.460702][ T907] 2 locks held by sysctl/907: [ 40.460769][ T907] #0: ff1100000a15c3e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 40.460889][ T907] #1: ffffffffb2c8c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 40.461024][ T907] [ 40.461024][ T907] the shortest dependencies between 2nd lock and 1st lock: [ 40.461137][ T907] -> (&ndev->lock){++--}-{3:3} { [ 40.461207][ T907] HARDIRQ-ON-W at: [ 40.461260][ T907] __lock_acquire+0x378/0xc10 [ 40.461352][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.461435][ T907] _raw_write_lock_bh+0x38/0x50 [ 40.461519][ T907] addrconf_permanent_addr+0x108/0x9c0 [ 40.461626][ T907] addrconf_notify+0x151/0xf30 [ 40.461713][ T907] notifier_call_chain+0xb0/0x320 [ 40.461796][ T907] __dev_notify_flags+0xde/0x280 [ 40.461879][ T907] netif_change_flags+0xfe/0x190 [ 40.461963][ T907] do_setlink.isra.0+0x1cc3/0x2750 [ 40.462045][ T907] rtnl_newlink+0x8d1/0xef0 [ 40.462130][ T907] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 40.462214][ T907] netlink_rcv_skb+0x14e/0x3a0 [ 40.462304][ T907] netlink_unicast+0x486/0x750 [ 40.462387][ T907] netlink_sendmsg+0x735/0xc60 [ 40.462469][ T907] ____sys_sendmsg+0x419/0x850 [ 40.462591][ T907] ___sys_sendmsg+0x14e/0x1d0 [ 40.462674][ T907] __sys_sendmsg+0x145/0x1f0 [ 40.462757][ T907] do_syscall_64+0x117/0x590 [ 40.462843][ T907] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 40.462946][ T907] HARDIRQ-ON-R at: [ 40.462995][ T907] __lock_acquire+0x378/0xc10 [ 40.463076][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.463160][ T907] _raw_read_lock_bh+0x44/0x80 [ 40.463243][ T907] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 40.463349][ T907] inet6_fill_link_af+0x5c/0xe0 [ 40.463432][ T907] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 40.463535][ T907] rtnl_getlink+0x9c9/0xeb0 [ 40.463618][ T907] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 40.463704][ T907] netlink_rcv_skb+0x14e/0x3a0 [ 40.463791][ T907] netlink_unicast+0x486/0x750 [ 40.463873][ T907] netlink_sendmsg+0x735/0xc60 [ 40.463957][ T907] ____sys_sendmsg+0x419/0x850 [ 40.464040][ T907] ___sys_sendmsg+0x14e/0x1d0 [ 40.464126][ T907] __sys_sendmsg+0x145/0x1f0 [ 40.464214][ T907] do_syscall_64+0x117/0x590 [ 40.464301][ T907] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 40.464401][ T907] IN-SOFTIRQ-W at: [ 40.464454][ T907] __lock_acquire+0x378/0xc10 [ 40.464536][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.464617][ T907] _raw_write_lock+0x33/0x40 [ 40.464704][ T907] addrconf_rs_timer+0xb0/0x770 [ 40.464788][ T907] call_timer_fn+0x163/0x4f0 [ 40.464873][ T907] __run_timers+0x68f/0xab0 [ 40.464958][ T907] run_timer_softirq+0xf0/0x160 [ 40.465043][ T907] handle_softirqs+0x1d8/0x940 [ 40.465128][ T907] __irq_exit_rcu+0x103/0x1c0 [ 40.465212][ T907] irq_exit_rcu+0xe/0x30 [ 40.465302][ T907] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 40.465401][ T907] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 40.465499][ T907] pv_native_safe_halt+0xf/0x10 [ 40.465581][ T907] default_idle+0x9/0x10 [ 40.465668][ T907] default_idle_call+0x6e/0xb0 [ 40.465751][ T907] cpuidle_idle_call.constprop.0+0x237/0x410 [ 40.465851][ T907] do_idle+0xf5/0x160 [ 40.465933][ T907] cpu_startup_entry+0x53/0x70 [ 40.466015][ T907] rest_init+0x1f7/0x200 [ 40.466100][ T907] start_kernel+0x3ad/0x3b0 [ 40.466185][ T907] x86_64_start_reservations+0x24/0x30 [ 40.466290][ T907] x86_64_start_kernel+0x12b/0x130 [ 40.466374][ T907] common_startup_64+0x13e/0x148 [ 40.466459][ T907] IN-SOFTIRQ-R at: [ 40.466509][ T907] __lock_acquire+0x378/0xc10 [ 40.466594][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.466710][ T907] _raw_read_lock_bh+0x44/0x80 [ 40.466794][ T907] ipv6_get_lladdr+0xa8/0x3f0 [ 40.466876][ T907] addrconf_rs_timer+0x251/0x770 [ 40.466960][ T907] call_timer_fn+0x163/0x4f0 [ 40.467045][ T907] __run_timers+0x68f/0xab0 [ 40.467127][ T907] run_timer_softirq+0xf0/0x160 [ 40.467211][ T907] handle_softirqs+0x1d8/0x940 [ 40.467299][ T907] __irq_exit_rcu+0x103/0x1c0 [ 40.467382][ T907] irq_exit_rcu+0xe/0x30 [ 40.467466][ T907] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 40.467568][ T907] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 40.467670][ T907] pv_native_safe_halt+0xf/0x10 [ 40.467753][ T907] default_idle+0x9/0x10 [ 40.467837][ T907] default_idle_call+0x6e/0xb0 [ 40.467920][ T907] cpuidle_idle_call.constprop.0+0x237/0x410 [ 40.468020][ T907] do_idle+0xf5/0x160 [ 40.468104][ T907] cpu_startup_entry+0x53/0x70 [ 40.468186][ T907] rest_init+0x1f7/0x200 [ 40.468270][ T907] start_kernel+0x3ad/0x3b0 [ 40.468359][ T907] x86_64_start_reservations+0x24/0x30 [ 40.468461][ T907] x86_64_start_kernel+0x12b/0x130 [ 40.468547][ T907] common_startup_64+0x13e/0x148 [ 40.468635][ T907] INITIAL USE at: [ 40.468687][ T907] __lock_acquire+0x378/0xc10 [ 40.468772][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.468855][ T907] _raw_write_lock_bh+0x38/0x50 [ 40.468942][ T907] addrconf_permanent_addr+0x108/0x9c0 [ 40.469042][ T907] addrconf_notify+0x151/0xf30 [ 40.469127][ T907] notifier_call_chain+0xb0/0x320 [ 40.469212][ T907] __dev_notify_flags+0xde/0x280 [ 40.469305][ T907] netif_change_flags+0xfe/0x190 [ 40.469390][ T907] do_setlink.isra.0+0x1cc3/0x2750 [ 40.469472][ T907] rtnl_newlink+0x8d1/0xef0 [ 40.469555][ T907] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 40.469637][ T907] netlink_rcv_skb+0x14e/0x3a0 [ 40.469721][ T907] netlink_unicast+0x486/0x750 [ 40.469804][ T907] netlink_sendmsg+0x735/0xc60 [ 40.469886][ T907] ____sys_sendmsg+0x419/0x850 [ 40.469970][ T907] ___sys_sendmsg+0x14e/0x1d0 [ 40.470058][ T907] __sys_sendmsg+0x145/0x1f0 [ 40.470142][ T907] do_syscall_64+0x117/0x590 [ 40.470225][ T907] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 40.470330][ T907] INITIAL READ USE at: [ 40.470396][ T907] __lock_acquire+0x378/0xc10 [ 40.470478][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.470577][ T907] _raw_read_lock_bh+0x44/0x80 [ 40.470659][ T907] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 40.470758][ T907] inet6_fill_link_af+0x5c/0xe0 [ 40.470840][ T907] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 40.470937][ T907] rtnl_getlink+0x9c9/0xeb0 [ 40.471021][ T907] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 40.471103][ T907] netlink_rcv_skb+0x14e/0x3a0 [ 40.471188][ T907] netlink_unicast+0x486/0x750 [ 40.471271][ T907] netlink_sendmsg+0x735/0xc60 [ 40.471359][ T907] ____sys_sendmsg+0x419/0x850 [ 40.471442][ T907] ___sys_sendmsg+0x14e/0x1d0 [ 40.471526][ T907] __sys_sendmsg+0x145/0x1f0 [ 40.471611][ T907] do_syscall_64+0x117/0x590 [ 40.471693][ T907] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 40.471792][ T907] } [ 40.471828][ T907] ... key at: [] __key.37+0x0/0x40 [ 40.471930][ T907] ... acquired at: [ 40.471981][ T907] __lock_acquire+0x508/0xc10 [ 40.472051][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.472117][ T907] _raw_spin_lock+0x33/0x40 [ 40.472183][ T907] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 40.472265][ T907] __ipv6_dev_ac_inc+0x57e/0x930 [ 40.472341][ T907] addrconf_join_anycast+0x1bc/0x260 [ 40.472406][ T907] __ipv6_ifa_notify+0x75b/0xad0 [ 40.472473][ T907] addrconf_dad_completed+0x14b/0xe10 [ 40.472541][ T907] addrconf_dad_work+0x3c1/0x930 [ 40.472607][ T907] process_one_work+0xdf8/0x1410 [ 40.472674][ T907] worker_thread+0x4f1/0xd60 [ 40.472739][ T907] kthread+0x367/0x460 [ 40.472790][ T907] ret_from_fork+0x474/0x6b0 [ 40.472857][ T907] ret_from_fork_asm+0x11/0x20 [ 40.472926][ T907] [ 40.472965][ T907] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 40.473034][ T907] HARDIRQ-ON-W at: [ 40.473084][ T907] __lock_acquire+0x378/0xc10 [ 40.473167][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.473249][ T907] _raw_spin_lock+0x33/0x40 [ 40.473336][ T907] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 40.473437][ T907] __ipv6_dev_ac_inc+0x57e/0x930 [ 40.473520][ T907] addrconf_join_anycast+0x1bc/0x260 [ 40.473602][ T907] __ipv6_ifa_notify+0x75b/0xad0 [ 40.473684][ T907] addrconf_dad_completed+0x14b/0xe10 [ 40.473766][ T907] addrconf_dad_work+0x3c1/0x930 [ 40.473852][ T907] process_one_work+0xdf8/0x1410 [ 40.473933][ T907] worker_thread+0x4f1/0xd60 [ 40.474017][ T907] kthread+0x367/0x460 [ 40.474083][ T907] ret_from_fork+0x474/0x6b0 [ 40.474166][ T907] ret_from_fork_asm+0x11/0x20 [ 40.474248][ T907] SOFTIRQ-ON-W at: [ 40.474304][ T907] __lock_acquire+0x378/0xc10 [ 40.474388][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.474471][ T907] _raw_spin_lock+0x33/0x40 [ 40.474556][ T907] __ipv6_dev_ac_dec+0x236/0x5d0 [ 40.474637][ T907] addrconf_leave_anycast+0x1bc/0x260 [ 40.474720][ T907] dev_forward_change+0x3b3/0x850 [ 40.474804][ T907] addrconf_fixup_forwarding+0x2af/0x4d0 [ 40.474904][ T907] addrconf_sysctl_forward+0x209/0x2b0 [ 40.474989][ T907] proc_sys_call_handler+0x31b/0x480 [ 40.475074][ T907] new_sync_write+0x333/0x750 [ 40.475158][ T907] vfs_write+0x6a4/0xc10 [ 40.475242][ T907] ksys_write+0x116/0x250 [ 40.475330][ T907] do_syscall_64+0x117/0x590 [ 40.475414][ T907] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 40.475512][ T907] INITIAL USE at: [ 40.475562][ T907] __lock_acquire+0x378/0xc10 [ 40.475645][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.475729][ T907] _raw_spin_lock+0x33/0x40 [ 40.475811][ T907] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 40.475910][ T907] __ipv6_dev_ac_inc+0x57e/0x930 [ 40.475993][ T907] addrconf_join_anycast+0x1bc/0x260 [ 40.476078][ T907] __ipv6_ifa_notify+0x75b/0xad0 [ 40.476161][ T907] addrconf_dad_completed+0x14b/0xe10 [ 40.476244][ T907] addrconf_dad_work+0x3c1/0x930 [ 40.476334][ T907] process_one_work+0xdf8/0x1410 [ 40.476417][ T907] worker_thread+0x4f1/0xd60 [ 40.476501][ T907] kthread+0x367/0x460 [ 40.476568][ T907] ret_from_fork+0x474/0x6b0 [ 40.476653][ T907] ret_from_fork_asm+0x11/0x20 [ 40.476737][ T907] } [ 40.476770][ T907] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 40.476869][ T907] ... acquired at: [ 40.476918][ T907] mark_lock+0x1d7/0xa00 [ 40.476986][ T907] mark_usage+0x105/0x170 [ 40.477051][ T907] __lock_acquire+0x378/0xc10 [ 40.477117][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.477183][ T907] _raw_spin_lock+0x33/0x40 [ 40.477248][ T907] __ipv6_dev_ac_dec+0x236/0x5d0 [ 40.477319][ T907] addrconf_leave_anycast+0x1bc/0x260 [ 40.477385][ T907] dev_forward_change+0x3b3/0x850 [ 40.477451][ T907] addrconf_fixup_forwarding+0x2af/0x4d0 [ 40.477534][ T907] addrconf_sysctl_forward+0x209/0x2b0 [ 40.477601][ T907] proc_sys_call_handler+0x31b/0x480 [ 40.477667][ T907] new_sync_write+0x333/0x750 [ 40.477733][ T907] vfs_write+0x6a4/0xc10 [ 40.477799][ T907] ksys_write+0x116/0x250 [ 40.477865][ T907] do_syscall_64+0x117/0x590 [ 40.477930][ T907] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 40.478014][ T907] [ 40.478047][ T907] [ 40.478047][ T907] stack backtrace: [ 40.478132][ T907] CPU: 2 UID: 0 PID: 907 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 40.478135][ T907] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 40.478137][ T907] Call Trace: [ 40.478138][ T907] [ 40.478140][ T907] dump_stack_lvl+0x6f/0xa0 [ 40.478144][ T907] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 40.478147][ T907] mark_lock_irq+0x989/0x9c0 [ 40.478149][ T907] mark_lock+0x1d7/0xa00 [ 40.478151][ T907] mark_usage+0x105/0x170 [ 40.478152][ T907] __lock_acquire+0x378/0xc10 [ 40.478154][ T907] lock_acquire.part.0+0xbc/0x260 [ 40.478156][ T907] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 40.478157][ T907] ? rcu_is_watching+0x15/0xd0 [ 40.478160][ T907] ? do_raw_read_unlock+0x70/0x70 [ 40.478162][ T907] ? lock_acquire+0x134/0x160 [ 40.478164][ T907] _raw_spin_lock+0x33/0x40 [ 40.478165][ T907] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 40.478166][ T907] __ipv6_dev_ac_dec+0x236/0x5d0 [ 40.478169][ T907] addrconf_leave_anycast+0x1bc/0x260 [ 40.478170][ T907] ? find_held_lock+0x2b/0x80 [ 40.478173][ T907] ? __ipv6_isatap_ifid+0x210/0x210 [ 40.478175][ T907] ? mark_held_locks+0x40/0x70 [ 40.478176][ T907] ? lockdep_hardirqs_on+0x8c/0x130 [ 40.478178][ T907] dev_forward_change+0x3b3/0x850 [ 40.478180][ T907] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 40.478182][ T907] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 40.478185][ T907] addrconf_fixup_forwarding+0x2af/0x4d0 [ 40.478188][ T907] addrconf_sysctl_forward+0x209/0x2b0 [ 40.478190][ T907] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 40.478192][ T907] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 40.478194][ T907] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 40.478197][ T907] ? proc_sys_call_handler+0x25d/0x480 [ 40.478199][ T907] proc_sys_call_handler+0x31b/0x480 [ 40.478201][ T907] ? proc_sys_lookup+0x3d0/0x3d0 [ 40.478203][ T907] ? rcu_read_unlock+0x1b/0x70 [ 40.478206][ T907] ? do_raw_spin_unlock+0x59/0x250 [ 40.478207][ T907] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 40.478209][ T907] ? rcu_read_lock_any_held+0x3c/0x90 [ 40.478211][ T907] ? proc_sys_call_handler+0x480/0x480 [ 40.478213][ T907] new_sync_write+0x333/0x750 [ 40.478214][ T907] ? __lock_acquire+0x508/0xc10 [ 40.478216][ T907] ? new_sync_read+0x740/0x740 [ 40.478217][ T907] ? lock_acquire.part.0+0xbc/0x260 [ 40.478219][ T907] ? ksys_write+0x116/0x250 [ 40.478221][ T907] vfs_write+0x6a4/0xc10 [ 40.478223][ T907] ksys_write+0x116/0x250 [ 40.478224][ T907] ? __ia32_sys_read+0xc0/0xc0 [ 40.478226][ T907] ? rcu_is_watching+0x15/0xd0 [ 40.478227][ T907] ? rcu_is_watching+0x15/0xd0 [ 40.478229][ T907] do_syscall_64+0x117/0x590 [ 40.478230][ T907] ? trace_hardirqs_off+0xd/0x30 [ 40.478233][ T907] ? exc_page_fault+0xee/0x100 [ 40.478235][ T907] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 40.478237][ T907] RIP: 0033:0x7f13b6b8d08e [ 40.478239][ T907] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 40.478241][ T907] RSP: 002b:00007ffe75f15b50 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 40.478244][ T907] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f13b6b8d08e [ 40.478245][ T907] RDX: 0000000000000002 RSI: 00005650238fa4b0 RDI: 0000000000000005 [ 40.478246][ T907] RBP: 00007ffe75f15b60 R08: 0000000000000000 R09: 0000000000000000 [ 40.478247][ T907] R10: 0000000000000000 R11: 0000000000000202 R12: 00005650238fc5e0 [ 40.478247][ T907] R13: 00005650238fa470 R14: 0000000000000002 R15: 0000000000000000 [ 40.478250][ T907] [ 41.412013][ T573] veth0: left allmulticast mode [ 41.412251][ T573] veth1: left allmulticast mode [ 41.412412][ T573] veth2: left allmulticast mode [ 41.412548][ T573] veth3: left allmulticast mode [ 41.412689][ T573] veth4: left allmulticast mode [ 41.412824][ T573] veth5: left allmulticast mode