[ 8.691822][ T192] ip (192) used greatest stack depth: 23904 bytes left [ 9.221319][ T214] 8021q: 802.1Q VLAN Support v1.8 [ 9.860168][ T242] br1: port 1(veth1) entered blocking state [ 9.860473][ T242] br1: port 1(veth1) entered disabled state [ 9.860645][ T242] veth1: entered allmulticast mode [ 9.862085][ T242] veth1: entered promiscuous mode [ 9.891384][ T113] br1: port 1(veth1) entered blocking state [ 9.891602][ T113] br1: port 1(veth1) entered forwarding state [ 23.898137][ T376] [ 23.898223][ T376] ======================================================== [ 23.898356][ T376] WARNING: possible irq lock inversion dependency detected [ 23.898479][ T376] 7.1.0-rc5-virtme #1 Not tainted [ 23.898562][ T376] -------------------------------------------------------- [ 23.898688][ T376] sysctl/376 just changed the state of lock: [ 23.898788][ T376] ffffffffb7d7e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 23.898948][ T376] but this lock was taken by another, SOFTIRQ-READ-safe lock in the past: [ 23.899068][ T376] (&ndev->lock){++.-}-{3:3} [ 23.899071][ T376] [ 23.899071][ T376] [ 23.899071][ T376] and interrupts could create inverse lock ordering between them. [ 23.899071][ T376] [ 23.899374][ T376] [ 23.899374][ T376] other info that might help us debug this: [ 23.899495][ T376] Possible interrupt unsafe locking scenario: [ 23.899495][ T376] [ 23.899629][ T376] CPU0 CPU1 [ 23.899716][ T376] ---- ---- [ 23.899801][ T376] lock(acaddr_hash_lock); [ 23.899885][ T376] local_irq_disable(); [ 23.899986][ T376] lock(&ndev->lock); [ 23.900093][ T376] lock(acaddr_hash_lock); [ 23.900202][ T376] [ 23.900268][ T376] lock(&ndev->lock); [ 23.900333][ T376] [ 23.900333][ T376] *** DEADLOCK *** [ 23.900333][ T376] [ 23.900461][ T376] 2 locks held by sysctl/376: [ 23.900546][ T376] #0: ff11000008fcc3e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 23.900700][ T376] #1: ffffffffb7c8c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 23.900876][ T376] [ 23.900876][ T376] the shortest dependencies between 2nd lock and 1st lock: [ 23.901012][ T376] -> (&ndev->lock){++.-}-{3:3} { [ 23.901096][ T376] HARDIRQ-ON-W at: [ 23.901163][ T376] __lock_acquire+0x378/0xc10 [ 23.901273][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.901371][ T376] _raw_write_lock_bh+0x38/0x50 [ 23.901473][ T376] addrconf_permanent_addr+0x108/0x9c0 [ 23.901592][ T376] addrconf_notify+0x151/0xf30 [ 23.901689][ T376] notifier_call_chain+0xb0/0x320 [ 23.901804][ T376] __dev_notify_flags+0xde/0x280 [ 23.901954][ T376] netif_change_flags+0xfe/0x190 [ 23.902068][ T376] do_setlink.isra.0+0x1cc3/0x2750 [ 23.902177][ T376] rtnl_newlink+0x8d1/0xef0 [ 23.902291][ T376] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 23.902407][ T376] netlink_rcv_skb+0x14e/0x3a0 [ 23.902523][ T376] netlink_unicast+0x486/0x750 [ 23.902633][ T376] netlink_sendmsg+0x735/0xc60 [ 23.902749][ T376] ____sys_sendmsg+0x419/0x850 [ 23.902866][ T376] ___sys_sendmsg+0x14e/0x1d0 [ 23.902992][ T376] __sys_sendmsg+0x145/0x1f0 [ 23.903100][ T376] do_syscall_64+0x117/0x590 [ 23.903201][ T376] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 23.903326][ T376] HARDIRQ-ON-R at: [ 23.903387][ T376] __lock_acquire+0x378/0xc10 [ 23.903488][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.903590][ T376] _raw_read_lock_bh+0x44/0x80 [ 23.903691][ T376] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 23.903823][ T376] inet6_fill_link_af+0x5c/0xe0 [ 23.903977][ T376] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 23.904104][ T376] rtnl_getlink+0x9c9/0xeb0 [ 23.904211][ T376] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 23.904317][ T376] netlink_rcv_skb+0x14e/0x3a0 [ 23.904420][ T376] netlink_unicast+0x486/0x750 [ 23.904518][ T376] netlink_sendmsg+0x735/0xc60 [ 23.904619][ T376] ____sys_sendmsg+0x419/0x850 [ 23.904721][ T376] ___sys_sendmsg+0x14e/0x1d0 [ 23.904823][ T376] __sys_sendmsg+0x145/0x1f0 [ 23.904931][ T376] do_syscall_64+0x117/0x590 [ 23.905030][ T376] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 23.905146][ T376] IN-SOFTIRQ-R at: [ 23.905206][ T376] __lock_acquire+0x378/0xc10 [ 23.905312][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.905414][ T376] _raw_read_lock_bh+0x44/0x80 [ 23.905520][ T376] ipv6_get_lladdr+0xa8/0x3f0 [ 23.905666][ T376] ndisc_send_ns+0xf3/0x120 [ 23.905771][ T376] ndisc_solicit+0x314/0x480 [ 23.905884][ T376] neigh_probe+0xb3/0x100 [ 23.906032][ T376] __neigh_event_send+0x802/0x1070 [ 23.906137][ T376] neigh_resolve_output+0xbe/0x140 [ 23.906242][ T376] ip6_finish_output2+0x423/0x1300 [ 23.906391][ T376] ip6_finish_output+0x646/0xda0 [ 23.906492][ T376] ip6_output+0x23f/0x7f0 [ 23.906593][ T376] ip6_forward+0x10f4/0x2bd0 [ 23.906699][ T376] ipv6_rcv+0x3c1/0x5a0 [ 23.906848][ T376] __netif_receive_skb_one_core+0xfc/0x180 [ 23.906973][ T376] netif_receive_skb_internal+0xb0/0x330 [ 23.907135][ T376] netif_receive_skb+0x56/0x380 [ 23.907236][ T376] br_handle_frame_finish+0xc3b/0x1fb0 [bridge] [ 23.907368][ T376] br_handle_frame+0x739/0xf40 [bridge] [ 23.907538][ T376] __netif_receive_skb_core.constprop.0+0x536/0x2bc0 [ 23.907659][ T376] __netif_receive_skb_one_core+0xa2/0x180 [ 23.907783][ T376] process_backlog+0x2bc/0x1490 [ 23.907929][ T376] __napi_poll+0xa7/0x3b0 [ 23.908031][ T376] net_rx_action+0x513/0xf50 [ 23.908135][ T376] handle_softirqs+0x1d8/0x940 [ 23.908283][ T376] do_softirq+0xa9/0xe0 [ 23.908387][ T376] __local_bh_enable_ip+0x113/0x140 [ 23.908492][ T376] __neigh_event_send+0x30a/0x1070 [ 23.908641][ T376] neigh_resolve_output+0xbe/0x140 [ 23.908749][ T376] ip6_finish_output2+0x423/0x1300 [ 23.908856][ T376] ip6_finish_output+0x646/0xda0 [ 23.908955][ T376] ip6_output+0x23f/0x7f0 [ 23.909098][ T376] ip6_send_skb+0xee/0x350 [ 23.909200][ T376] rawv6_push_pending_frames+0x4cb/0xa90 [ 23.909331][ T376] rawv6_sendmsg+0x1434/0x1a50 [ 23.909483][ T376] __sys_sendto+0x2c9/0x400 [ 23.909585][ T376] __x64_sys_sendto+0xe4/0x1f0 [ 23.909692][ T376] do_syscall_64+0x117/0x590 [ 23.909847][ T376] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 23.909969][ T376] INITIAL USE at: [ 23.910035][ T376] __lock_acquire+0x378/0xc10 [ 23.910181][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.910284][ T376] _raw_write_lock_bh+0x38/0x50 [ 23.910384][ T376] addrconf_permanent_addr+0x108/0x9c0 [ 23.910554][ T376] addrconf_notify+0x151/0xf30 [ 23.910655][ T376] notifier_call_chain+0xb0/0x320 [ 23.910756][ T376] __dev_notify_flags+0xde/0x280 [ 23.910918][ T376] netif_change_flags+0xfe/0x190 [ 23.911031][ T376] do_setlink.isra.0+0x1cc3/0x2750 [ 23.911136][ T376] rtnl_newlink+0x8d1/0xef0 [ 23.911240][ T376] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 23.911343][ T376] netlink_rcv_skb+0x14e/0x3a0 [ 23.911449][ T376] netlink_unicast+0x486/0x750 [ 23.911554][ T376] netlink_sendmsg+0x735/0xc60 [ 23.911705][ T376] ____sys_sendmsg+0x419/0x850 [ 23.911809][ T376] ___sys_sendmsg+0x14e/0x1d0 [ 23.911928][ T376] __sys_sendmsg+0x145/0x1f0 [ 23.912073][ T376] do_syscall_64+0x117/0x590 [ 23.912174][ T376] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 23.912303][ T376] INITIAL READ USE at: [ 23.912430][ T376] __lock_acquire+0x378/0xc10 [ 23.912535][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.912655][ T376] _raw_read_lock_bh+0x44/0x80 [ 23.912806][ T376] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 23.912931][ T376] inet6_fill_link_af+0x5c/0xe0 [ 23.913040][ T376] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 23.913204][ T376] rtnl_getlink+0x9c9/0xeb0 [ 23.913312][ T376] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 23.913421][ T376] netlink_rcv_skb+0x14e/0x3a0 [ 23.913569][ T376] netlink_unicast+0x486/0x750 [ 23.913672][ T376] netlink_sendmsg+0x735/0xc60 [ 23.913781][ T376] ____sys_sendmsg+0x419/0x850 [ 23.913932][ T376] ___sys_sendmsg+0x14e/0x1d0 [ 23.914032][ T376] __sys_sendmsg+0x145/0x1f0 [ 23.914130][ T376] do_syscall_64+0x117/0x590 [ 23.914234][ T376] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 23.914366][ T376] } [ 23.914409][ T376] ... key at: [] __key.37+0x0/0x40 [ 23.914533][ T376] ... acquired at: [ 23.914636][ T376] __lock_acquire+0x508/0xc10 [ 23.914721][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.914802][ T376] _raw_spin_lock+0x33/0x40 [ 23.914890][ T376] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 23.915033][ T376] __ipv6_dev_ac_inc+0x57e/0x930 [ 23.915113][ T376] addrconf_join_anycast+0x1bc/0x260 [ 23.915199][ T376] __ipv6_ifa_notify+0x75b/0xad0 [ 23.915280][ T376] addrconf_dad_completed+0x14b/0xe10 [ 23.915404][ T376] addrconf_dad_work+0x3c1/0x930 [ 23.915486][ T376] process_one_work+0xdf8/0x1410 [ 23.915567][ T376] worker_thread+0x4f1/0xd60 [ 23.915647][ T376] kthread+0x367/0x460 [ 23.915760][ T376] ret_from_fork+0x474/0x6b0 [ 23.915845][ T376] ret_from_fork_asm+0x11/0x20 [ 23.915933][ T376] [ 23.915975][ T376] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 23.916062][ T376] HARDIRQ-ON-W at: [ 23.916164][ T376] __lock_acquire+0x378/0xc10 [ 23.916266][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.916366][ T376] _raw_spin_lock+0x33/0x40 [ 23.916509][ T376] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 23.916627][ T376] __ipv6_dev_ac_inc+0x57e/0x930 [ 23.916731][ T376] addrconf_join_anycast+0x1bc/0x260 [ 23.916878][ T376] __ipv6_ifa_notify+0x75b/0xad0 [ 23.916985][ T376] addrconf_dad_completed+0x14b/0xe10 [ 23.917085][ T376] addrconf_dad_work+0x3c1/0x930 [ 23.917186][ T376] process_one_work+0xdf8/0x1410 [ 23.917332][ T376] worker_thread+0x4f1/0xd60 [ 23.917435][ T376] kthread+0x367/0x460 [ 23.917516][ T376] ret_from_fork+0x474/0x6b0 [ 23.917662][ T376] ret_from_fork_asm+0x11/0x20 [ 23.917762][ T376] SOFTIRQ-ON-W at: [ 23.917828][ T376] __lock_acquire+0x378/0xc10 [ 23.917928][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.918081][ T376] _raw_spin_lock+0x33/0x40 [ 23.918181][ T376] __ipv6_dev_ac_dec+0x236/0x5d0 [ 23.918282][ T376] addrconf_leave_anycast+0x1bc/0x260 [ 23.918426][ T376] dev_forward_change+0x3b3/0x850 [ 23.918526][ T376] addrconf_fixup_forwarding+0x2af/0x4d0 [ 23.918646][ T376] addrconf_sysctl_forward+0x209/0x2b0 [ 23.918790][ T376] proc_sys_call_handler+0x31b/0x480 [ 23.918896][ T376] new_sync_write+0x333/0x750 [ 23.918996][ T376] vfs_write+0x6a4/0xc10 [ 23.919144][ T376] ksys_write+0x116/0x250 [ 23.919246][ T376] do_syscall_64+0x117/0x590 [ 23.919345][ T376] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 23.919510][ T376] INITIAL USE at: [ 23.919569][ T376] __lock_acquire+0x378/0xc10 [ 23.919669][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.919769][ T376] _raw_spin_lock+0x33/0x40 [ 23.919925][ T376] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 23.920044][ T376] __ipv6_dev_ac_inc+0x57e/0x930 [ 23.920145][ T376] addrconf_join_anycast+0x1bc/0x260 [ 23.920288][ T376] __ipv6_ifa_notify+0x75b/0xad0 [ 23.920392][ T376] addrconf_dad_completed+0x14b/0xe10 [ 23.920496][ T376] addrconf_dad_work+0x3c1/0x930 [ 23.920638][ T376] process_one_work+0xdf8/0x1410 [ 23.920738][ T376] worker_thread+0x4f1/0xd60 [ 23.920842][ T376] kthread+0x367/0x460 [ 23.920967][ T376] ret_from_fork+0x474/0x6b0 [ 23.921066][ T376] ret_from_fork_asm+0x11/0x20 [ 23.921175][ T376] } [ 23.921216][ T376] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 23.921381][ T376] ... acquired at: [ 23.921440][ T376] mark_lock+0x1d7/0xa00 [ 23.921521][ T376] mark_usage+0x105/0x170 [ 23.921602][ T376] __lock_acquire+0x378/0xc10 [ 23.921724][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.921805][ T376] _raw_spin_lock+0x33/0x40 [ 23.921887][ T376] __ipv6_dev_ac_dec+0x236/0x5d0 [ 23.921967][ T376] addrconf_leave_anycast+0x1bc/0x260 [ 23.922088][ T376] dev_forward_change+0x3b3/0x850 [ 23.922169][ T376] addrconf_fixup_forwarding+0x2af/0x4d0 [ 23.922269][ T376] addrconf_sysctl_forward+0x209/0x2b0 [ 23.922351][ T376] proc_sys_call_handler+0x31b/0x480 [ 23.922480][ T376] new_sync_write+0x333/0x750 [ 23.922564][ T376] vfs_write+0x6a4/0xc10 [ 23.922644][ T376] ksys_write+0x116/0x250 [ 23.922724][ T376] do_syscall_64+0x117/0x590 [ 23.922855][ T376] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 23.922954][ T376] [ 23.922994][ T376] [ 23.922994][ T376] stack backtrace: [ 23.923098][ T376] CPU: 3 UID: 0 PID: 376 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 23.923102][ T376] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 23.923104][ T376] Call Trace: [ 23.923106][ T376] [ 23.923107][ T376] dump_stack_lvl+0x6f/0xa0 [ 23.923111][ T376] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 23.923115][ T376] mark_lock_irq+0x989/0x9c0 [ 23.923117][ T376] mark_lock+0x1d7/0xa00 [ 23.923119][ T376] mark_usage+0x105/0x170 [ 23.923121][ T376] __lock_acquire+0x378/0xc10 [ 23.923123][ T376] lock_acquire.part.0+0xbc/0x260 [ 23.923124][ T376] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 23.923126][ T376] ? rcu_is_watching+0x15/0xd0 [ 23.923129][ T376] ? do_raw_read_unlock+0x70/0x70 [ 23.923131][ T376] ? lock_acquire+0x134/0x160 [ 23.923133][ T376] _raw_spin_lock+0x33/0x40 [ 23.923135][ T376] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 23.923136][ T376] __ipv6_dev_ac_dec+0x236/0x5d0 [ 23.923138][ T376] addrconf_leave_anycast+0x1bc/0x260 [ 23.923140][ T376] ? find_held_lock+0x2b/0x80 [ 23.923143][ T376] ? __ipv6_isatap_ifid+0x210/0x210 [ 23.923144][ T376] ? mark_held_locks+0x40/0x70 [ 23.923146][ T376] ? lockdep_hardirqs_on+0x8c/0x130 [ 23.923150][ T376] dev_forward_change+0x3b3/0x850 [ 23.923153][ T376] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 23.923156][ T376] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 23.923159][ T376] addrconf_fixup_forwarding+0x2af/0x4d0 [ 23.923161][ T376] addrconf_sysctl_forward+0x209/0x2b0 [ 23.923163][ T376] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 23.923166][ T376] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 23.923168][ T376] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 23.923171][ T376] ? proc_sys_call_handler+0x25d/0x480 [ 23.923173][ T376] proc_sys_call_handler+0x31b/0x480 [ 23.923176][ T376] ? proc_sys_lookup+0x3d0/0x3d0 [ 23.923178][ T376] ? rcu_read_unlock+0x1b/0x70 [ 23.923180][ T376] ? do_raw_spin_unlock+0x59/0x250 [ 23.923182][ T376] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 23.923184][ T376] ? rcu_read_lock_any_held+0x3c/0x90 [ 23.923186][ T376] ? proc_sys_call_handler+0x480/0x480 [ 23.923188][ T376] new_sync_write+0x333/0x750 [ 23.923189][ T376] ? __lock_acquire+0x508/0xc10 [ 23.923191][ T376] ? new_sync_read+0x740/0x740 [ 23.923192][ T376] ? lock_acquire.part.0+0xbc/0x260 [ 23.923194][ T376] ? ksys_write+0x116/0x250 [ 23.923196][ T376] vfs_write+0x6a4/0xc10 [ 23.923198][ T376] ksys_write+0x116/0x250 [ 23.923199][ T376] ? __ia32_sys_read+0xc0/0xc0 [ 23.923201][ T376] ? rcu_is_watching+0x15/0xd0 [ 23.923202][ T376] ? rcu_is_watching+0x15/0xd0 [ 23.923204][ T376] do_syscall_64+0x117/0x590 [ 23.923205][ T376] ? trace_hardirqs_off+0xd/0x30 [ 23.923209][ T376] ? exc_page_fault+0xee/0x100 [ 23.923212][ T376] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 23.923215][ T376] RIP: 0033:0x7f1e90eb808e [ 23.923218][ T376] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 23.923220][ T376] RSP: 002b:00007ffc7c211f30 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 23.923223][ T376] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007f1e90eb808e [ 23.923224][ T376] RDX: 0000000000000002 RSI: 000055b2b51804b0 RDI: 0000000000000005 [ 23.923225][ T376] RBP: 00007ffc7c211f40 R08: 0000000000000000 R09: 0000000000000000 [ 23.923226][ T376] R10: 0000000000000000 R11: 0000000000000202 R12: 000055b2b51825e0 [ 23.923227][ T376] R13: 000055b2b5180470 R14: 0000000000000002 R15: 0000000000000000 [ 23.923229][ T376] [ 24.088876][ T386] br1: port 1(veth1) entered disabled state [ 24.102885][ T387] veth1: left allmulticast mode [ 24.103000][ T387] veth1: left promiscuous mode [ 24.103150][ T387] br1: port 1(veth1) entered disabled state