[ 53.503635][ T649] 8021q: 802.1Q VLAN Support v1.8 [ 54.318159][ T684] br1: port 1(veth1) entered blocking state [ 54.318404][ T684] br1: port 1(veth1) entered disabled state [ 54.318641][ T684] veth1: entered allmulticast mode [ 54.320081][ T684] veth1: entered promiscuous mode [ 54.350883][ T36] br1: port 1(veth1) entered blocking state [ 54.351102][ T36] br1: port 1(veth1) entered forwarding state [ 80.852477][ T856] [ 80.852570][ T856] ======================================================== [ 80.852698][ T856] WARNING: possible irq lock inversion dependency detected [ 80.852824][ T856] 7.1.0-rc5-virtme #1 Not tainted [ 80.852903][ T856] -------------------------------------------------------- [ 80.853019][ T856] sysctl/856 just changed the state of lock: [ 80.853118][ T856] ffffffff9e57e8b8 (acaddr_hash_lock){+.+.}-{3:3}, at: __ipv6_dev_ac_dec+0x236/0x5d0 [ 80.853266][ T856] but this lock was taken by another, SOFTIRQ-safe lock in the past: [ 80.853380][ T856] (&ndev->lock){++--}-{3:3} [ 80.853382][ T856] [ 80.853382][ T856] [ 80.853382][ T856] and interrupts could create inverse lock ordering between them. [ 80.853382][ T856] [ 80.853672][ T856] [ 80.853672][ T856] other info that might help us debug this: [ 80.853792][ T856] Possible interrupt unsafe locking scenario: [ 80.853792][ T856] [ 80.853907][ T856] CPU0 CPU1 [ 80.853986][ T856] ---- ---- [ 80.854066][ T856] lock(acaddr_hash_lock); [ 80.854144][ T856] local_irq_disable(); [ 80.854244][ T856] lock(&ndev->lock); [ 80.854344][ T856] lock(acaddr_hash_lock); [ 80.854442][ T856] [ 80.854501][ T856] lock(&ndev->lock); [ 80.854566][ T856] [ 80.854566][ T856] *** DEADLOCK *** [ 80.854566][ T856] [ 80.854689][ T856] 2 locks held by sysctl/856: [ 80.854769][ T856] #0: ff11000009a543e0 (sb_writers#3){.+.+}-{0:0}, at: ksys_write+0x116/0x250 [ 80.854909][ T856] #1: ffffffff9e48c9c0 (rtnl_mutex){+.+.}-{4:4}, at: addrconf_fixup_forwarding+0x4d/0x4d0 [ 80.855064][ T856] [ 80.855064][ T856] the shortest dependencies between 2nd lock and 1st lock: [ 80.855198][ T856] -> (&ndev->lock){++--}-{3:3} { [ 80.855284][ T856] HARDIRQ-ON-W at: [ 80.855347][ T856] __lock_acquire+0x378/0xc10 [ 80.855448][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.855544][ T856] _raw_write_lock_bh+0x38/0x50 [ 80.855643][ T856] addrconf_permanent_addr+0x108/0x9c0 [ 80.855758][ T856] addrconf_notify+0x151/0xf30 [ 80.855855][ T856] notifier_call_chain+0xb0/0x320 [ 80.855948][ T856] __dev_notify_flags+0xde/0x280 [ 80.856044][ T856] netif_change_flags+0xfe/0x190 [ 80.856140][ T856] do_setlink.isra.0+0x1cc3/0x2750 [ 80.856240][ T856] rtnl_newlink+0x8d1/0xef0 [ 80.856339][ T856] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 80.856436][ T856] netlink_rcv_skb+0x14e/0x3a0 [ 80.856534][ T856] netlink_unicast+0x486/0x750 [ 80.856631][ T856] netlink_sendmsg+0x735/0xc60 [ 80.856727][ T856] ____sys_sendmsg+0x419/0x850 [ 80.856824][ T856] ___sys_sendmsg+0x14e/0x1d0 [ 80.856921][ T856] __sys_sendmsg+0x145/0x1f0 [ 80.857016][ T856] do_syscall_64+0x117/0x590 [ 80.857114][ T856] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 80.857234][ T856] HARDIRQ-ON-R at: [ 80.857292][ T856] __lock_acquire+0x378/0xc10 [ 80.857389][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.857485][ T856] _raw_read_lock_bh+0x44/0x80 [ 80.857580][ T856] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 80.857697][ T856] inet6_fill_link_af+0x5c/0xe0 [ 80.857793][ T856] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 80.857909][ T856] rtnl_getlink+0x9c9/0xeb0 [ 80.858005][ T856] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 80.858101][ T856] netlink_rcv_skb+0x14e/0x3a0 [ 80.858199][ T856] netlink_unicast+0x486/0x750 [ 80.858301][ T856] netlink_sendmsg+0x735/0xc60 [ 80.858398][ T856] ____sys_sendmsg+0x419/0x850 [ 80.858495][ T856] ___sys_sendmsg+0x14e/0x1d0 [ 80.858592][ T856] __sys_sendmsg+0x145/0x1f0 [ 80.858687][ T856] do_syscall_64+0x117/0x590 [ 80.858783][ T856] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 80.858897][ T856] IN-SOFTIRQ-W at: [ 80.858955][ T856] __lock_acquire+0x378/0xc10 [ 80.859050][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.859146][ T856] _raw_write_lock+0x33/0x40 [ 80.859244][ T856] addrconf_rs_timer+0xb0/0x770 [ 80.859342][ T856] call_timer_fn+0x163/0x4f0 [ 80.859438][ T856] __run_timers+0x68f/0xab0 [ 80.859537][ T856] run_timer_softirq+0xf0/0x160 [ 80.859632][ T856] handle_softirqs+0x1d8/0x940 [ 80.859727][ T856] __irq_exit_rcu+0x103/0x1c0 [ 80.859821][ T856] irq_exit_rcu+0xe/0x30 [ 80.859916][ T856] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 80.860032][ T856] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 80.860147][ T856] pv_native_safe_halt+0xf/0x10 [ 80.860247][ T856] default_idle+0x9/0x10 [ 80.860344][ T856] default_idle_call+0x6e/0xb0 [ 80.860438][ T856] cpuidle_idle_call.constprop.0+0x237/0x410 [ 80.860556][ T856] do_idle+0xf5/0x160 [ 80.860652][ T856] cpu_startup_entry+0x53/0x70 [ 80.860748][ T856] start_secondary+0x204/0x2b0 [ 80.860846][ T856] common_startup_64+0x13e/0x148 [ 80.860944][ T856] IN-SOFTIRQ-R at: [ 80.861001][ T856] __lock_acquire+0x378/0xc10 [ 80.861098][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.861196][ T856] _raw_read_lock_bh+0x44/0x80 [ 80.861296][ T856] ipv6_get_lladdr+0xa8/0x3f0 [ 80.861393][ T856] addrconf_rs_timer+0x251/0x770 [ 80.861489][ T856] call_timer_fn+0x163/0x4f0 [ 80.861588][ T856] __run_timers+0x68f/0xab0 [ 80.861684][ T856] run_timer_softirq+0xf0/0x160 [ 80.861780][ T856] handle_softirqs+0x1d8/0x940 [ 80.861876][ T856] __irq_exit_rcu+0x103/0x1c0 [ 80.861973][ T856] irq_exit_rcu+0xe/0x30 [ 80.862072][ T856] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 80.862189][ T856] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 80.862309][ T856] pv_native_safe_halt+0xf/0x10 [ 80.862407][ T856] default_idle+0x9/0x10 [ 80.862504][ T856] default_idle_call+0x6e/0xb0 [ 80.862602][ T856] cpuidle_idle_call.constprop.0+0x237/0x410 [ 80.862719][ T856] do_idle+0xf5/0x160 [ 80.862814][ T856] cpu_startup_entry+0x53/0x70 [ 80.862911][ T856] start_secondary+0x204/0x2b0 [ 80.863008][ T856] common_startup_64+0x13e/0x148 [ 80.863106][ T856] INITIAL USE at: [ 80.863165][ T856] __lock_acquire+0x378/0xc10 [ 80.863313][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.863412][ T856] _raw_write_lock_bh+0x38/0x50 [ 80.863510][ T856] addrconf_permanent_addr+0x108/0x9c0 [ 80.863669][ T856] addrconf_notify+0x151/0xf30 [ 80.863770][ T856] notifier_call_chain+0xb0/0x320 [ 80.863866][ T856] __dev_notify_flags+0xde/0x280 [ 80.864004][ T856] netif_change_flags+0xfe/0x190 [ 80.864103][ T856] do_setlink.isra.0+0x1cc3/0x2750 [ 80.864201][ T856] rtnl_newlink+0x8d1/0xef0 [ 80.864344][ T856] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 80.864441][ T856] netlink_rcv_skb+0x14e/0x3a0 [ 80.864539][ T856] netlink_unicast+0x486/0x750 [ 80.864636][ T856] netlink_sendmsg+0x735/0xc60 [ 80.864772][ T856] ____sys_sendmsg+0x419/0x850 [ 80.864867][ T856] ___sys_sendmsg+0x14e/0x1d0 [ 80.864963][ T856] __sys_sendmsg+0x145/0x1f0 [ 80.865099][ T856] do_syscall_64+0x117/0x590 [ 80.865195][ T856] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 80.865313][ T856] INITIAL READ USE at: [ 80.865431][ T856] __lock_acquire+0x378/0xc10 [ 80.865525][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.865642][ T856] _raw_read_lock_bh+0x44/0x80 [ 80.865780][ T856] inet6_fill_ifla6_attrs+0x1aee/0x21e0 [ 80.865895][ T856] inet6_fill_link_af+0x5c/0xe0 [ 80.865992][ T856] rtnl_fill_ifinfo.isra.0+0x1a45/0x2c20 [ 80.866151][ T856] rtnl_getlink+0x9c9/0xeb0 [ 80.866253][ T856] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 80.866350][ T856] netlink_rcv_skb+0x14e/0x3a0 [ 80.866487][ T856] netlink_unicast+0x486/0x750 [ 80.866585][ T856] netlink_sendmsg+0x735/0xc60 [ 80.866681][ T856] ____sys_sendmsg+0x419/0x850 [ 80.866819][ T856] ___sys_sendmsg+0x14e/0x1d0 [ 80.866914][ T856] __sys_sendmsg+0x145/0x1f0 [ 80.867010][ T856] do_syscall_64+0x117/0x590 [ 80.867149][ T856] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 80.867269][ T856] } [ 80.867309][ T856] ... key at: [] __key.37+0x0/0x40 [ 80.867428][ T856] ... acquired at: [ 80.867526][ T856] __lock_acquire+0x508/0xc10 [ 80.867603][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.867680][ T856] _raw_spin_lock+0x33/0x40 [ 80.867757][ T856] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 80.867893][ T856] __ipv6_dev_ac_inc+0x57e/0x930 [ 80.867974][ T856] addrconf_join_anycast+0x1bc/0x260 [ 80.868051][ T856] __ipv6_ifa_notify+0x75b/0xad0 [ 80.868129][ T856] addrconf_dad_completed+0x14b/0xe10 [ 80.868249][ T856] addrconf_dad_work+0x3c1/0x930 [ 80.868325][ T856] process_one_work+0xdf8/0x1410 [ 80.868402][ T856] worker_thread+0x4f1/0xd60 [ 80.868482][ T856] kthread+0x367/0x460 [ 80.868581][ T856] ret_from_fork+0x474/0x6b0 [ 80.868659][ T856] ret_from_fork_asm+0x11/0x20 [ 80.868736][ T856] [ 80.868776][ T856] -> (acaddr_hash_lock){+.+.}-{3:3} { [ 80.868855][ T856] HARDIRQ-ON-W at: [ 80.868953][ T856] __lock_acquire+0x378/0xc10 [ 80.869050][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.869146][ T856] _raw_spin_lock+0x33/0x40 [ 80.869286][ T856] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 80.869399][ T856] __ipv6_dev_ac_inc+0x57e/0x930 [ 80.869493][ T856] addrconf_join_anycast+0x1bc/0x260 [ 80.869631][ T856] __ipv6_ifa_notify+0x75b/0xad0 [ 80.869731][ T856] addrconf_dad_completed+0x14b/0xe10 [ 80.869828][ T856] addrconf_dad_work+0x3c1/0x930 [ 80.869965][ T856] process_one_work+0xdf8/0x1410 [ 80.870060][ T856] worker_thread+0x4f1/0xd60 [ 80.870157][ T856] kthread+0x367/0x460 [ 80.870238][ T856] ret_from_fork+0x474/0x6b0 [ 80.870375][ T856] ret_from_fork_asm+0x11/0x20 [ 80.870469][ T856] SOFTIRQ-ON-W at: [ 80.870527][ T856] __lock_acquire+0x378/0xc10 [ 80.870662][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.870758][ T856] _raw_spin_lock+0x33/0x40 [ 80.870853][ T856] __ipv6_dev_ac_dec+0x236/0x5d0 [ 80.870951][ T856] addrconf_leave_anycast+0x1bc/0x260 [ 80.871089][ T856] dev_forward_change+0x3b3/0x850 [ 80.871184][ T856] addrconf_fixup_forwarding+0x2af/0x4d0 [ 80.871303][ T856] addrconf_sysctl_forward+0x209/0x2b0 [ 80.871438][ T856] proc_sys_call_handler+0x31b/0x480 [ 80.871538][ T856] new_sync_write+0x333/0x750 [ 80.871635][ T856] vfs_write+0x6a4/0xc10 [ 80.871774][ T856] ksys_write+0x116/0x250 [ 80.871870][ T856] do_syscall_64+0x117/0x590 [ 80.871969][ T856] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 80.872125][ T856] INITIAL USE at: [ 80.872183][ T856] __lock_acquire+0x378/0xc10 [ 80.872285][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.872420][ T856] _raw_spin_lock+0x33/0x40 [ 80.872515][ T856] ipv6_add_acaddr_hash.isra.0+0x16d/0x350 [ 80.872629][ T856] __ipv6_dev_ac_inc+0x57e/0x930 [ 80.872765][ T856] addrconf_join_anycast+0x1bc/0x260 [ 80.872862][ T856] __ipv6_ifa_notify+0x75b/0xad0 [ 80.872958][ T856] addrconf_dad_completed+0x14b/0xe10 [ 80.873053][ T856] addrconf_dad_work+0x3c1/0x930 [ 80.873191][ T856] process_one_work+0xdf8/0x1410 [ 80.873294][ T856] worker_thread+0x4f1/0xd60 [ 80.873391][ T856] kthread+0x367/0x460 [ 80.873509][ T856] ret_from_fork+0x474/0x6b0 [ 80.873606][ T856] ret_from_fork_asm+0x11/0x20 [ 80.873703][ T856] } [ 80.873741][ T856] ... key at: [] acaddr_hash_lock+0x18/0x45a0 [ 80.873900][ T856] ... acquired at: [ 80.873958][ T856] mark_lock+0x1d7/0xa00 [ 80.874036][ T856] mark_usage+0x105/0x170 [ 80.874113][ T856] __lock_acquire+0x378/0xc10 [ 80.874233][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.874310][ T856] _raw_spin_lock+0x33/0x40 [ 80.874387][ T856] __ipv6_dev_ac_dec+0x236/0x5d0 [ 80.874463][ T856] addrconf_leave_anycast+0x1bc/0x260 [ 80.874581][ T856] dev_forward_change+0x3b3/0x850 [ 80.874659][ T856] addrconf_fixup_forwarding+0x2af/0x4d0 [ 80.874755][ T856] addrconf_sysctl_forward+0x209/0x2b0 [ 80.874872][ T856] proc_sys_call_handler+0x31b/0x480 [ 80.874949][ T856] new_sync_write+0x333/0x750 [ 80.875026][ T856] vfs_write+0x6a4/0xc10 [ 80.875103][ T856] ksys_write+0x116/0x250 [ 80.875220][ T856] do_syscall_64+0x117/0x590 [ 80.875302][ T856] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 80.875398][ T856] [ 80.875436][ T856] [ 80.875436][ T856] stack backtrace: [ 80.875571][ T856] CPU: 2 UID: 0 PID: 856 Comm: sysctl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 80.875574][ T856] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 80.875576][ T856] Call Trace: [ 80.875578][ T856] [ 80.875579][ T856] dump_stack_lvl+0x6f/0xa0 [ 80.875584][ T856] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 80.875587][ T856] mark_lock_irq+0x989/0x9c0 [ 80.875590][ T856] mark_lock+0x1d7/0xa00 [ 80.875592][ T856] mark_usage+0x105/0x170 [ 80.875593][ T856] __lock_acquire+0x378/0xc10 [ 80.875595][ T856] lock_acquire.part.0+0xbc/0x260 [ 80.875597][ T856] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 80.875599][ T856] ? rcu_is_watching+0x15/0xd0 [ 80.875602][ T856] ? do_raw_read_unlock+0x70/0x70 [ 80.875604][ T856] ? lock_acquire+0x134/0x160 [ 80.875606][ T856] _raw_spin_lock+0x33/0x40 [ 80.875607][ T856] ? __ipv6_dev_ac_dec+0x236/0x5d0 [ 80.875608][ T856] __ipv6_dev_ac_dec+0x236/0x5d0 [ 80.875610][ T856] addrconf_leave_anycast+0x1bc/0x260 [ 80.875612][ T856] ? find_held_lock+0x2b/0x80 [ 80.875615][ T856] ? __ipv6_isatap_ifid+0x210/0x210 [ 80.875617][ T856] ? mark_held_locks+0x40/0x70 [ 80.875618][ T856] ? lockdep_hardirqs_on+0x8c/0x130 [ 80.875620][ T856] dev_forward_change+0x3b3/0x850 [ 80.875622][ T856] ? addrconf_fixup_forwarding+0x4d/0x4d0 [ 80.875624][ T856] ? addrconf_sysctl_proxy_ndp+0x2f0/0x2f0 [ 80.875627][ T856] addrconf_fixup_forwarding+0x2af/0x4d0 [ 80.875629][ T856] addrconf_sysctl_forward+0x209/0x2b0 [ 80.875631][ T856] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 80.875633][ T856] ? addrconf_fixup_forwarding+0x4d0/0x4d0 [ 80.875635][ T856] ? __kvmalloc_node_noprof+0x305/0x8a0 [ 80.875638][ T856] ? proc_sys_call_handler+0x25d/0x480 [ 80.875641][ T856] proc_sys_call_handler+0x31b/0x480 [ 80.875643][ T856] ? proc_sys_lookup+0x3d0/0x3d0 [ 80.875645][ T856] ? rcu_read_unlock+0x1b/0x70 [ 80.875647][ T856] ? do_raw_spin_unlock+0x59/0x250 [ 80.875649][ T856] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 80.875651][ T856] ? rcu_read_lock_any_held+0x3c/0x90 [ 80.875652][ T856] ? proc_sys_call_handler+0x480/0x480 [ 80.875654][ T856] new_sync_write+0x333/0x750 [ 80.875656][ T856] ? __lock_acquire+0x508/0xc10 [ 80.875657][ T856] ? new_sync_read+0x740/0x740 [ 80.875659][ T856] ? lock_acquire.part.0+0xbc/0x260 [ 80.875660][ T856] ? ksys_write+0x116/0x250 [ 80.875662][ T856] vfs_write+0x6a4/0xc10 [ 80.875664][ T856] ksys_write+0x116/0x250 [ 80.875666][ T856] ? __ia32_sys_read+0xc0/0xc0 [ 80.875667][ T856] ? rcu_is_watching+0x15/0xd0 [ 80.875668][ T856] ? rcu_is_watching+0x15/0xd0 [ 80.875670][ T856] do_syscall_64+0x117/0x590 [ 80.875671][ T856] ? trace_hardirqs_off+0xd/0x30 [ 80.875675][ T856] ? exc_page_fault+0xee/0x100 [ 80.875676][ T856] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 80.875678][ T856] RIP: 0033:0x7fda718e908e [ 80.875681][ T856] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 80.875683][ T856] RSP: 002b:00007fff47f1f900 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 80.875685][ T856] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007fda718e908e [ 80.875687][ T856] RDX: 0000000000000002 RSI: 0000563c84c164b0 RDI: 0000000000000005 [ 80.875688][ T856] RBP: 00007fff47f1f910 R08: 0000000000000000 R09: 0000000000000000 [ 80.875688][ T856] R10: 0000000000000000 R11: 0000000000000202 R12: 0000563c84c185e0 [ 80.875689][ T856] R13: 0000563c84c16470 R14: 0000000000000002 R15: 0000000000000000 [ 80.875691][ T856] [ 81.090796][ T867] br1: port 1(veth1) entered disabled state [ 81.111546][ T868] veth1: left allmulticast mode [ 81.114443][ T868] veth1: left promiscuous mode [ 81.114715][ T868] br1: port 1(veth1) entered disabled state