[ 1060.388961][ T4005] br1: port 1(vx10) entered blocking state [ 1060.389178][ T4005] br1: port 1(vx10) entered disabled state [ 1060.389873][ T4005] vx10: entered allmulticast mode [ 1060.391344][ T4005] vx10: entered promiscuous mode [ 1060.391709][ T4005] br1: port 1(vx10) entered blocking state [ 1060.391875][ T4005] br1: port 1(vx10) entered forwarding state [ 1060.517516][ T4011] br1: port 2(vx20) entered blocking state [ 1060.517727][ T4011] br1: port 2(vx20) entered disabled state [ 1060.517916][ T4011] vx20: entered allmulticast mode [ 1060.519392][ T4011] vx20: entered promiscuous mode [ 1060.519735][ T4011] br1: port 2(vx20) entered blocking state [ 1060.519909][ T4011] br1: port 2(vx20) entered forwarding state [ 1060.572819][ T4013] br1: port 3(veth1) entered blocking state [ 1060.573017][ T4013] br1: port 3(veth1) entered disabled state [ 1060.573203][ T4013] veth1: entered allmulticast mode [ 1060.575237][ T4013] veth1: entered promiscuous mode [ 1060.613785][ T38] br1: port 3(veth1) entered blocking state [ 1060.614088][ T38] br1: port 3(veth1) entered forwarding state [ 1060.635581][ T4015] br1: port 4(veth2) entered blocking state [ 1060.635769][ T4015] br1: port 4(veth2) entered disabled state [ 1060.635953][ T4015] veth2: entered allmulticast mode [ 1060.638092][ T4015] veth2: entered promiscuous mode [ 1060.670769][ T91] br1: port 4(veth2) entered blocking state [ 1060.670988][ T91] br1: port 4(veth2) entered forwarding state [ 1060.780386][ T4020] br1: port 5(vx4001) entered blocking state [ 1060.780627][ T4020] br1: port 5(vx4001) entered disabled state [ 1060.780863][ T4020] vx4001: entered allmulticast mode [ 1060.783090][ T4020] vx4001: entered promiscuous mode [ 1060.783532][ T4020] br1: port 5(vx4001) entered blocking state [ 1060.783750][ T4020] br1: port 5(vx4001) entered forwarding state [ 1061.117789][ T9] br1: entered promiscuous mode [ 1063.051966][ T4110] br1: port 1(vx10) entered blocking state [ 1063.052221][ T4110] br1: port 1(vx10) entered disabled state [ 1063.053044][ T4110] vx10: entered allmulticast mode [ 1063.054560][ T4110] vx10: entered promiscuous mode [ 1063.055016][ T4110] br1: port 1(vx10) entered blocking state [ 1063.055222][ T4110] br1: port 1(vx10) entered forwarding state [ 1063.168857][ T4114] br1: port 2(vx20) entered blocking state [ 1063.169099][ T4114] br1: port 2(vx20) entered disabled state [ 1063.169339][ T4114] vx20: entered allmulticast mode [ 1063.170855][ T4114] vx20: entered promiscuous mode [ 1063.171237][ T4114] br1: port 2(vx20) entered blocking state [ 1063.171752][ T4114] br1: port 2(vx20) entered forwarding state [ 1063.279279][ T4118] br1: port 3(vx4001) entered blocking state [ 1063.280011][ T4118] br1: port 3(vx4001) entered disabled state [ 1063.280245][ T4118] vx4001: entered allmulticast mode [ 1063.281764][ T4118] vx4001: entered promiscuous mode [ 1063.282152][ T4118] br1: port 3(vx4001) entered blocking state [ 1063.282376][ T4118] br1: port 3(vx4001) entered forwarding state [ 1063.333908][ T4120] br1: port 4(w1) entered blocking state [ 1063.334061][ T4120] br1: port 4(w1) entered disabled state [ 1063.334210][ T4120] w1: entered allmulticast mode [ 1063.335659][ T4120] w1: entered promiscuous mode [ 1063.364717][ T38] br1: port 4(w1) entered blocking state [ 1063.364881][ T38] br1: port 4(w1) entered forwarding state [ 1063.417024][ T4123] br1: port 5(w3) entered blocking state [ 1063.417193][ T4123] br1: port 5(w3) entered disabled state [ 1063.417360][ T4123] w3: entered allmulticast mode [ 1063.418822][ T4123] w3: entered promiscuous mode [ 1063.449026][ T46] br1: port 5(w3) entered blocking state [ 1063.449177][ T46] br1: port 5(w3) entered forwarding state [ 1063.728517][ T9] br1: entered promiscuous mode [ 1065.063676][ C0] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 1065.064581][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 1065.066181][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 1065.066544][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 1065.066903][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 1065.067419][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 1065.067718][ C0] br1: received packet on vx20 with own address as source address (addr:00:00:5e:00:01:01, vlan:20) [ 1065.068061][ C0] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 1065.068452][ C0] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 1065.068713][ C0] br1: received packet on vx10 with own address as source address (addr:00:00:5e:00:01:01, vlan:10) [ 1076.275447][ T12] w3: left allmulticast mode [ 1076.275665][ T12] w3: left promiscuous mode [ 1076.275900][ T12] br1: port 5(w3) entered disabled state [ 1076.278556][ T12] w1: left allmulticast mode [ 1076.279764][ T12] w1: left promiscuous mode [ 1076.279984][ T12] br1: port 4(w1) entered disabled state [ 1076.281258][ T12] vx4001: left allmulticast mode [ 1076.281855][ T12] vx4001: left promiscuous mode [ 1076.282075][ T12] br1: port 3(vx4001) entered disabled state [ 1076.283904][ T12] vx20: left allmulticast mode [ 1076.284133][ T12] vx20: left promiscuous mode [ 1076.284496][ T12] br1: port 2(vx20) entered disabled state [ 1076.285666][ T12] vx10: left allmulticast mode [ 1076.285805][ T12] vx10: left promiscuous mode [ 1076.286001][ T12] br1: port 1(vx10) entered disabled state [ 1076.289495][ T12] [ 1076.289553][ T12] ====================================================== [ 1076.289672][ T12] WARNING: possible circular locking dependency detected [ 1076.289774][ T12] 7.2.0-rc6-virtme #1 Not tainted [ 1076.289858][ T12] ------------------------------------------------------ [ 1076.289966][ T12] kworker/u16:0/12 is trying to acquire lock: [ 1076.290071][ T12] ff11000010291108 ((&n->timer)){+.-.}-{0:0}, at: __timer_delete_sync+0xdb/0x130 [ 1076.290228][ T12] [ 1076.290228][ T12] but task is already holding lock: [ 1076.290358][ T12] ff1100000ff05358 (&tbl->lock){+.-.}-{3:3}, at: __neigh_ifdown.isra.0+0xa1/0xea0 [ 1076.290507][ T12] [ 1076.290507][ T12] which lock already depends on the new lock. [ 1076.290507][ T12] [ 1076.290681][ T12] [ 1076.290681][ T12] the existing dependency chain (in reverse order) is: [ 1076.290828][ T12] [ 1076.290828][ T12] -> #1 (&tbl->lock){+.-.}-{3:3}: [ 1076.290959][ T12] __lock_acquire+0x518/0xc20 [ 1076.291046][ T12] lock_acquire.part.0+0xbc/0x260 [ 1076.291127][ T12] _raw_spin_lock_bh+0x38/0x50 [ 1076.291212][ T12] ___neigh_create+0x2be/0x1070 [ 1076.291294][ T12] ip6_finish_output2+0xb64/0x1380 [ 1076.291374][ T12] ip6_finish_output+0x646/0xda0 [ 1076.291453][ T12] ip6_output+0x23f/0x7f0 [ 1076.291536][ T12] ip6_send_skb+0xee/0x350 [ 1076.291617][ T12] icmp6_send+0x16f9/0x1c90 [ 1076.291704][ T12] ip6_link_failure+0x2d/0x460 [ 1076.291790][ T12] ndisc_error_report+0x97/0x1b0 [ 1076.291870][ T12] neigh_invalidate+0x208/0x560 [ 1076.291950][ T12] neigh_timer_handler+0x8e9/0x1210 [ 1076.292031][ T12] call_timer_fn+0x163/0x4c0 [ 1076.292111][ T12] __run_timers+0x68f/0xaa0 [ 1076.292189][ T12] run_timer_softirq+0xf0/0x160 [ 1076.292274][ T12] handle_softirqs+0x1d8/0x8f0 [ 1076.292397][ T12] __irq_exit_rcu+0x103/0x1c0 [ 1076.292525][ T12] irq_exit_rcu+0xe/0x30 [ 1076.292607][ T12] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1076.292710][ T12] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1076.292898][ T12] pv_native_safe_halt+0xf/0x10 [ 1076.292979][ T12] default_idle+0x9/0x10 [ 1076.293065][ T12] default_idle_call+0x6e/0xb0 [ 1076.293191][ T12] cpuidle_idle_call.constprop.0+0x237/0x410 [ 1076.293293][ T12] do_idle+0xd8/0x180 [ 1076.293374][ T12] cpu_startup_entry+0x53/0x70 [ 1076.293543][ T12] start_secondary+0x204/0x2b0 [ 1076.293632][ T12] common_startup_64+0x13e/0x148 [ 1076.293715][ T12] [ 1076.293715][ T12] -> #0 ((&n->timer)){+.-.}-{0:0}: [ 1076.293844][ T12] check_prev_add+0xd8/0xe90 [ 1076.293926][ T12] validate_chain+0x6b8/0xc20 [ 1076.294006][ T12] __lock_acquire+0x518/0xc20 [ 1076.294092][ T12] lock_acquire.part.0+0xbc/0x260 [ 1076.294176][ T12] __timer_delete_sync+0xea/0x130 [ 1076.294305][ T12] neigh_flush_one+0x4bf/0x650 [ 1076.294385][ T12] __neigh_ifdown.isra.0+0x1b5/0xea0 [ 1076.294488][ T12] neigh_ifdown+0x10/0x20 [ 1076.294571][ T12] rt6_disable_ip+0x183/0x200 [ 1076.294702][ T12] addrconf_ifdown.isra.0+0x103/0x1670 [ 1076.294845][ T12] addrconf_notify+0x2c8/0xf30 [ 1076.294969][ T12] notifier_call_chain+0xae/0x300 [ 1076.295098][ T12] netif_close_many+0x366/0x710 [ 1076.295230][ T12] unregister_netdevice_many_notify+0x671/0x19a0 [ 1076.295330][ T12] ops_undo_list+0x615/0x8f0 [ 1076.295456][ T12] cleanup_net+0x431/0x890 [ 1076.295536][ T12] process_one_work+0xdf8/0x1410 [ 1076.295621][ T12] worker_thread+0x4f1/0xd60 [ 1076.295708][ T12] kthread+0x367/0x460 [ 1076.295791][ T12] ret_from_fork+0x474/0x6b0 [ 1076.295871][ T12] ret_from_fork_asm+0x11/0x20 [ 1076.295951][ T12] [ 1076.295951][ T12] other info that might help us debug this: [ 1076.295951][ T12] [ 1076.296122][ T12] Possible unsafe locking scenario: [ 1076.296122][ T12] [ 1076.296241][ T12] CPU0 CPU1 [ 1076.296321][ T12] ---- ---- [ 1076.296403][ T12] lock(&tbl->lock); [ 1076.296465][ T12] lock((&n->timer)); [ 1076.296567][ T12] lock(&tbl->lock); [ 1076.296682][ T12] lock((&n->timer)); [ 1076.296746][ T12] [ 1076.296746][ T12] *** DEADLOCK *** [ 1076.296746][ T12] [ 1076.296915][ T12] 5 locks held by kworker/u16:0/12: [ 1076.297042][ T12] #0: ff110000019d9d40 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0xd55/0x1410 [ 1076.297208][ T12] #1: ffa00000000c7d10 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdb7/0x1410 [ 1076.297348][ T12] #2: ffffffffa509e3a8 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbf/0x890 [ 1076.297494][ T12] #3: ffffffffa50b9bc0 (rtnl_mutex){+.+.}-{4:4}, at: ops_undo_list+0x534/0x8f0 [ 1076.297639][ T12] #4: ff1100000ff05358 (&tbl->lock){+.-.}-{3:3}, at: __neigh_ifdown.isra.0+0xa1/0xea0 [ 1076.297779][ T12] [ 1076.297779][ T12] stack backtrace: [ 1076.297880][ T12] CPU: 1 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 7.2.0-rc6-virtme #1 PREEMPT(full) [ 1076.297883][ T12] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1076.297885][ T12] Workqueue: netns cleanup_net [ 1076.297888][ T12] Call Trace: [ 1076.297890][ T12] [ 1076.297891][ T12] dump_stack_lvl+0x6f/0xa0 [ 1076.297894][ T12] print_circular_bug.cold+0x38/0x46 [ 1076.297897][ T12] check_noncircular+0x171/0x1a0 [ 1076.297900][ T12] check_prev_add+0xd8/0xe90 [ 1076.297902][ T12] ? look_up_lock_class+0x65/0x150 [ 1076.297904][ T12] ? check_prev_add+0xef/0xe90 [ 1076.297906][ T12] validate_chain+0x6b8/0xc20 [ 1076.297908][ T12] __lock_acquire+0x518/0xc20 [ 1076.297911][ T12] lock_acquire.part.0+0xbc/0x260 [ 1076.297913][ T12] ? __timer_delete_sync+0xdb/0x130 [ 1076.297914][ T12] ? rcu_is_watching+0x15/0xd0 [ 1076.297917][ T12] ? lock_acquire+0x13c/0x160 [ 1076.297919][ T12] ? __timer_delete_sync+0xdb/0x130 [ 1076.297920][ T12] __timer_delete_sync+0xea/0x130 [ 1076.297921][ T12] ? __timer_delete_sync+0xdb/0x130 [ 1076.297923][ T12] neigh_flush_one+0x4bf/0x650 [ 1076.297925][ T12] __neigh_ifdown.isra.0+0x1b5/0xea0 [ 1076.297927][ T12] ? find_held_lock+0x2b/0x80 [ 1076.297929][ T12] ? neigh_flush_one+0x650/0x650 [ 1076.297930][ T12] ? __lock_release.isra.0+0x6b/0x1a0 [ 1076.297933][ T12] ? mark_held_locks+0x40/0x70 [ 1076.297935][ T12] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 1076.297936][ T12] ? lockdep_hardirqs_on+0x8c/0x130 [ 1076.297938][ T12] ? _raw_spin_unlock_irqrestore+0x53/0x80 [ 1076.297940][ T12] ? _raw_spin_unlock_irqrestore+0x40/0x80 [ 1076.297941][ T12] ? rcu_preempt_deferred_qs_irqrestore+0x562/0xc10 [ 1076.297943][ T12] ? trace_hardirqs_off+0xd/0x30 [ 1076.297947][ T12] neigh_ifdown+0x10/0x20 [ 1076.297948][ T12] rt6_disable_ip+0x183/0x200 [ 1076.297950][ T12] ? rt6_sync_down_dev+0x120/0x120 [ 1076.297953][ T12] addrconf_ifdown.isra.0+0x103/0x1670 [ 1076.297955][ T12] ? neigh_flush_one+0x650/0x650 [ 1076.297957][ T12] ? addrconf_sysctl_addr_gen_mode+0xb10/0xb10 [ 1076.297959][ T12] ? mark_held_locks+0x40/0x70 [ 1076.297962][ T12] addrconf_notify+0x2c8/0xf30 [ 1076.297963][ T12] ? team_port_get_rtnl+0x65/0xc0 [ 1076.297967][ T12] notifier_call_chain+0xae/0x300 [ 1076.297969][ T12] netif_close_many+0x366/0x710 [ 1076.297971][ T12] ? __dev_close_many+0x530/0x530 [ 1076.297973][ T12] ? netif_close_many_and_unlock+0x22/0x2c0 [ 1076.297975][ T12] unregister_netdevice_many_notify+0x671/0x19a0 [ 1076.297977][ T12] ? mark_held_locks+0x40/0x70 [ 1076.297979][ T12] ? unregister_netdevice_queued+0x80/0x80 [ 1076.297980][ T12] ? lockdep_hardirqs_on+0x8c/0x130 [ 1076.297981][ T12] ? __call_rcu_common.constprop.0+0x3d1/0xa10 [ 1076.297984][ T12] ? mutex_is_locked+0x1c/0x50 [ 1076.297986][ T12] ? rtnl_is_locked+0x15/0x20 [ 1076.297987][ T12] ? nexthop_net_exit_rtnl+0x1f/0x270 [ 1076.297991][ T12] ops_undo_list+0x615/0x8f0 [ 1076.297993][ T12] ? lockdep_hardirqs_on+0x8c/0x130 [ 1076.297994][ T12] ? rtnl_net_dumpid_one+0x2d0/0x2d0 [ 1076.297995][ T12] ? __lock_release.isra.0+0x6b/0x1a0 [ 1076.297998][ T12] ? idr_destroy+0x121/0x250 [ 1076.298001][ T12] cleanup_net+0x431/0x890 [ 1076.298002][ T12] ? net_passive_dec+0x1c0/0x1c0 [ 1076.298004][ T12] ? process_one_work+0xdb7/0x1410 [ 1076.298005][ T12] ? lock_acquire+0x13c/0x160 [ 1076.298007][ T12] ? rcu_is_watching+0x15/0xd0 [ 1076.298009][ T12] process_one_work+0xdf8/0x1410 [ 1076.298011][ T12] ? pwq_dec_nr_in_flight+0x710/0x710 [ 1076.298012][ T12] ? lock_acquire.part.0+0xbc/0x260 [ 1076.298015][ T12] worker_thread+0x4f1/0xd60 [ 1076.298018][ T12] ? rescuer_thread+0x1320/0x1320 [ 1076.298019][ T12] kthread+0x367/0x460 [ 1076.298020][ T12] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 1076.298022][ T12] ? kthread_affine_node+0x330/0x330 [ 1076.298023][ T12] ret_from_fork+0x474/0x6b0 [ 1076.298025][ T12] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1076.298028][ T12] ? __switch_to+0x5a3/0xe00 [ 1076.298030][ T12] ? kthread_affine_node+0x330/0x330 [ 1076.298031][ T12] ret_from_fork_asm+0x11/0x20 [ 1076.298034][ T12] [ 1076.717107][ T50] br1: left promiscuous mode [ 1076.845788][ T4349] br1: port 4(veth2) entered disabled state [ 1076.867327][ T4350] veth2: left allmulticast mode [ 1076.867441][ T4350] veth2: left promiscuous mode [ 1076.867585][ T4350] br1: port 4(veth2) entered disabled state [ 1076.903137][ T4352] br1: port 3(veth1) entered disabled state [ 1076.919574][ T4353] veth1: left allmulticast mode [ 1076.919680][ T4353] veth1: left promiscuous mode [ 1076.919821][ T4353] br1: port 3(veth1) entered disabled state [ 1076.950978][ T4355] vx4001: left allmulticast mode [ 1076.951080][ T4355] vx4001: left promiscuous mode [ 1076.951228][ T4355] br1: port 5(vx4001) entered disabled state [ 1077.028186][ T4359] vx20: left allmulticast mode [ 1077.028300][ T4359] vx20: left promiscuous mode [ 1077.029053][ T4359] br1: port 2(vx20) entered disabled state [ 1077.113680][ T4363] vx10: left allmulticast mode [ 1077.113795][ T4363] vx10: left promiscuous mode [ 1077.113947][ T4363] br1: port 1(vx10) entered disabled state