[ 536.119934][T13272] br1: port 1(vx100) entered blocking state [ 536.120165][T13272] br1: port 1(vx100) entered disabled state [ 536.120346][T13272] vx100: entered allmulticast mode [ 536.121835][T13272] vx100: entered promiscuous mode [ 536.122210][T13272] br1: port 1(vx100) entered blocking state [ 536.122438][T13272] br1: port 1(vx100) entered forwarding state [ 536.188553][T13274] br1: port 2(veth1) entered blocking state [ 536.188776][T13274] br1: port 2(veth1) entered disabled state [ 536.188991][T13274] veth1: entered allmulticast mode [ 536.190463][T13274] veth1: entered promiscuous mode [ 536.215985][ T36] br1: port 2(veth1) entered blocking state [ 536.216209][ T36] br1: port 2(veth1) entered forwarding state [ 536.346327][T13280] br2: port 1(vx200) entered blocking state [ 536.346552][T13280] br2: port 1(vx200) entered disabled state [ 536.346927][T13280] vx200: entered allmulticast mode [ 536.348396][T13280] vx200: entered promiscuous mode [ 536.348997][T13280] br2: port 1(vx200) entered blocking state [ 536.349176][T13280] br2: port 1(vx200) entered forwarding state [ 536.438698][T13283] br2: port 2(veth2.20) entered blocking state [ 536.438957][T13283] br2: port 2(veth2.20) entered disabled state [ 536.439229][T13283] veth2.20: entered allmulticast mode [ 536.439442][T13283] veth2: entered allmulticast mode [ 536.441066][T13283] veth2.20: entered promiscuous mode [ 536.441274][T13283] veth2: entered promiscuous mode [ 536.478132][T13285] br2: port 2(veth2.20) entered blocking state [ 536.478358][T13285] br2: port 2(veth2.20) entered forwarding state [ 537.629603][T13336] br3: port 1(w1) entered blocking state [ 537.629834][T13336] br3: port 1(w1) entered disabled state [ 537.630041][T13336] w1: entered allmulticast mode [ 537.631606][T13336] w1: entered promiscuous mode [ 537.668353][T13337] br3: port 1(w1) entered blocking state [ 537.668554][T13337] br3: port 1(w1) entered forwarding state [ 537.805598][T13342] br3: port 2(vx100) entered blocking state [ 537.805882][T13342] br3: port 2(vx100) entered disabled state [ 537.806161][T13342] vx100: entered allmulticast mode [ 537.807990][T13342] vx100: entered promiscuous mode [ 537.809218][T13342] br3: port 2(vx100) entered blocking state [ 537.809489][T13342] br3: port 2(vx100) entered forwarding state [ 538.837848][T13389] br3: port 1(w1) entered blocking state [ 538.838064][T13389] br3: port 1(w1) entered disabled state [ 538.838268][T13389] w1: entered allmulticast mode [ 538.840202][T13389] w1: entered promiscuous mode [ 538.870740][T13390] br3: port 1(w1) entered blocking state [ 538.870931][T13390] br3: port 1(w1) entered forwarding state [ 539.002067][T13395] br3: port 2(vx200) entered blocking state [ 539.002297][T13395] br3: port 2(vx200) entered disabled state [ 539.002549][T13395] vx200: entered allmulticast mode [ 539.004648][T13395] vx200: entered promiscuous mode [ 539.005260][T13395] br3: port 2(vx200) entered blocking state [ 539.005525][T13395] br3: port 2(vx200) entered forwarding state [ 539.774459][T13434] br3: port 3(w1.20) entered blocking state [ 539.774767][T13434] br3: port 3(w1.20) entered disabled state [ 539.775045][T13434] w1.20: entered allmulticast mode [ 539.776763][T13434] w1.20: entered promiscuous mode [ 539.967665][T13447] br3: port 3(w1.20) entered blocking state [ 539.967966][T13447] br3: port 3(w1.20) entered forwarding state [ 540.113222][ C1] IPv6: w2: IPv6 duplicate address fe80::c059:2dff:fe15:ef1f used by c2:59:2d:15:ef:1f detected! [ 547.936802][ C0] clocksource: Watchdog remote CPU 2 read timed out [ 547.982168][ T71] w1.20: left allmulticast mode [ 547.982848][ T71] w1.20: left promiscuous mode [ 547.984177][ T71] br3: port 3(w1.20) entered disabled state [ 547.988351][ T71] vx200: left allmulticast mode [ 547.988595][ T71] vx200: left promiscuous mode [ 547.989362][ T71] br3: port 2(vx200) entered disabled state [ 547.992564][ T71] w1: left allmulticast mode [ 547.992955][ T71] w1: left promiscuous mode [ 547.993290][ T71] br3: port 1(w1) entered disabled state [ 548.001444][ T71] [ 548.001542][ T71] ====================================================== [ 548.001702][ T71] WARNING: possible circular locking dependency detected [ 548.001816][ T71] 7.2.0-rc6-virtme #1 Not tainted [ 548.001913][ T71] ------------------------------------------------------ [ 548.002030][ T71] kworker/u16:1/71 is trying to acquire lock: [ 548.002145][ T71] ff11000012f86508 ((&n->timer)){+.-.}-{0:0}, at: __timer_delete_sync+0xdb/0x130 [ 548.002317][ T71] [ 548.002317][ T71] but task is already holding lock: [ 548.002461][ T71] ff11000012f40b58 (&tbl->lock){+.-.}-{3:3}, at: __neigh_ifdown.isra.0+0xa1/0xea0 [ 548.002654][ T71] [ 548.002654][ T71] which lock already depends on the new lock. [ 548.002654][ T71] [ 548.002854][ T71] [ 548.002854][ T71] the existing dependency chain (in reverse order) is: [ 548.003006][ T71] [ 548.003006][ T71] -> #1 (&tbl->lock){+.-.}-{3:3}: [ 548.003138][ T71] __lock_acquire+0x518/0xc20 [ 548.003227][ T71] lock_acquire.part.0+0xbc/0x260 [ 548.003312][ T71] _raw_spin_lock_bh+0x38/0x50 [ 548.003397][ T71] ___neigh_create+0x2be/0x1070 [ 548.003508][ T71] ip_finish_output2+0xe83/0x1f10 [ 548.003651][ T71] ip_output+0x1ca/0x660 [ 548.003778][ T71] ip_push_pending_frames+0xf6/0x250 [ 548.003929][ T71] __icmp_send+0xcb7/0x1ae0 [ 548.004015][ T71] ipv4_send_dest_unreach+0x438/0x9d0 [ 548.004162][ T71] ipv4_link_failure+0x16/0x190 [ 548.004245][ T71] arp_error_report+0x97/0x1b0 [ 548.004334][ T71] neigh_invalidate+0x208/0x560 [ 548.004424][ T71] neigh_timer_handler+0x8e9/0x1210 [ 548.004567][ T71] call_timer_fn+0x163/0x4c0 [ 548.004657][ T71] __run_timers+0x68f/0xaa0 [ 548.004750][ T71] run_timer_softirq+0xf0/0x160 [ 548.004834][ T71] handle_softirqs+0x1d8/0x8f0 [ 548.004962][ T71] __irq_exit_rcu+0x103/0x1c0 [ 548.005047][ T71] irq_exit_rcu+0xe/0x30 [ 548.005132][ T71] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 548.005281][ T71] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 548.005387][ T71] pv_native_safe_halt+0xf/0x10 [ 548.005477][ T71] default_idle+0x9/0x10 [ 548.005567][ T71] default_idle_call+0x6e/0xb0 [ 548.005704][ T71] cpuidle_idle_call.constprop.0+0x237/0x410 [ 548.005811][ T71] do_idle+0xd8/0x180 [ 548.005895][ T71] cpu_startup_entry+0x53/0x70 [ 548.005977][ T71] rest_init+0x1f7/0x200 [ 548.006148][ T71] start_kernel+0x3af/0x3b0 [ 548.006234][ T71] x86_64_start_reservations+0x24/0x30 [ 548.006340][ T71] x86_64_start_kernel+0x12b/0x130 [ 548.006433][ T71] common_startup_64+0x13e/0x148 [ 548.006530][ T71] [ 548.006530][ T71] -> #0 ((&n->timer)){+.-.}-{0:0}: [ 548.006665][ T71] check_prev_add+0xd8/0xe90 [ 548.006759][ T71] validate_chain+0x6b8/0xc20 [ 548.006852][ T71] __lock_acquire+0x518/0xc20 [ 548.006935][ T71] lock_acquire.part.0+0xbc/0x260 [ 548.007069][ T71] __timer_delete_sync+0xea/0x130 [ 548.007157][ T71] neigh_flush_one+0x4bf/0x650 [ 548.007242][ T71] __neigh_ifdown.isra.0+0x1b5/0xea0 [ 548.007346][ T71] neigh_ifdown+0x10/0x20 [ 548.007431][ T71] rt6_disable_ip+0x183/0x200 [ 548.007556][ T71] addrconf_ifdown.isra.0+0x103/0x1670 [ 548.007737][ T71] addrconf_notify+0x2c8/0xf30 [ 548.007949][ T71] notifier_call_chain+0xae/0x300 [ 548.008079][ T71] netif_close_many+0x366/0x710 [ 548.008210][ T71] unregister_netdevice_many_notify+0x671/0x19a0 [ 548.008372][ T71] ops_undo_list+0x615/0x8f0 [ 548.008500][ T71] cleanup_net+0x431/0x890 [ 548.008631][ T71] process_one_work+0xdf8/0x1410 [ 548.008762][ T71] worker_thread+0x4f1/0xd60 [ 548.008891][ T71] kthread+0x367/0x460 [ 548.009020][ T71] ret_from_fork+0x474/0x6b0 [ 548.009152][ T71] ret_from_fork_asm+0x11/0x20 [ 548.009361][ T71] [ 548.009361][ T71] other info that might help us debug this: [ 548.009361][ T71] [ 548.009543][ T71] Possible unsafe locking scenario: [ 548.009543][ T71] [ 548.009676][ T71] CPU0 CPU1 [ 548.009806][ T71] ---- ---- [ 548.009896][ T71] lock(&tbl->lock); [ 548.009962][ T71] lock((&n->timer)); [ 548.010067][ T71] lock(&tbl->lock); [ 548.010223][ T71] lock((&n->timer)); [ 548.010289][ T71] [ 548.010289][ T71] *** DEADLOCK *** [ 548.010289][ T71] [ 548.010417][ T71] 5 locks held by kworker/u16:1/71: [ 548.010513][ T71] #0: ff110000019d9d40 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0xd55/0x1410 [ 548.010739][ T71] #1: ffa00000004c7d10 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdb7/0x1410 [ 548.010890][ T71] #2: ffffffffa8e9e3a8 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbf/0x890 [ 548.011088][ T71] #3: ffffffffa8eb9bc0 (rtnl_mutex){+.+.}-{4:4}, at: ops_undo_list+0x534/0x8f0 [ 548.011236][ T71] #4: ff11000012f40b58 (&tbl->lock){+.-.}-{3:3}, at: __neigh_ifdown.isra.0+0xa1/0xea0 [ 548.011433][ T71] [ 548.011433][ T71] stack backtrace: [ 548.011601][ T71] CPU: 3 UID: 0 PID: 71 Comm: kworker/u16:1 Not tainted 7.2.0-rc6-virtme #1 PREEMPT(full) [ 548.011606][ T71] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 548.011608][ T71] Workqueue: netns cleanup_net [ 548.011613][ T71] Call Trace: [ 548.011615][ T71] [ 548.011617][ T71] dump_stack_lvl+0x6f/0xa0 [ 548.011622][ T71] print_circular_bug.cold+0x38/0x46 [ 548.011627][ T71] check_noncircular+0x171/0x1a0 [ 548.011632][ T71] check_prev_add+0xd8/0xe90 [ 548.011635][ T71] ? look_up_lock_class+0x65/0x150 [ 548.011638][ T71] ? check_prev_add+0xef/0xe90 [ 548.011642][ T71] validate_chain+0x6b8/0xc20 [ 548.011646][ T71] __lock_acquire+0x518/0xc20 [ 548.011651][ T71] lock_acquire.part.0+0xbc/0x260 [ 548.011654][ T71] ? __timer_delete_sync+0xdb/0x130 [ 548.011657][ T71] ? rcu_is_watching+0x15/0xd0 [ 548.011661][ T71] ? lock_acquire+0x13c/0x160 [ 548.011665][ T71] ? __timer_delete_sync+0xdb/0x130 [ 548.011667][ T71] __timer_delete_sync+0xea/0x130 [ 548.011670][ T71] ? __timer_delete_sync+0xdb/0x130 [ 548.011673][ T71] neigh_flush_one+0x4bf/0x650 [ 548.011677][ T71] __neigh_ifdown.isra.0+0x1b5/0xea0 [ 548.011680][ T71] ? fib6_clean_tree+0xf2/0x130 [ 548.011684][ T71] ? fib6_walk+0x3d0/0x3d0 [ 548.011687][ T71] ? neigh_flush_one+0x650/0x650 [ 548.011690][ T71] ? find_held_lock+0x2b/0x80 [ 548.011693][ T71] ? fib6_ifup+0x220/0x220 [ 548.011696][ T71] ? __lock_release.isra.0+0x6b/0x1a0 [ 548.011699][ T71] ? __fib6_clean_all+0x149/0x290 [ 548.011703][ T71] ? __local_bh_enable_ip+0xa5/0x140 [ 548.011707][ T71] ? __fib6_clean_all+0x14e/0x290 [ 548.011711][ T71] neigh_ifdown+0x10/0x20 [ 548.011714][ T71] rt6_disable_ip+0x183/0x200 [ 548.011716][ T71] ? rt6_sync_down_dev+0x120/0x120 [ 548.011719][ T71] ? __neigh_ifdown.isra.0+0x988/0xea0 [ 548.011723][ T71] addrconf_ifdown.isra.0+0x103/0x1670 [ 548.011727][ T71] ? neigh_flush_one+0x650/0x650 [ 548.011731][ T71] ? addrconf_sysctl_addr_gen_mode+0xb10/0xb10 [ 548.011735][ T71] ? mark_held_locks+0x40/0x70 [ 548.011739][ T71] addrconf_notify+0x2c8/0xf30 [ 548.011742][ T71] ? team_port_get_rtnl+0x65/0xc0 [ 548.011746][ T71] notifier_call_chain+0xae/0x300 [ 548.011751][ T71] netif_close_many+0x366/0x710 [ 548.011755][ T71] ? __dev_close_many+0x530/0x530 [ 548.011758][ T71] ? netif_close_many_and_unlock+0x22/0x2c0 [ 548.011762][ T71] unregister_netdevice_many_notify+0x671/0x19a0 [ 548.011766][ T71] ? mark_held_locks+0x40/0x70 [ 548.011769][ T71] ? unregister_netdevice_queued+0x80/0x80 [ 548.011771][ T71] ? lockdep_hardirqs_on+0x8c/0x130 [ 548.011774][ T71] ? __call_rcu_common.constprop.0+0x3d1/0xa10 [ 548.011778][ T71] ? mutex_is_locked+0x1c/0x50 [ 548.011781][ T71] ? rtnl_is_locked+0x15/0x20 [ 548.011783][ T71] ? nexthop_net_exit_rtnl+0x1f/0x270 [ 548.011789][ T71] ops_undo_list+0x615/0x8f0 [ 548.011792][ T71] ? lockdep_hardirqs_on+0x8c/0x130 [ 548.011795][ T71] ? rtnl_net_dumpid_one+0x2d0/0x2d0 [ 548.011797][ T71] ? __lock_release.isra.0+0x6b/0x1a0 [ 548.011800][ T71] ? idr_destroy+0x121/0x250 [ 548.011805][ T71] cleanup_net+0x431/0x890 [ 548.011808][ T71] ? net_passive_dec+0x1c0/0x1c0 [ 548.011811][ T71] ? process_one_work+0xdb7/0x1410 [ 548.011814][ T71] ? lock_acquire+0x13c/0x160 [ 548.011816][ T71] ? rcu_is_watching+0x15/0xd0 [ 548.011819][ T71] process_one_work+0xdf8/0x1410 [ 548.011824][ T71] ? pwq_dec_nr_in_flight+0x710/0x710 [ 548.011826][ T71] ? lock_acquire.part.0+0xbc/0x260 [ 548.011831][ T71] worker_thread+0x4f1/0xd60 [ 548.011835][ T71] ? rescuer_thread+0x1320/0x1320 [ 548.011837][ T71] ? __kthread_parkme+0xbd/0x210 [ 548.011840][ T71] ? rescuer_thread+0x1320/0x1320 [ 548.011843][ T71] ? rescuer_thread+0x1320/0x1320 [ 548.011844][ T71] kthread+0x367/0x460 [ 548.011846][ T71] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 548.011849][ T71] ? kthread_affine_node+0x330/0x330 [ 548.011850][ T71] ret_from_fork+0x474/0x6b0 [ 548.011853][ T71] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 548.011855][ T71] ? __switch_to+0x5a3/0xe00 [ 548.011858][ T71] ? kthread_affine_node+0x330/0x330 [ 548.011859][ T71] ret_from_fork_asm+0x11/0x20 [ 548.011863][ T71] [ 548.110883][ T71] vx100: left allmulticast mode [ 548.111007][ T71] vx100: left promiscuous mode [ 548.111167][ T71] br3: port 2(vx100) entered disabled state [ 548.112091][ T71] w1: left allmulticast mode [ 548.112186][ T71] w1: left promiscuous mode [ 548.112324][ T71] br3: port 1(w1) entered disabled state [ 548.551108][T13555] vx200: left allmulticast mode [ 548.551243][T13555] vx200: left promiscuous mode [ 548.551405][T13555] br2: port 1(vx200) entered disabled state [ 548.621167][T13558] br2: port 2(veth2.20) entered disabled state [ 548.621719][T13558] veth2.20 (unregistering): left allmulticast mode [ 548.621838][T13558] veth2: left allmulticast mode [ 548.621934][T13558] veth2.20 (unregistering): left promiscuous mode [ 548.622041][T13558] veth2: left promiscuous mode [ 548.622215][T13558] br2: port 2(veth2.20) entered disabled state [ 548.726171][T13562] br1: port 2(veth1) entered disabled state [ 548.747751][T13563] veth1: left allmulticast mode [ 548.747863][T13563] veth1: left promiscuous mode [ 548.748015][T13563] br1: port 2(veth1) entered disabled state [ 548.767849][T13564] vx100: left allmulticast mode [ 548.767957][T13564] vx100: left promiscuous mode [ 548.768113][T13564] br1: port 1(vx100) entered disabled state