[ 1882.584448][T12667] veth0: renamed from veth-alpha [ 1882.609022][T12668] veth0: renamed from veth-betaL [ 1882.638465][T12669] veth1: renamed from veth-betaR [ 1882.667620][T12670] veth0: renamed from veth-gamma [ 1885.219254][ C3] [ 1885.219360][ C3] ====================================================== [ 1885.219477][ C3] WARNING: possible circular locking dependency detected [ 1885.219585][ C3] 7.2.0-rc6-virtme #1 Not tainted [ 1885.219678][ C3] ------------------------------------------------------ [ 1885.219787][ C3] swapper/3/0 is trying to acquire lock: [ 1885.219877][ C3] ff110000115c0b58 (&tbl->lock){+.-.}-{3:3}, at: ___neigh_create+0x2be/0x1070 [ 1885.220050][ C3] [ 1885.220050][ C3] but task is already holding lock: [ 1885.220182][ C3] ffa0000000280c98 ((&n->timer)){+.-.}-{0:0}, at: call_timer_fn+0x113/0x4c0 [ 1885.220342][ C3] [ 1885.220342][ C3] which lock already depends on the new lock. [ 1885.220342][ C3] [ 1885.220519][ C3] [ 1885.220519][ C3] the existing dependency chain (in reverse order) is: [ 1885.220675][ C3] [ 1885.220675][ C3] -> #1 ((&n->timer)){+.-.}-{0:0}: [ 1885.220815][ C3] __lock_acquire+0x518/0xc20 [ 1885.220910][ C3] lock_acquire.part.0+0xbc/0x260 [ 1885.220996][ C3] __timer_delete_sync+0xea/0x130 [ 1885.221083][ C3] neigh_flush_one+0x4bf/0x650 [ 1885.221168][ C3] __neigh_ifdown.isra.0+0x1b5/0xea0 [ 1885.221276][ C3] neigh_ifdown+0x10/0x20 [ 1885.221362][ C3] fib_netdev_event+0x1a9/0x5d0 [ 1885.221452][ C3] notifier_call_chain+0xae/0x300 [ 1885.221541][ C3] netif_close_many+0x366/0x770 [ 1885.221630][ C3] unregister_netdevice_many_notify+0x71a/0x1b40 [ 1885.221737][ C3] default_device_exit_batch+0x38b/0x600 [ 1885.221844][ C3] ops_undo_list+0x2ce/0x8f0 [ 1885.221935][ C3] cleanup_net+0x431/0x940 [ 1885.222024][ C3] process_one_work+0xdf8/0x1410 [ 1885.222111][ C3] worker_thread+0x4f1/0xd60 [ 1885.222198][ C3] kthread+0x367/0x460 [ 1885.222286][ C3] ret_from_fork+0x474/0x6b0 [ 1885.222377][ C3] ret_from_fork_asm+0x11/0x20 [ 1885.222469][ C3] [ 1885.222469][ C3] -> #0 (&tbl->lock){+.-.}-{3:3}: [ 1885.222599][ C3] check_prev_add+0xd8/0xe90 [ 1885.222690][ C3] validate_chain+0x6b8/0xc20 [ 1885.222776][ C3] __lock_acquire+0x518/0xc20 [ 1885.222864][ C3] lock_acquire.part.0+0xbc/0x260 [ 1885.222950][ C3] _raw_spin_lock_bh+0x38/0x50 [ 1885.223036][ C3] ___neigh_create+0x2be/0x1070 [ 1885.223123][ C3] ip6_finish_output2+0xb9a/0x12f0 [ 1885.223210][ C3] ip6_finish_output+0x701/0xe80 [ 1885.223296][ C3] ip6_output+0x23f/0x7f0 [ 1885.223385][ C3] ndisc_send_skb+0xba3/0x1520 [ 1885.223473][ C3] ndisc_send_ns+0xa9/0x120 [ 1885.223558][ C3] ndisc_solicit+0x314/0x480 [ 1885.223644][ C3] neigh_probe+0xb3/0x100 [ 1885.223733][ C3] neigh_timer_handler+0x191/0x1210 [ 1885.223818][ C3] call_timer_fn+0x163/0x4c0 [ 1885.223907][ C3] __run_timers+0x68f/0xaa0 [ 1885.223998][ C3] run_timer_softirq+0xf0/0x160 [ 1885.224087][ C3] handle_softirqs+0x1d8/0x8f0 [ 1885.224178][ C3] __irq_exit_rcu+0x103/0x1c0 [ 1885.224266][ C3] irq_exit_rcu+0xe/0x30 [ 1885.224350][ C3] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1885.224464][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1885.224575][ C3] pv_native_safe_halt+0xf/0x10 [ 1885.224663][ C3] default_idle+0x9/0x10 [ 1885.224752][ C3] default_idle_call+0x6e/0xb0 [ 1885.224841][ C3] cpuidle_idle_call.constprop.0+0x237/0x410 [ 1885.224956][ C3] do_idle+0xd8/0x180 [ 1885.225042][ C3] cpu_startup_entry+0x53/0x70 [ 1885.225128][ C3] start_secondary+0x204/0x2b0 [ 1885.225216][ C3] common_startup_64+0x13e/0x148 [ 1885.225303][ C3] [ 1885.225303][ C3] other info that might help us debug this: [ 1885.225303][ C3] [ 1885.225472][ C3] Possible unsafe locking scenario: [ 1885.225472][ C3] [ 1885.225600][ C3] CPU0 CPU1 [ 1885.225687][ C3] ---- ---- [ 1885.225776][ C3] lock((&n->timer)); [ 1885.225846][ C3] lock(&tbl->lock); [ 1885.225957][ C3] lock((&n->timer)); [ 1885.226073][ C3] lock(&tbl->lock); [ 1885.226142][ C3] [ 1885.226142][ C3] *** DEADLOCK *** [ 1885.226142][ C3] [ 1885.226275][ C3] 3 locks held by swapper/3/0: [ 1885.226366][ C3] #0: ffa0000000280c98 ((&n->timer)){+.-.}-{0:0}, at: call_timer_fn+0x113/0x4c0 [ 1885.226520][ C3] #1: ffffffffa8b91d40 (rcu_read_lock){....}-{1:3}, at: ndisc_send_skb+0x175/0x1520 [ 1885.226675][ C3] #2: ffffffffa8b91d40 (rcu_read_lock){....}-{1:3}, at: ip6_output+0x11d/0x7f0 [ 1885.226825][ C3] [ 1885.226825][ C3] stack backtrace: [ 1885.226937][ C3] CPU: 3 UID: 0 PID: 0 Comm: swapper/3 Not tainted 7.2.0-rc6-virtme #1 PREEMPT(full) [ 1885.226940][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1885.226941][ C3] Call Trace: [ 1885.226943][ C3] [ 1885.226945][ C3] dump_stack_lvl+0x6f/0xa0 [ 1885.226948][ C3] print_circular_bug.cold+0x38/0x46 [ 1885.226951][ C3] check_noncircular+0x171/0x1a0 [ 1885.226954][ C3] ? mark_usage+0x61/0x170 [ 1885.226956][ C3] check_prev_add+0xd8/0xe90 [ 1885.226958][ C3] validate_chain+0x6b8/0xc20 [ 1885.226961][ C3] __lock_acquire+0x518/0xc20 [ 1885.226963][ C3] lock_acquire.part.0+0xbc/0x260 [ 1885.226965][ C3] ? ___neigh_create+0x2be/0x1070 [ 1885.226967][ C3] ? rcu_is_watching+0x15/0xd0 [ 1885.226969][ C3] ? lock_acquire+0x13c/0x160 [ 1885.226971][ C3] _raw_spin_lock_bh+0x38/0x50 [ 1885.226972][ C3] ? ___neigh_create+0x2be/0x1070 [ 1885.226974][ C3] ___neigh_create+0x2be/0x1070 [ 1885.226975][ C3] ? pv_native_safe_halt+0xf/0x10 [ 1885.226977][ C3] ip6_finish_output2+0xb9a/0x12f0 [ 1885.226979][ C3] ? ip6_xmit+0x2000/0x2000 [ 1885.226980][ C3] ? find_held_lock+0x2b/0x80 [ 1885.226982][ C3] ? __lock_release.isra.0+0x6b/0x1a0 [ 1885.226984][ C3] ? ip6_mtu+0x174/0x410 [ 1885.226987][ C3] ip6_finish_output+0x701/0xe80 [ 1885.226989][ C3] ip6_output+0x23f/0x7f0 [ 1885.226990][ C3] ? ip6_finish_output+0xe80/0xe80 [ 1885.226992][ C3] ? lock_acquire.part.0+0xbc/0x260 [ 1885.226993][ C3] ? find_held_lock+0x2b/0x80 [ 1885.226995][ C3] ? __lock_release.isra.0+0x6b/0x1a0 [ 1885.226996][ C3] ? __local_bh_enable_ip+0xa5/0x140 [ 1885.226999][ C3] ndisc_send_skb+0xba3/0x1520 [ 1885.227001][ C3] ? ndisc_recv_na+0x1090/0x1090 [ 1885.227004][ C3] ? __local_bh_enable_ip+0xa5/0x140 [ 1885.227006][ C3] ndisc_send_ns+0xa9/0x120 [ 1885.227007][ C3] ? __ipv6_chk_addr_and_flags+0x251/0x5f0 [ 1885.227009][ C3] ? ndisc_router_discovery+0x30c0/0x30c0 [ 1885.227011][ C3] ? __ipv6_chk_addr_and_flags+0x25b/0x5f0 [ 1885.227013][ C3] ? lockdep_hardirqs_on+0x8c/0x130 [ 1885.227014][ C3] ? _raw_spin_unlock_irqrestore+0x53/0x80 [ 1885.227016][ C3] ndisc_solicit+0x314/0x480 [ 1885.227017][ C3] ? ndisc_send_ns+0x120/0x120 [ 1885.227018][ C3] ? __lock_release.isra.0+0x6b/0x1a0 [ 1885.227020][ C3] ? neigh_probe+0x62/0x100 [ 1885.227021][ C3] ? neigh_periodic_work+0xa60/0xa60 [ 1885.227023][ C3] neigh_probe+0xb3/0x100 [ 1885.227024][ C3] neigh_timer_handler+0x191/0x1210 [ 1885.227026][ C3] ? neigh_periodic_work+0xa60/0xa60 [ 1885.227027][ C3] ? rcu_is_watching+0x15/0xd0 [ 1885.227028][ C3] call_timer_fn+0x163/0x4c0 [ 1885.227030][ C3] ? detach_if_pending+0x1d0/0x1d0 [ 1885.227031][ C3] ? find_held_lock+0x2b/0x80 [ 1885.227033][ C3] ? __lock_release.isra.0+0x6b/0x1a0 [ 1885.227035][ C3] ? rcu_is_watching+0x15/0xd0 [ 1885.227036][ C3] __run_timers+0x68f/0xaa0 [ 1885.227037][ C3] ? neigh_periodic_work+0xa60/0xa60 [ 1885.227039][ C3] ? __bpf_trace_itimer_expire+0x10/0x10 [ 1885.227041][ C3] ? __lock_acquire+0x518/0xc20 [ 1885.227044][ C3] ? __rwlock_init+0x150/0x150 [ 1885.227045][ C3] run_timer_softirq+0xf0/0x160 [ 1885.227047][ C3] ? clockevents_program_event+0x307/0x7e0 [ 1885.227050][ C3] ? __run_timers+0xaa0/0xaa0 [ 1885.227051][ C3] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 1885.227054][ C3] ? rcu_is_watching+0x15/0xd0 [ 1885.227055][ C3] handle_softirqs+0x1d8/0x8f0 [ 1885.227057][ C3] ? _local_bh_enable+0xd0/0xd0 [ 1885.227059][ C3] __irq_exit_rcu+0x103/0x1c0 [ 1885.227061][ C3] irq_exit_rcu+0xe/0x30 [ 1885.227063][ C3] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1885.227064][ C3] [ 1885.227065][ C3] [ 1885.227065][ C3] ? lockdep_hardirqs_on+0x8c/0x130 [ 1885.227067][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1885.227068][ C3] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 1885.227070][ C3] Code: 48 8b 3d 44 61 6e 02 e8 1f 00 00 00 48 2b 05 08 22 a7 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d a3 dd 19 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 1885.227072][ C3] RSP: 0018:ffa0000000167e00 EFLAGS: 00000282 [ 1885.227074][ C3] RAX: 00000000057b8189 RBX: ff11000001c80040 RCX: ffffffffa4ef7f27 [ 1885.227075][ C3] RDX: ff11000001c80040 RSI: ffffffffa80c4933 RDI: ffffffffa7a7d760 [ 1885.227076][ C3] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 1885.227077][ C3] R10: 0000000000000003 R11: 0000000000000001 R12: 1ff400000002cfc3 [ 1885.227078][ C3] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000000000 [ 1885.227079][ C3] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 1885.227082][ C3] default_idle+0x9/0x10 [ 1885.227083][ C3] default_idle_call+0x6e/0xb0 [ 1885.227084][ C3] cpuidle_idle_call.constprop.0+0x237/0x410 [ 1885.227086][ C3] ? arch_cpu_idle_exit+0x40/0x40 [ 1885.227088][ C3] ? mark_tsc_async_resets+0x30/0x30 [ 1885.227090][ C3] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 1885.227091][ C3] ? rcu_is_watching+0x15/0xd0 [ 1885.227093][ C3] do_idle+0xd8/0x180 [ 1885.227095][ C3] cpu_startup_entry+0x53/0x70 [ 1885.227096][ C3] start_secondary+0x204/0x2b0 [ 1885.227098][ C3] ? set_cpu_sibling_map+0x2130/0x2130 [ 1885.227100][ C3] common_startup_64+0x13e/0x148 [ 1885.227103][ C3] [ 1891.343751][T12693] lwtunnel_output(): recursion limit reached on datapath [ 1892.385976][T12693] lwtunnel_output(): recursion limit reached on datapath [ 1899.561764][ C0] lwtunnel_input(): recursion limit reached on datapath [ 1900.581296][ C0] lwtunnel_input(): recursion limit reached on datapath [ 1902.612671][T12706] lwtunnel_output(): recursion limit reached on datapath [ 1903.653172][T12706] lwtunnel_output(): recursion limit reached on datapath [ 1906.707097][ C0] lwtunnel_input(): recursion limit reached on datapath [ 1907.746122][ C0] lwtunnel_input(): recursion limit reached on datapath [ 1909.777135][T12712] lwtunnel_output(): recursion limit reached on datapath [ 1910.818099][T12712] lwtunnel_output(): recursion limit reached on datapath