[ 46.712063][ T546] ip (546) used greatest stack depth: 24592 bytes left [ 46.749975][ T547] ip (547) used greatest stack depth: 24424 bytes left [ 47.474148][ T583] veth0: renamed from veth-rt-1 [ 47.766880][ T593] veth0: renamed from veth-rt-2 [ 47.980410][ C0] clocksource: Watchdog remote CPU 2 read timed out [ 48.076974][ T602] ip (602) used greatest stack depth: 24040 bytes left [ 59.069601][ C2] [ 59.069711][ C2] ====================================================== [ 59.069831][ C2] WARNING: possible circular locking dependency detected [ 59.069942][ C2] 7.2.0-rc6-virtme #1 Not tainted [ 59.070037][ C2] ------------------------------------------------------ [ 59.070148][ C2] swapper/2/0 is trying to acquire lock: [ 59.070241][ C2] ff11000009edd358 (&tbl->lock){+.-.}-{3:3}, at: ___neigh_create+0x2be/0x1070 [ 59.070416][ C2] [ 59.070416][ C2] but task is already holding lock: [ 59.070551][ C2] ffa0000000228c98 ((&n->timer)){+.-.}-{0:0}, at: call_timer_fn+0x113/0x4c0 [ 59.070713][ C2] [ 59.070713][ C2] which lock already depends on the new lock. [ 59.070713][ C2] [ 59.070892][ C2] [ 59.070892][ C2] the existing dependency chain (in reverse order) is: [ 59.071045][ C2] [ 59.071045][ C2] -> #1 ((&n->timer)){+.-.}-{0:0}: [ 59.071183][ C2] __lock_acquire+0x518/0xc20 [ 59.071276][ C2] lock_acquire.part.0+0xbc/0x260 [ 59.071366][ C2] __timer_delete_sync+0xea/0x130 [ 59.071459][ C2] neigh_flush_one+0x4bf/0x650 [ 59.071546][ C2] __neigh_ifdown.isra.0+0x1b5/0xea0 [ 59.071653][ C2] neigh_ifdown+0x10/0x20 [ 59.071741][ C2] rt6_disable_ip+0x183/0x200 [ 59.071832][ C2] addrconf_ifdown.isra.0+0x103/0x1670 [ 59.071942][ C2] addrconf_notify+0x2c8/0xf30 [ 59.072030][ C2] notifier_call_chain+0xae/0x300 [ 59.072120][ C2] netif_close_many+0x366/0x770 [ 59.072208][ C2] netif_close_many_and_unlock+0x22/0x2c0 [ 59.072315][ C2] unregister_netdevice_many_notify+0x56f/0x1b40 [ 59.072429][ C2] default_device_exit_batch+0x38b/0x600 [ 59.072540][ C2] ops_undo_list+0x2ce/0x8f0 [ 59.072629][ C2] cleanup_net+0x431/0x940 [ 59.072721][ C2] process_one_work+0xdf8/0x1410 [ 59.072810][ C2] worker_thread+0x4f1/0xd60 [ 59.072904][ C2] kthread+0x367/0x460 [ 59.072992][ C2] ret_from_fork+0x474/0x6b0 [ 59.073094][ C2] ret_from_fork_asm+0x11/0x20 [ 59.073183][ C2] [ 59.073183][ C2] -> #0 (&tbl->lock){+.-.}-{3:3}: [ 59.073315][ C2] check_prev_add+0xd8/0xe90 [ 59.073407][ C2] validate_chain+0x6b8/0xc20 [ 59.073495][ C2] __lock_acquire+0x518/0xc20 [ 59.073583][ C2] lock_acquire.part.0+0xbc/0x260 [ 59.073674][ C2] _raw_spin_lock_bh+0x38/0x50 [ 59.073762][ C2] ___neigh_create+0x2be/0x1070 [ 59.073848][ C2] ip6_finish_output2+0xb9a/0x12f0 [ 59.073936][ C2] ip6_finish_output+0x701/0xe80 [ 59.074023][ C2] ip6_output+0x23f/0x7f0 [ 59.074111][ C2] ip6_send_skb+0xee/0x350 [ 59.074198][ C2] icmp6_send+0x1728/0x1cd0 [ 59.074289][ C2] ip6_link_failure+0x2d/0x460 [ 59.074375][ C2] ndisc_error_report+0x97/0x1b0 [ 59.074466][ C2] neigh_invalidate+0x208/0x560 [ 59.074550][ C2] neigh_timer_handler+0x8e9/0x1210 [ 59.074635][ C2] call_timer_fn+0x163/0x4c0 [ 59.074719][ C2] __run_timers+0x68f/0xaa0 [ 59.074806][ C2] run_timer_softirq+0xf0/0x160 [ 59.074893][ C2] handle_softirqs+0x1d8/0x8f0 [ 59.074981][ C2] __irq_exit_rcu+0x103/0x1c0 [ 59.075066][ C2] irq_exit_rcu+0xe/0x30 [ 59.075152][ C2] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 59.075262][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 59.075371][ C2] pv_native_safe_halt+0xf/0x10 [ 59.075465][ C2] default_idle+0x9/0x10 [ 59.075552][ C2] default_idle_call+0x6e/0xb0 [ 59.075639][ C2] cpuidle_idle_call.constprop.0+0x237/0x410 [ 59.075748][ C2] do_idle+0xd8/0x180 [ 59.075833][ C2] cpu_startup_entry+0x53/0x70 [ 59.075919][ C2] start_secondary+0x204/0x2b0 [ 59.076011][ C2] common_startup_64+0x13e/0x148 [ 59.076099][ C2] [ 59.076099][ C2] other info that might help us debug this: [ 59.076099][ C2] [ 59.076271][ C2] Possible unsafe locking scenario: [ 59.076271][ C2] [ 59.076408][ C2] CPU0 CPU1 [ 59.076494][ C2] ---- ---- [ 59.076583][ C2] lock((&n->timer)); [ 59.076654][ C2] lock(&tbl->lock); [ 59.076766][ C2] lock((&n->timer)); [ 59.076876][ C2] lock(&tbl->lock); [ 59.076944][ C2] [ 59.076944][ C2] *** DEADLOCK *** [ 59.076944][ C2] [ 59.077074][ C2] 5 locks held by swapper/2/0: [ 59.077163][ C2] #0: ffa0000000228c98 ((&n->timer)){+.-.}-{0:0}, at: call_timer_fn+0x113/0x4c0 [ 59.077323][ C2] #1: ffffffffbc791d40 (rcu_read_lock){....}-{1:3}, at: icmp6_send+0x283/0x1cd0 [ 59.077478][ C2] #2: ff110000092d9318 (k-slock-AF_INET6){+...}-{3:3}, at: icmp6_send+0x9ff/0x1cd0 [ 59.077630][ C2] #3: ffffffffbc791d40 (rcu_read_lock){....}-{1:3}, at: ip6_send_skb+0xa2/0x350 [ 59.077782][ C2] #4: ffffffffbc791d40 (rcu_read_lock){....}-{1:3}, at: ip6_output+0x11d/0x7f0 [ 59.077938][ C2] [ 59.077938][ C2] stack backtrace: [ 59.078048][ C2] CPU: 2 UID: 0 PID: 0 Comm: swapper/2 Not tainted 7.2.0-rc6-virtme #1 PREEMPT(full) [ 59.078051][ C2] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 59.078053][ C2] Call Trace: [ 59.078055][ C2] [ 59.078057][ C2] dump_stack_lvl+0x6f/0xa0 [ 59.078059][ C2] print_circular_bug.cold+0x38/0x46 [ 59.078062][ C2] check_noncircular+0x171/0x1a0 [ 59.078065][ C2] check_prev_add+0xd8/0xe90 [ 59.078068][ C2] validate_chain+0x6b8/0xc20 [ 59.078070][ C2] __lock_acquire+0x518/0xc20 [ 59.078073][ C2] lock_acquire.part.0+0xbc/0x260 [ 59.078075][ C2] ? ___neigh_create+0x2be/0x1070 [ 59.078077][ C2] ? rcu_is_watching+0x15/0xd0 [ 59.078079][ C2] ? lock_acquire+0x13c/0x160 [ 59.078081][ C2] _raw_spin_lock_bh+0x38/0x50 [ 59.078083][ C2] ? ___neigh_create+0x2be/0x1070 [ 59.078084][ C2] ___neigh_create+0x2be/0x1070 [ 59.078086][ C2] ip6_finish_output2+0xb9a/0x12f0 [ 59.078088][ C2] ? ip6_xmit+0x2000/0x2000 [ 59.078090][ C2] ? find_held_lock+0x2b/0x80 [ 59.078092][ C2] ? __lock_release.isra.0+0x6b/0x1a0 [ 59.078094][ C2] ? ip6_mtu+0x174/0x410 [ 59.078096][ C2] ip6_finish_output+0x701/0xe80 [ 59.078098][ C2] ip6_output+0x23f/0x7f0 [ 59.078099][ C2] ? ip6_finish_output+0xe80/0xe80 [ 59.078101][ C2] ? l3mdev_l3_out.constprop.0+0xe5/0x340 [ 59.078105][ C2] ip6_send_skb+0xee/0x350 [ 59.078106][ C2] icmp6_send+0x1728/0x1cd0 [ 59.078109][ C2] ? icmpv6_push_pending_frames+0x5f0/0x5f0 [ 59.078110][ C2] ? rcu_read_lock_any_held+0x3c/0x90 [ 59.078115][ C2] ? rcu_read_lock_any_held+0x3c/0x90 [ 59.078117][ C2] ? __lock_acquire+0x518/0xc20 [ 59.078119][ C2] ? find_held_lock+0x2b/0x80 [ 59.078121][ C2] ip6_link_failure+0x2d/0x460 [ 59.078122][ C2] ndisc_error_report+0x97/0x1b0 [ 59.078124][ C2] neigh_invalidate+0x208/0x560 [ 59.078126][ C2] ? neigh_periodic_work+0xa60/0xa60 [ 59.078127][ C2] neigh_timer_handler+0x8e9/0x1210 [ 59.078129][ C2] ? neigh_periodic_work+0xa60/0xa60 [ 59.078130][ C2] ? rcu_is_watching+0x15/0xd0 [ 59.078132][ C2] call_timer_fn+0x163/0x4c0 [ 59.078133][ C2] ? detach_if_pending+0x1d0/0x1d0 [ 59.078134][ C2] ? find_held_lock+0x2b/0x80 [ 59.078136][ C2] ? __lock_release.isra.0+0x6b/0x1a0 [ 59.078138][ C2] ? rcu_is_watching+0x15/0xd0 [ 59.078140][ C2] __run_timers+0x68f/0xaa0 [ 59.078141][ C2] ? neigh_periodic_work+0xa60/0xa60 [ 59.078143][ C2] ? __bpf_trace_itimer_expire+0x10/0x10 [ 59.078144][ C2] ? __lock_acquire+0x518/0xc20 [ 59.078147][ C2] ? __rwlock_init+0x150/0x150 [ 59.078149][ C2] run_timer_softirq+0xf0/0x160 [ 59.078150][ C2] ? clockevents_program_event+0x307/0x7e0 [ 59.078153][ C2] ? __run_timers+0xaa0/0xaa0 [ 59.078154][ C2] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 59.078157][ C2] ? rcu_is_watching+0x15/0xd0 [ 59.078159][ C2] handle_softirqs+0x1d8/0x8f0 [ 59.078161][ C2] ? _local_bh_enable+0xd0/0xd0 [ 59.078163][ C2] __irq_exit_rcu+0x103/0x1c0 [ 59.078165][ C2] irq_exit_rcu+0xe/0x30 [ 59.078167][ C2] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 59.078168][ C2] [ 59.078169][ C2] [ 59.078169][ C2] ? lockdep_hardirqs_on+0x8c/0x130 [ 59.078171][ C2] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 59.078172][ C2] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 59.078175][ C2] Code: 48 8b 3d 44 61 6e 02 e8 1f 00 00 00 48 2b 05 08 22 a7 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d a3 dd 19 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 59.078176][ C2] RSP: 0018:ffa0000000157e00 EFLAGS: 00000282 [ 59.078179][ C2] RAX: 00000000001b3f9f RBX: ff11000001bac6c0 RCX: ffffffffb8af7f27 [ 59.078180][ C2] RDX: ff11000001bac6c0 RSI: ffffffffbbcc4933 RDI: ffffffffbb67d760 [ 59.078180][ C2] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 59.078181][ C2] R10: 0000000000000002 R11: 0000000000000001 R12: 1ff400000002afc3 [ 59.078182][ C2] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000000000 [ 59.078183][ C2] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 59.078186][ C2] default_idle+0x9/0x10 [ 59.078187][ C2] default_idle_call+0x6e/0xb0 [ 59.078188][ C2] cpuidle_idle_call.constprop.0+0x237/0x410 [ 59.078190][ C2] ? arch_cpu_idle_exit+0x40/0x40 [ 59.078192][ C2] ? mark_tsc_async_resets+0x30/0x30 [ 59.078194][ C2] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 59.078195][ C2] ? rcu_is_watching+0x15/0xd0 [ 59.078197][ C2] do_idle+0xd8/0x180 [ 59.078199][ C2] cpu_startup_entry+0x53/0x70 [ 59.078200][ C2] start_secondary+0x204/0x2b0 [ 59.078202][ C2] ? set_cpu_sibling_map+0x2130/0x2130 [ 59.078205][ C2] common_startup_64+0x13e/0x148 [ 59.078208][ C2]