[ 1140.395673][T24334] IPv6: Can't replace route, no match found [ 1141.388928][T24404] IPv6: Can't replace route, no match found [ 1163.086322][T25341] Mirror/redirect action on [ 1164.070578][ C0] [ 1164.070682][ C0] ================================ [ 1164.070786][ C0] WARNING: inconsistent lock state [ 1164.070887][ C0] 7.1.0-rc5-virtme #1 Not tainted [ 1164.070987][ C0] -------------------------------- [ 1164.071087][ C0] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 1164.071211][ C0] kworker/u16:1/67 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 1164.071340][ C0] ffffffffc02d67b8 (mirred_list_lock){+.?.}-{3:3}, at: tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1164.071546][ C0] {SOFTIRQ-ON-W} state was registered at: [ 1164.071647][ C0] __lock_acquire+0x378/0xc10 [ 1164.071753][ C0] lock_acquire.part.0+0xbc/0x260 [ 1164.071853][ C0] _raw_spin_lock+0x33/0x40 [ 1164.071955][ C0] tcf_mirred_init+0x844/0xd70 [act_mirred] [ 1164.072078][ C0] tcf_action_init_1+0x428/0x6b0 [ 1164.072178][ C0] tcf_action_init+0x3cf/0x890 [ 1164.072287][ C0] tcf_exts_validate_ex+0x411/0x670 [ 1164.072387][ C0] tcf_exts_validate+0x14/0x20 [ 1164.072545][ C0] basic_change+0x362/0x1307 [cls_basic] [ 1164.072704][ C0] tc_new_tfilter+0x875/0x21e0 [ 1164.072863][ C0] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 1164.073018][ C0] netlink_rcv_skb+0x14e/0x3a0 [ 1164.073175][ C0] netlink_unicast+0x486/0x750 [ 1164.073339][ C0] netlink_sendmsg+0x735/0xc60 [ 1164.073490][ C0] ____sys_sendmsg+0x419/0x850 [ 1164.073647][ C0] ___sys_sendmsg+0x14e/0x1d0 [ 1164.073803][ C0] __sys_sendmsg+0x145/0x1f0 [ 1164.073955][ C0] do_syscall_64+0x117/0x590 [ 1164.074104][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1164.074284][ C0] irq event stamp: 27816084 [ 1164.074422][ C0] hardirqs last enabled at (27816084): [] _raw_spin_unlock_irqrestore+0x53/0x80 [ 1164.074624][ C0] hardirqs last disabled at (27816083): [] _raw_spin_lock_irqsave+0x50/0x60 [ 1164.074821][ C0] softirqs last enabled at (27813988): [] handle_softirqs+0x611/0x940 [ 1164.074996][ C0] softirqs last disabled at (27814663): [] __irq_exit_rcu+0x103/0x1c0 [ 1164.075173][ C0] [ 1164.075173][ C0] other info that might help us debug this: [ 1164.075323][ C0] Possible unsafe locking scenario: [ 1164.075323][ C0] [ 1164.075469][ C0] CPU0 [ 1164.075543][ C0] ---- [ 1164.075618][ C0] lock(mirred_list_lock); [ 1164.075714][ C0] [ 1164.075790][ C0] lock(mirred_list_lock); [ 1164.075888][ C0] [ 1164.075888][ C0] *** DEADLOCK *** [ 1164.075888][ C0] [ 1164.076033][ C0] 7 locks held by kworker/u16:1/67: [ 1164.076134][ C0] #0: ff110000019e9d40 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0xd55/0x1410 [ 1164.076339][ C0] #1: ffa0000000487d10 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdb7/0x1410 [ 1164.076515][ C0] #2: ffffffffa0898528 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbf/0x940 [ 1164.076697][ C0] #3: ffffffffa08b4300 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x9a/0x600 [ 1164.076899][ C0] #4: ffffffffa095dca8 ((inetaddr_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x54/0xb0 [ 1164.077102][ C0] #5: ffffffffa03a5bf8 (remove_cache_srcu){.+.+}-{0:0}, at: kasan_quarantine_reduce+0x84/0x240 [ 1164.077313][ C0] #6: ffffffffa018bc80 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x389/0x1020 [ 1164.077489][ C0] [ 1164.077489][ C0] stack backtrace: [ 1164.077613][ C0] CPU: 0 UID: 0 PID: 67 Comm: kworker/u16:1 Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 1164.077616][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1164.077619][ C0] Workqueue: netns cleanup_net [ 1164.077622][ C0] Call Trace: [ 1164.077624][ C0] [ 1164.077625][ C0] dump_stack_lvl+0x6f/0xa0 [ 1164.077631][ C0] print_usage_bug.part.0.cold+0xa9/0xb7 [ 1164.077634][ C0] ? filter_irq_stacks+0xd0/0xd0 [ 1164.077637][ C0] mark_lock_irq+0x4e3/0x9c0 [ 1164.077639][ C0] ? sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1164.077641][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1164.077643][ C0] ? save_trace+0x68/0x280 [ 1164.077644][ C0] ? ip_mc_msfilter+0x80/0xac0 [ 1164.077648][ C0] mark_lock+0x1d7/0xa00 [ 1164.077650][ C0] mark_usage+0x42/0x170 [ 1164.077652][ C0] __lock_acquire+0x378/0xc10 [ 1164.077653][ C0] ? mark_held_locks+0x40/0x70 [ 1164.077654][ C0] ? rcu_do_batch+0x2b4/0x1020 [ 1164.077657][ C0] lock_acquire.part.0+0xbc/0x260 [ 1164.077659][ C0] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1164.077660][ C0] ? rcu_is_watching+0x15/0xd0 [ 1164.077662][ C0] ? lock_acquire+0x134/0x160 [ 1164.077664][ C0] _raw_spin_lock+0x33/0x40 [ 1164.077666][ C0] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1164.077667][ C0] tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1164.077669][ C0] tcf_action_rcu_free+0x74/0x1a0 [ 1164.077670][ C0] ? rcu_do_batch+0x2b4/0x1020 [ 1164.077672][ C0] rcu_do_batch+0x2b6/0x1020 [ 1164.077675][ C0] ? trace_rcu_batch_end+0x330/0x330 [ 1164.077677][ C0] ? mark_held_locks+0x40/0x70 [ 1164.077678][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 1164.077680][ C0] ? lockdep_hardirqs_on+0x8c/0x130 [ 1164.077681][ C0] rcu_core+0x2bf/0x640 [ 1164.077683][ C0] handle_softirqs+0x1d8/0x940 [ 1164.077685][ C0] ? find_held_lock+0x2b/0x80 [ 1164.077686][ C0] ? __lock_release.isra.0+0x6b/0x1a0 [ 1164.077688][ C0] ? _local_bh_enable+0xd0/0xd0 [ 1164.077690][ C0] __irq_exit_rcu+0x103/0x1c0 [ 1164.077691][ C0] irq_exit_rcu+0xe/0x30 [ 1164.077693][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1164.077694][ C0] [ 1164.077695][ C0] [ 1164.077696][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1164.077697][ C0] RIP: 0010:_raw_spin_unlock_irqrestore+0x36/0x80 [ 1164.077700][ C0] Code: f5 53 48 8b 74 24 10 48 89 fb 48 83 c7 18 e8 61 10 9d fd 48 89 df e8 e9 66 9d fd f7 c5 00 02 00 00 75 1f 9c 58 f6 c4 02 75 2f 01 00 00 00 e8 80 f4 8f fd 65 8b 05 29 1a 5e 02 85 c0 74 12 5b [ 1164.077701][ C0] RSP: 0018:ffa00000004871b8 EFLAGS: 00000246 [ 1164.077703][ C0] RAX: 0000000000000092 RBX: ff11000001041440 RCX: ffffffff9ed78613 [ 1164.077704][ C0] RDX: ff110000090b8040 RSI: ffffffff9f693d1a RDI: ffffffff9f0727c0 [ 1164.077705][ C0] RBP: 0000000000000246 R08: 0000000000000000 R09: 0000000000000000 [ 1164.077706][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: ff1100000dd1c468 [ 1164.077707][ C0] R13: 0000000000000000 R14: ffa0000000487200 R15: 0000000000000000 [ 1164.077709][ C0] ? _raw_spin_unlock_irqrestore+0x53/0x80 [ 1164.077711][ C0] qlist_free_all+0x5c/0x110 [ 1164.077713][ C0] kasan_quarantine_reduce+0x196/0x240 [ 1164.077715][ C0] __kasan_slab_alloc+0x4b/0x70 [ 1164.077717][ C0] kmem_cache_alloc_node_noprof+0x224/0x640 [ 1164.077720][ C0] __alloc_skb+0xde/0x5f0 [ 1164.077722][ C0] ? __alloc_skb+0x4c2/0x5f0 [ 1164.077724][ C0] ? napi_skb_cache_get+0x7b0/0x7b0 [ 1164.077725][ C0] ? atomic_notifier_call_chain+0x86/0x130 [ 1164.077727][ C0] rtmsg_fib+0x131/0x4e0 [ 1164.077730][ C0] ? fib_dump_info+0x1550/0x1550 [ 1164.077731][ C0] ? ret_from_fork_asm+0x11/0x20 [ 1164.077735][ C0] fib_table_delete+0x514/0xa90 [ 1164.077737][ C0] ? find_held_lock+0x2b/0x80 [ 1164.077738][ C0] ? fib_table_lookup+0x18f0/0x18f0 [ 1164.077740][ C0] ? lockdep_rtnl_is_held+0x1a/0x20 [ 1164.077742][ C0] ? fib_get_table+0xd7/0x180 [ 1164.077744][ C0] fib_magic+0x304/0x4e0 [ 1164.077746][ C0] ? fib_new_table+0x330/0x330 [ 1164.077750][ C0] fib_del_ifaddr+0x620/0x1160 [ 1164.077752][ C0] ? lock_acquire+0x134/0x160 [ 1164.077753][ C0] fib_inetaddr_event+0xa9/0x270 [ 1164.077755][ C0] notifier_call_chain+0xb0/0x320 [ 1164.077757][ C0] blocking_notifier_call_chain+0x6d/0xb0 [ 1164.077759][ C0] __inet_del_ifa+0x3a9/0xe20 [ 1164.077761][ C0] ? lockdep_rtnl_is_held+0x1a/0x20 [ 1164.077763][ C0] inetdev_event+0x297/0xf90 [ 1164.077764][ C0] ? mutex_is_locked+0x1c/0x50 [ 1164.077767][ C0] notifier_call_chain+0xb0/0x320 [ 1164.077769][ C0] unregister_netdevice_many_notify+0xc4b/0x1b30 [ 1164.077772][ C0] ? unregister_netdevice_queued+0x80/0x80 [ 1164.077774][ C0] ? mutex_is_locked+0x1c/0x50 [ 1164.077775][ C0] ? rtnl_is_locked+0x15/0x20 [ 1164.077777][ C0] ? unregister_netdevice_queue+0x6a/0x470 [ 1164.077780][ C0] default_device_exit_batch+0x38b/0x600 [ 1164.077782][ C0] ? unregister_netdev+0x60/0x60 [ 1164.077785][ C0] ? perf_trace_sched_switch+0x7d0/0x7d0 [ 1164.077787][ C0] ? fou_exit_net+0x30/0x110 [ 1164.077791][ C0] ops_undo_list+0x2ce/0x8f0 [ 1164.077793][ C0] ? lockdep_hardirqs_on+0x8c/0x130 [ 1164.077794][ C0] ? netns_install+0x2a0/0x2a0 [ 1164.077795][ C0] ? __lock_release.isra.0+0x6b/0x1a0 [ 1164.077797][ C0] ? idr_destroy+0x121/0x250 [ 1164.077800][ C0] cleanup_net+0x431/0x940 [ 1164.077802][ C0] ? net_passive_dec+0x1c0/0x1c0 [ 1164.077803][ C0] ? process_one_work+0xdb7/0x1410 [ 1164.077805][ C0] ? lock_acquire+0x134/0x160 [ 1164.077806][ C0] ? rcu_is_watching+0x15/0xd0 [ 1164.077808][ C0] process_one_work+0xdf8/0x1410 [ 1164.077811][ C0] ? pwq_dec_nr_in_flight+0x710/0x710 [ 1164.077813][ C0] ? lock_acquire.part.0+0xbc/0x260 [ 1164.077815][ C0] worker_thread+0x4f1/0xd60 [ 1164.077818][ C0] ? rescuer_thread+0x1320/0x1320 [ 1164.077820][ C0] ? __kthread_parkme+0xbd/0x210 [ 1164.077822][ C0] ? rescuer_thread+0x1320/0x1320 [ 1164.077823][ C0] kthread+0x367/0x460 [ 1164.077825][ C0] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 1164.077828][ C0] ? kthread_affine_node+0x330/0x330 [ 1164.077830][ C0] ret_from_fork+0x474/0x6b0 [ 1164.077833][ C0] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1164.077835][ C0] ? __switch_to+0x5a3/0xe00 [ 1164.077837][ C0] ? kthread_affine_node+0x330/0x330 [ 1164.077839][ C0] ret_from_fork_asm+0x11/0x20 [ 1164.077842][ C0] [ 1228.732941][T25998] veth2: entered promiscuous mode [ 1230.746468][T25998] veth2: left promiscuous mode [ 1230.820409][T26001] veth2: entered promiscuous mode [ 1230.833157][T26001] veth2: left promiscuous mode [ 1230.907286][T26004] veth2: entered promiscuous mode [ 1230.920965][T26004] veth2: left promiscuous mode [ 1230.990190][T26007] veth2: entered promiscuous mode [ 1231.000864][T26007] veth2: left promiscuous mode [ 1231.074220][T26010] veth2: entered promiscuous mode [ 1231.083939][T26010] veth2: left promiscuous mode [ 1231.504407][T26046] veth2: entered promiscuous mode [ 1231.513555][T26046] veth2: left promiscuous mode [ 1281.776668][T29981] veth2: entered promiscuous mode [ 1281.787628][T29981] veth2: left promiscuous mode [ 1282.905344][T29993] veth2: entered promiscuous mode [ 1282.914537][T29993] veth2: left promiscuous mode [ 1284.078859][T30007] veth2: entered promiscuous mode [ 1284.094578][T30007] veth2: left promiscuous mode [ 1284.765431][T30052] veth2: entered promiscuous mode [ 1284.773796][T30052] veth2: left promiscuous mode [ 1287.837195][T30055] veth2: entered promiscuous mode [ 1287.845488][T30055] veth2: left promiscuous mode [ 1290.907770][T30058] veth2: entered promiscuous mode [ 1290.918543][T30058] veth2: left promiscuous mode