[ 1167.118213][T24246] IPv6: Can't replace route, no match found [ 1168.166174][T24316] IPv6: Can't replace route, no match found [ 1189.795018][T25255] Mirror/redirect action on [ 1190.748204][ C3] [ 1190.748298][ C3] ================================ [ 1190.748403][ C3] WARNING: inconsistent lock state [ 1190.748498][ C3] 7.1.0-rc5-virtme #1 Not tainted [ 1190.748593][ C3] -------------------------------- [ 1190.748685][ C3] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 1190.748811][ C3] kworker/u16:1/69 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 1190.748927][ C3] ffffffffc04b07b8 (mirred_list_lock){+.?.}-{3:3}, at: tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1190.749117][ C3] {SOFTIRQ-ON-W} state was registered at: [ 1190.749210][ C3] __lock_acquire+0x378/0xc10 [ 1190.749309][ C3] lock_acquire.part.0+0xbc/0x260 [ 1190.749400][ C3] _raw_spin_lock+0x33/0x40 [ 1190.749493][ C3] tcf_mirred_init+0x844/0xd70 [act_mirred] [ 1190.749605][ C3] tcf_action_init_1+0x428/0x6b0 [ 1190.749729][ C3] tcf_action_init+0x3cf/0x890 [ 1190.749840][ C3] tcf_exts_validate_ex+0x411/0x670 [ 1190.749942][ C3] tcf_exts_validate+0x14/0x20 [ 1190.750041][ C3] basic_change+0x362/0x1307 [cls_basic] [ 1190.750140][ C3] tc_new_tfilter+0x875/0x21e0 [ 1190.750238][ C3] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 1190.750337][ C3] netlink_rcv_skb+0x14e/0x3a0 [ 1190.750439][ C3] netlink_unicast+0x486/0x750 [ 1190.750537][ C3] netlink_sendmsg+0x735/0xc60 [ 1190.750636][ C3] ____sys_sendmsg+0x419/0x850 [ 1190.750737][ C3] ___sys_sendmsg+0x14e/0x1d0 [ 1190.750839][ C3] __sys_sendmsg+0x145/0x1f0 [ 1190.750936][ C3] do_syscall_64+0x117/0x590 [ 1190.751039][ C3] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1190.751161][ C3] irq event stamp: 27892802 [ 1190.751259][ C3] hardirqs last enabled at (27892802): [] _raw_spin_unlock_irqrestore+0x53/0x80 [ 1190.751457][ C3] hardirqs last disabled at (27892801): [] _raw_spin_lock_irqsave+0x50/0x60 [ 1190.751649][ C3] softirqs last enabled at (27889210): [] handle_softirqs+0x611/0x940 [ 1190.751827][ C3] softirqs last disabled at (27891477): [] __irq_exit_rcu+0x103/0x1c0 [ 1190.752001][ C3] [ 1190.752001][ C3] other info that might help us debug this: [ 1190.752149][ C3] Possible unsafe locking scenario: [ 1190.752149][ C3] [ 1190.752296][ C3] CPU0 [ 1190.752370][ C3] ---- [ 1190.752444][ C3] lock(mirred_list_lock); [ 1190.752544][ C3] [ 1190.752618][ C3] lock(mirred_list_lock); [ 1190.752717][ C3] [ 1190.752717][ C3] *** DEADLOCK *** [ 1190.752717][ C3] [ 1190.752866][ C3] 7 locks held by kworker/u16:1/69: [ 1190.752967][ C3] #0: ff110000019e9d40 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0xd55/0x1410 [ 1190.753167][ C3] #1: ffa00000004a7d10 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdb7/0x1410 [ 1190.753340][ C3] #2: ffffffffbc098528 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbf/0x940 [ 1190.753515][ C3] #3: ffffffffbc0b4300 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x9a/0x600 [ 1190.753712][ C3] #4: ffffffffbc15dca8 ((inetaddr_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x54/0xb0 [ 1190.753901][ C3] #5: ffffffffbb98bda0 (rcu_read_lock){....}-{1:3}, at: unwind_next_frame+0x17e/0x1ea0 [ 1190.754057][ C3] #6: ffffffffbb98bc80 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x389/0x1020 [ 1190.754232][ C3] [ 1190.754232][ C3] stack backtrace: [ 1190.754350][ C3] CPU: 3 UID: 0 PID: 69 Comm: kworker/u16:1 Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 1190.754353][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1190.754355][ C3] Workqueue: netns cleanup_net [ 1190.754358][ C3] Call Trace: [ 1190.754360][ C3] [ 1190.754362][ C3] dump_stack_lvl+0x6f/0xa0 [ 1190.754368][ C3] print_usage_bug.part.0.cold+0xa9/0xb7 [ 1190.754371][ C3] ? filter_irq_stacks+0xd0/0xd0 [ 1190.754375][ C3] mark_lock_irq+0x4e3/0x9c0 [ 1190.754377][ C3] ? sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1190.754379][ C3] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1190.754381][ C3] ? save_trace+0x68/0x280 [ 1190.754382][ C3] ? __skb_to_sgvec+0x240/0xa30 [ 1190.754385][ C3] mark_lock+0x1d7/0xa00 [ 1190.754387][ C3] mark_usage+0x42/0x170 [ 1190.754388][ C3] __lock_acquire+0x378/0xc10 [ 1190.754390][ C3] ? mark_held_locks+0x40/0x70 [ 1190.754391][ C3] ? rcu_do_batch+0x2b4/0x1020 [ 1190.754394][ C3] lock_acquire.part.0+0xbc/0x260 [ 1190.754396][ C3] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1190.754398][ C3] ? rcu_is_watching+0x15/0xd0 [ 1190.754400][ C3] ? lock_acquire+0x134/0x160 [ 1190.754402][ C3] _raw_spin_lock+0x33/0x40 [ 1190.754403][ C3] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1190.754405][ C3] tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1190.754407][ C3] tcf_action_rcu_free+0x74/0x1a0 [ 1190.754408][ C3] ? rcu_do_batch+0x2b4/0x1020 [ 1190.754410][ C3] rcu_do_batch+0x2b6/0x1020 [ 1190.754413][ C3] ? trace_rcu_batch_end+0x330/0x330 [ 1190.754415][ C3] ? mark_held_locks+0x40/0x70 [ 1190.754416][ C3] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 1190.754418][ C3] ? lockdep_hardirqs_on+0x8c/0x130 [ 1190.754420][ C3] rcu_core+0x2bf/0x640 [ 1190.754421][ C3] handle_softirqs+0x1d8/0x940 [ 1190.754423][ C3] ? find_held_lock+0x2b/0x80 [ 1190.754426][ C3] ? __lock_release.isra.0+0x6b/0x1a0 [ 1190.754428][ C3] ? _local_bh_enable+0xd0/0xd0 [ 1190.754431][ C3] __irq_exit_rcu+0x103/0x1c0 [ 1190.754433][ C3] irq_exit_rcu+0xe/0x30 [ 1190.754434][ C3] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1190.754436][ C3] [ 1190.754436][ C3] [ 1190.754437][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1190.754439][ C3] RIP: 0010:__orc_find+0x9d/0x100 [ 1190.754441][ C3] Code: e1 07 83 c1 03 40 38 f9 7c 05 40 84 ff 75 30 48 63 0a 48 01 d1 49 39 ca 73 b0 4c 8d 4a fc 4d 39 c1 73 b3 49 29 f3 48 83 c4 30 <49> c1 fb 02 4b 8d 04 5b 48 8d 04 43 5b c3 31 c0 c3 48 89 f0 c3 48 [ 1190.754443][ C3] RSP: 0018:ffa00000004a6d88 EFLAGS: 00000286 [ 1190.754446][ C3] RAX: dffffc0000000000 RBX: ffffffffbc7c2116 RCX: ffffffffb9f6e8ca [ 1190.754448][ C3] RDX: ffffffffbc4e06a0 RSI: ffffffffbc4e06a0 RDI: 0000000000000000 [ 1190.754449][ C3] RBP: 0000000000000001 R08: ffffffffbc4e06a4 R09: ffffffffbc4e06a0 [ 1190.754451][ C3] R10: ffffffffb9f6e9d0 R11: 0000000000000000 R12: ffa00000004a6ef0 [ 1190.754453][ C3] R13: ffa00000004a6e98 R14: ff11000008fec640 R15: 0000000000000000 [ 1190.754454][ C3] ? rtmsg_fib+0x130/0x4e0 [ 1190.754457][ C3] ? rtmsg_fib+0x2a/0x4e0 [ 1190.754459][ C3] unwind_next_frame+0x272/0x1ea0 [ 1190.754461][ C3] ? rtmsg_fib+0x131/0x4e0 [ 1190.754462][ C3] ? stack_access_ok+0x1e0/0x1e0 [ 1190.754464][ C3] ? __unwind_start+0x432/0x910 [ 1190.754466][ C3] ? write_profile+0xf0/0xf0 [ 1190.754468][ C3] arch_stack_walk+0xd7/0x130 [ 1190.754472][ C3] ? rtmsg_fib+0x131/0x4e0 [ 1190.754474][ C3] stack_trace_save+0x93/0xc0 [ 1190.754476][ C3] ? filter_irq_stacks+0xd0/0xd0 [ 1190.754478][ C3] ? __unwind_start+0x432/0x910 [ 1190.754479][ C3] ? cleanup_net+0x431/0x940 [ 1190.754481][ C3] ? write_profile+0xf0/0xf0 [ 1190.754483][ C3] ? __kernel_text_address+0x12/0x30 [ 1190.754484][ C3] ? write_profile+0xf0/0xf0 [ 1190.754486][ C3] kasan_save_stack+0x2f/0x50 [ 1190.754489][ C3] ? kasan_save_stack+0x2f/0x50 [ 1190.754490][ C3] ? kasan_save_track+0x14/0x30 [ 1190.754491][ C3] ? __kasan_slab_alloc+0x60/0x70 [ 1190.754493][ C3] ? kmem_cache_alloc_node_noprof+0x224/0x640 [ 1190.754495][ C3] ? kmalloc_reserve+0x103/0x2d0 [ 1190.754496][ C3] ? __alloc_skb+0x11e/0x5f0 [ 1190.754498][ C3] ? rtmsg_fib+0x131/0x4e0 [ 1190.754503][ C3] kasan_save_track+0x14/0x30 [ 1190.754504][ C3] __kasan_slab_alloc+0x60/0x70 [ 1190.754506][ C3] kmem_cache_alloc_node_noprof+0x224/0x640 [ 1190.754508][ C3] kmalloc_reserve+0x103/0x2d0 [ 1190.754510][ C3] __alloc_skb+0x11e/0x5f0 [ 1190.754511][ C3] ? __alloc_skb+0x4c2/0x5f0 [ 1190.754513][ C3] ? napi_skb_cache_get+0x7b0/0x7b0 [ 1190.754515][ C3] ? atomic_notifier_call_chain+0x86/0x130 [ 1190.754517][ C3] rtmsg_fib+0x131/0x4e0 [ 1190.754519][ C3] ? fib_dump_info+0x1550/0x1550 [ 1190.754520][ C3] ? ret_from_fork_asm+0x11/0x20 [ 1190.754523][ C3] fib_table_delete+0x514/0xa90 [ 1190.754526][ C3] ? find_held_lock+0x2b/0x80 [ 1190.754527][ C3] ? fib_table_lookup+0x18f0/0x18f0 [ 1190.754529][ C3] ? lockdep_rtnl_is_held+0x1a/0x20 [ 1190.754531][ C3] ? fib_get_table+0xd7/0x180 [ 1190.754534][ C3] fib_magic+0x304/0x4e0 [ 1190.754536][ C3] ? fib_new_table+0x330/0x330 [ 1190.754540][ C3] fib_del_ifaddr+0x9d5/0x1160 [ 1190.754541][ C3] ? lock_acquire+0x134/0x160 [ 1190.754543][ C3] fib_inetaddr_event+0xa9/0x270 [ 1190.754545][ C3] notifier_call_chain+0xb0/0x320 [ 1190.754547][ C3] blocking_notifier_call_chain+0x6d/0xb0 [ 1190.754549][ C3] __inet_del_ifa+0x3a9/0xe20 [ 1190.754552][ C3] ? lockdep_rtnl_is_held+0x1a/0x20 [ 1190.754553][ C3] inetdev_event+0x297/0xf90 [ 1190.754555][ C3] ? mutex_is_locked+0x1c/0x50 [ 1190.754559][ C3] notifier_call_chain+0xb0/0x320 [ 1190.754562][ C3] unregister_netdevice_many_notify+0xc4b/0x1b30 [ 1190.754566][ C3] ? unregister_netdevice_queued+0x80/0x80 [ 1190.754567][ C3] ? mutex_is_locked+0x1c/0x50 [ 1190.754569][ C3] ? rtnl_is_locked+0x15/0x20 [ 1190.754571][ C3] ? unregister_netdevice_queue+0x6a/0x470 [ 1190.754575][ C3] default_device_exit_batch+0x38b/0x600 [ 1190.754578][ C3] ? unregister_netdev+0x60/0x60 [ 1190.754581][ C3] ? perf_trace_sched_switch+0x7d0/0x7d0 [ 1190.754584][ C3] ? fou_exit_net+0x30/0x110 [ 1190.754588][ C3] ops_undo_list+0x2ce/0x8f0 [ 1190.754590][ C3] ? lockdep_hardirqs_on+0x8c/0x130 [ 1190.754591][ C3] ? netns_install+0x2a0/0x2a0 [ 1190.754593][ C3] ? __lock_release.isra.0+0x6b/0x1a0 [ 1190.754594][ C3] ? idr_destroy+0x121/0x250 [ 1190.754597][ C3] cleanup_net+0x431/0x940 [ 1190.754599][ C3] ? net_passive_dec+0x1c0/0x1c0 [ 1190.754600][ C3] ? process_one_work+0xdb7/0x1410 [ 1190.754602][ C3] ? lock_acquire+0x134/0x160 [ 1190.754604][ C3] ? rcu_is_watching+0x15/0xd0 [ 1190.754606][ C3] process_one_work+0xdf8/0x1410 [ 1190.754608][ C3] ? pwq_dec_nr_in_flight+0x710/0x710 [ 1190.754610][ C3] ? lock_acquire.part.0+0xbc/0x260 [ 1190.754613][ C3] worker_thread+0x4f1/0xd60 [ 1190.754615][ C3] ? rescuer_thread+0x1320/0x1320 [ 1190.754617][ C3] ? __kthread_parkme+0xbd/0x210 [ 1190.754619][ C3] ? rescuer_thread+0x1320/0x1320 [ 1190.754621][ C3] kthread+0x367/0x460 [ 1190.754623][ C3] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 1190.754626][ C3] ? kthread_affine_node+0x330/0x330 [ 1190.754628][ C3] ret_from_fork+0x474/0x6b0 [ 1190.754630][ C3] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1190.754632][ C3] ? __switch_to+0x5a3/0xe00 [ 1190.754634][ C3] ? kthread_affine_node+0x330/0x330 [ 1190.754636][ C3] ret_from_fork_asm+0x11/0x20 [ 1190.754639][ C3] [ 1255.584845][T25912] veth2: entered promiscuous mode [ 1256.598604][T25912] veth2: left promiscuous mode [ 1256.678672][T25915] veth2: entered promiscuous mode [ 1256.696722][T25915] veth2: left promiscuous mode [ 1256.785281][T25918] veth2: entered promiscuous mode [ 1256.801328][T25918] veth2: left promiscuous mode [ 1256.890088][T25921] veth2: entered promiscuous mode [ 1256.906821][T25921] veth2: left promiscuous mode [ 1256.994543][T25924] veth2: entered promiscuous mode [ 1257.010689][T25924] veth2: left promiscuous mode [ 1257.489008][T25960] veth2: entered promiscuous mode [ 1257.500401][T25960] veth2: left promiscuous mode [ 1308.883806][T29895] veth2: entered promiscuous mode [ 1308.896342][T29895] veth2: left promiscuous mode [ 1310.025560][T29907] veth2: entered promiscuous mode [ 1310.044718][T29907] veth2: left promiscuous mode [ 1311.213278][T29921] veth2: entered promiscuous mode [ 1311.221214][T29921] veth2: left promiscuous mode [ 1311.905681][T29966] veth2: entered promiscuous mode [ 1311.915510][T29966] veth2: left promiscuous mode [ 1314.981127][T29969] veth2: entered promiscuous mode [ 1314.991157][T29969] veth2: left promiscuous mode [ 1318.055528][T29972] veth2: entered promiscuous mode [ 1318.069283][T29972] veth2: left promiscuous mode