[ 1083.858054][ T3496] IPv6: Can't replace route, no match found [ 1084.960740][ T3566] IPv6: Can't replace route, no match found [ 1105.732518][ T4506] Mirror/redirect action on [ 1106.659239][ C0] [ 1106.659325][ C0] ================================ [ 1106.659426][ C0] WARNING: inconsistent lock state [ 1106.659517][ C0] 7.1.0-rc5-virtme #1 Not tainted [ 1106.659615][ C0] -------------------------------- [ 1106.659710][ C0] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 1106.659828][ C0] kworker/u16:0/12 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 1106.659944][ C0] ffffffffc081f7b8 (mirred_list_lock){+.?.}-{3:3}, at: tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1106.660133][ C0] {SOFTIRQ-ON-W} state was registered at: [ 1106.660225][ C0] __lock_acquire+0x378/0xc10 [ 1106.660325][ C0] lock_acquire.part.0+0xbc/0x260 [ 1106.660418][ C0] _raw_spin_lock+0x33/0x40 [ 1106.660517][ C0] tcf_mirred_init+0x844/0xd70 [act_mirred] [ 1106.660635][ C0] tcf_action_init_1+0x428/0x6b0 [ 1106.660732][ C0] tcf_action_init+0x3cf/0x890 [ 1106.660826][ C0] tcf_exts_validate_ex+0x411/0x670 [ 1106.660920][ C0] tcf_exts_validate+0x14/0x20 [ 1106.661012][ C0] basic_change+0x362/0x1307 [cls_basic] [ 1106.661104][ C0] tc_new_tfilter+0x875/0x21e0 [ 1106.661196][ C0] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 1106.661289][ C0] netlink_rcv_skb+0x14e/0x3a0 [ 1106.661380][ C0] netlink_unicast+0x486/0x750 [ 1106.661473][ C0] netlink_sendmsg+0x735/0xc60 [ 1106.661565][ C0] ____sys_sendmsg+0x419/0x850 [ 1106.661661][ C0] ___sys_sendmsg+0x14e/0x1d0 [ 1106.661756][ C0] __sys_sendmsg+0x145/0x1f0 [ 1106.661848][ C0] do_syscall_64+0x117/0x590 [ 1106.661940][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1106.662059][ C0] irq event stamp: 18947276 [ 1106.662153][ C0] hardirqs last enabled at (18947276): [] _raw_spin_unlock_irqrestore+0x53/0x80 [ 1106.662343][ C0] hardirqs last disabled at (18947275): [] _raw_spin_lock_irqsave+0x50/0x60 [ 1106.662530][ C0] softirqs last enabled at (18945478): [] unregister_netdevice_many_notify+0xcfc/0x1b30 [ 1106.662739][ C0] softirqs last disabled at (18945987): [] __irq_exit_rcu+0x103/0x1c0 [ 1106.662899][ C0] [ 1106.662899][ C0] other info that might help us debug this: [ 1106.663037][ C0] Possible unsafe locking scenario: [ 1106.663037][ C0] [ 1106.663175][ C0] CPU0 [ 1106.663246][ C0] ---- [ 1106.663316][ C0] lock(mirred_list_lock); [ 1106.663408][ C0] [ 1106.663476][ C0] lock(mirred_list_lock); [ 1106.663568][ C0] [ 1106.663568][ C0] *** DEADLOCK *** [ 1106.663568][ C0] [ 1106.663707][ C0] 8 locks held by kworker/u16:0/12: [ 1106.663802][ C0] #0: ff110000019e9d40 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0xd55/0x1410 [ 1106.663989][ C0] #1: ffa00000000c7d10 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdb7/0x1410 [ 1106.664155][ C0] #2: ffffffffb9298528 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbf/0x940 [ 1106.664318][ C0] #3: ffffffffb92b4300 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x9a/0x600 [ 1106.664502][ C0] #4: ff110000019eb6a0 (&root->kernfs_supers_rwsem){++++}-{4:4}, at: kernfs_remove_by_name_ns+0x4c/0x100 [ 1106.664692][ C0] #5: ff110000019eb580 (&root->kernfs_rwsem){++++}-{4:4}, at: kernfs_remove_by_name_ns+0x54/0x100 [ 1106.664876][ C0] #6: ffffffffb8b8bda0 (rcu_read_lock){....}-{1:3}, at: unwind_next_frame+0x17e/0x1ea0 [ 1106.665041][ C0] #7: ffffffffb8b8bc80 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x389/0x1020 [ 1106.665204][ C0] [ 1106.665204][ C0] stack backtrace: [ 1106.665321][ C0] CPU: 0 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 1106.665324][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1106.665326][ C0] Workqueue: netns cleanup_net [ 1106.665329][ C0] Call Trace: [ 1106.665330][ C0] [ 1106.665332][ C0] dump_stack_lvl+0x6f/0xa0 [ 1106.665337][ C0] print_usage_bug.part.0.cold+0xa9/0xb7 [ 1106.665339][ C0] ? filter_irq_stacks+0xd0/0xd0 [ 1106.665343][ C0] mark_lock_irq+0x4e3/0x9c0 [ 1106.665344][ C0] ? sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1106.665346][ C0] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1106.665347][ C0] ? save_trace+0x68/0x280 [ 1106.665349][ C0] ? read_from_oldmem+0x90/0x150 [ 1106.665351][ C0] mark_lock+0x1d7/0xa00 [ 1106.665353][ C0] mark_usage+0x42/0x170 [ 1106.665354][ C0] __lock_acquire+0x378/0xc10 [ 1106.665356][ C0] ? mark_held_locks+0x40/0x70 [ 1106.665357][ C0] ? rcu_do_batch+0x2b4/0x1020 [ 1106.665359][ C0] lock_acquire.part.0+0xbc/0x260 [ 1106.665361][ C0] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1106.665363][ C0] ? rcu_is_watching+0x15/0xd0 [ 1106.665365][ C0] ? lock_acquire+0x134/0x160 [ 1106.665367][ C0] _raw_spin_lock+0x33/0x40 [ 1106.665368][ C0] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1106.665369][ C0] tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1106.665371][ C0] tcf_action_rcu_free+0x74/0x1a0 [ 1106.665372][ C0] ? rcu_do_batch+0x2b4/0x1020 [ 1106.665374][ C0] rcu_do_batch+0x2b6/0x1020 [ 1106.665377][ C0] ? trace_rcu_batch_end+0x330/0x330 [ 1106.665379][ C0] ? mark_held_locks+0x40/0x70 [ 1106.665380][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 1106.665381][ C0] ? lockdep_hardirqs_on+0x8c/0x130 [ 1106.665383][ C0] rcu_core+0x2bf/0x640 [ 1106.665384][ C0] handle_softirqs+0x1d8/0x940 [ 1106.665386][ C0] ? find_held_lock+0x2b/0x80 [ 1106.665388][ C0] ? __lock_release.isra.0+0x6b/0x1a0 [ 1106.665389][ C0] ? _local_bh_enable+0xd0/0xd0 [ 1106.665391][ C0] __irq_exit_rcu+0x103/0x1c0 [ 1106.665392][ C0] irq_exit_rcu+0xe/0x30 [ 1106.665394][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1106.665395][ C0] [ 1106.665396][ C0] [ 1106.665397][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1106.665398][ C0] RIP: 0010:lock_acquire.part.0+0xfa/0x260 [ 1106.665400][ C0] Code: ff 65 0f c1 05 f7 56 c1 04 83 f8 01 4c 8b 14 24 0f 85 30 01 00 00 9c 58 f6 c4 02 0f 85 4d 01 00 00 4d 85 d2 0f 85 16 01 00 00 <48> 8b 44 24 30 65 48 2b 05 69 10 c1 04 0f 85 43 01 00 00 48 83 c4 [ 1106.665402][ C0] RSP: 0018:ffa00000000c7108 EFLAGS: 00000206 [ 1106.665404][ C0] RAX: 0000000000000046 RBX: 0000000000000000 RCX: ffa56a8a55738f1b [ 1106.665405][ C0] RDX: 0000000000000001 RSI: ffffffffb807e08a RDI: ffffffffb7a727c0 [ 1106.665406][ C0] RBP: 0000000000000000 R08: 0000000000000001 R09: ff11000001aed220 [ 1106.665407][ C0] R10: 0000000000000200 R11: 0000000000000001 R12: ffffffffb8b8bda0 [ 1106.665408][ C0] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000002 [ 1106.665410][ C0] ? rcu_is_watching+0x15/0xd0 [ 1106.665412][ C0] ? lock_acquire+0x134/0x160 [ 1106.665413][ C0] unwind_next_frame+0x192/0x1ea0 [ 1106.665415][ C0] ? unwind_next_frame+0x17e/0x1ea0 [ 1106.665416][ C0] ? __unwind_start+0x35b/0x910 [ 1106.665417][ C0] ? unwind_next_frame+0x691/0x1ea0 [ 1106.665419][ C0] ? stack_access_ok+0x1e0/0x1e0 [ 1106.665421][ C0] ? get_stack_info_noinstr+0x1a/0x120 [ 1106.665423][ C0] __unwind_start+0x432/0x910 [ 1106.665424][ C0] ? write_profile+0xf0/0xf0 [ 1106.665426][ C0] arch_stack_walk+0xb3/0x130 [ 1106.665430][ C0] ? __unwind_start+0x35b/0x910 [ 1106.665432][ C0] stack_trace_save+0x93/0xc0 [ 1106.665434][ C0] ? filter_irq_stacks+0xd0/0xd0 [ 1106.665436][ C0] ? validate_chain+0x38b/0xc20 [ 1106.665438][ C0] kasan_save_stack+0x2f/0x50 [ 1106.665444][ C0] kasan_record_aux_stack+0x9b/0xc0 [ 1106.665446][ C0] ? kernfs_vfs_xattr_set+0x80/0x80 [ 1106.665448][ C0] __call_rcu_common.constprop.0+0xb2/0xa10 [ 1106.665449][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 1106.665451][ C0] kernfs_put.part.0+0x1ce/0x590 [ 1106.665453][ C0] kernfs_remove_by_name_ns+0xe7/0x100 [ 1106.665455][ C0] remove_files+0x8d/0x1b0 [ 1106.665457][ C0] sysfs_remove_group+0x7c/0x170 [ 1106.665459][ C0] sysfs_remove_groups+0x67/0xc0 [ 1106.665461][ C0] device_remove_attrs+0x1e3/0x270 [ 1106.665464][ C0] ? device_remove_file+0x20/0x20 [ 1106.665467][ C0] ? kernfs_remove_by_name_ns+0xa0/0x100 [ 1106.665469][ C0] device_del+0x31c/0x8c0 [ 1106.665470][ C0] ? __device_link_del+0x500/0x500 [ 1106.665472][ C0] unregister_netdevice_many_notify+0xf94/0x1b30 [ 1106.665475][ C0] ? unregister_netdevice_queued+0x80/0x80 [ 1106.665477][ C0] ? mutex_is_locked+0x1c/0x50 [ 1106.665479][ C0] ? rtnl_is_locked+0x15/0x20 [ 1106.665481][ C0] ? unregister_netdevice_queue+0x6a/0x470 [ 1106.665484][ C0] default_device_exit_batch+0x38b/0x600 [ 1106.665486][ C0] ? unregister_netdev+0x60/0x60 [ 1106.665488][ C0] ? perf_trace_sched_switch+0x7d0/0x7d0 [ 1106.665491][ C0] ? fou_exit_net+0x30/0x110 [ 1106.665495][ C0] ops_undo_list+0x2ce/0x8f0 [ 1106.665497][ C0] ? lockdep_hardirqs_on+0x8c/0x130 [ 1106.665498][ C0] ? netns_install+0x2a0/0x2a0 [ 1106.665499][ C0] ? __lock_release.isra.0+0x6b/0x1a0 [ 1106.665501][ C0] ? idr_destroy+0x121/0x250 [ 1106.665503][ C0] cleanup_net+0x431/0x940 [ 1106.665505][ C0] ? net_passive_dec+0x1c0/0x1c0 [ 1106.665506][ C0] ? process_one_work+0xdb7/0x1410 [ 1106.665508][ C0] ? lock_acquire+0x134/0x160 [ 1106.665510][ C0] ? rcu_is_watching+0x15/0xd0 [ 1106.665512][ C0] process_one_work+0xdf8/0x1410 [ 1106.665514][ C0] ? pwq_dec_nr_in_flight+0x710/0x710 [ 1106.665516][ C0] ? lock_acquire.part.0+0xbc/0x260 [ 1106.665518][ C0] worker_thread+0x4f1/0xd60 [ 1106.665522][ C0] ? rescuer_thread+0x1320/0x1320 [ 1106.665523][ C0] kthread+0x367/0x460 [ 1106.665525][ C0] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 1106.665528][ C0] ? kthread_affine_node+0x330/0x330 [ 1106.665530][ C0] ret_from_fork+0x474/0x6b0 [ 1106.665532][ C0] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1106.665534][ C0] ? __switch_to+0x5a3/0xe00 [ 1106.665536][ C0] ? kthread_affine_node+0x330/0x330 [ 1106.665538][ C0] ret_from_fork_asm+0x11/0x20 [ 1106.665541][ C0] [ 1170.811020][ T5165] veth2: entered promiscuous mode [ 1172.821193][ T5165] veth2: left promiscuous mode [ 1172.894474][ T5168] veth2: entered promiscuous mode [ 1172.910086][ T5168] veth2: left promiscuous mode [ 1173.011736][ T5171] veth2: entered promiscuous mode [ 1173.027349][ T5171] veth2: left promiscuous mode [ 1173.101483][ T5174] veth2: entered promiscuous mode [ 1173.114087][ T5174] veth2: left promiscuous mode [ 1173.186337][ T5177] veth2: entered promiscuous mode [ 1173.202044][ T5177] veth2: left promiscuous mode [ 1173.609042][ T5213] veth2: entered promiscuous mode [ 1173.619281][ T5213] veth2: left promiscuous mode [ 1224.225727][ T9147] veth2: entered promiscuous mode [ 1224.235486][ T9147] veth2: left promiscuous mode [ 1225.354179][ T9159] veth2: entered promiscuous mode [ 1225.361254][ T9159] veth2: left promiscuous mode [ 1226.512099][ T9173] veth2: entered promiscuous mode [ 1226.525199][ T9173] veth2: left promiscuous mode [ 1227.190865][ T9218] veth2: entered promiscuous mode [ 1227.204773][ T9218] veth2: left promiscuous mode [ 1230.266237][ T9221] veth2: entered promiscuous mode [ 1230.279651][ T9221] veth2: left promiscuous mode [ 1233.336833][ T9224] veth2: entered promiscuous mode [ 1233.351527][ T9224] veth2: left promiscuous mode