[ 1178.063646][T31159] IPv6: Can't replace route, no match found [ 1179.100343][T31229] IPv6: Can't replace route, no match found [ 1201.996144][T32169] Mirror/redirect action on [ 1203.026775][ C1] [ 1203.026897][ C1] ================================ [ 1203.027045][ C1] WARNING: inconsistent lock state [ 1203.027179][ C1] 7.1.0-rc5-virtme #1 Not tainted [ 1203.027314][ C1] -------------------------------- [ 1203.027457][ C1] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 1203.027620][ C1] kworker/u16:0/12 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 1203.027794][ C1] ffffffffc03907b8 (mirred_list_lock){+.?.}-{3:3}, at: tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1203.028063][ C1] {SOFTIRQ-ON-W} state was registered at: [ 1203.028193][ C1] __lock_acquire+0x378/0xc10 [ 1203.028328][ C1] lock_acquire.part.0+0xbc/0x260 [ 1203.028472][ C1] _raw_spin_lock+0x33/0x40 [ 1203.028607][ C1] tcf_mirred_init+0x844/0xd70 [act_mirred] [ 1203.028771][ C1] tcf_action_init_1+0x428/0x6b0 [ 1203.028904][ C1] tcf_action_init+0x3cf/0x890 [ 1203.029043][ C1] tcf_exts_validate_ex+0x411/0x670 [ 1203.029176][ C1] tcf_exts_validate+0x14/0x20 [ 1203.029306][ C1] basic_change+0x362/0x1307 [cls_basic] [ 1203.029440][ C1] tc_new_tfilter+0x875/0x21e0 [ 1203.029571][ C1] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 1203.029704][ C1] netlink_rcv_skb+0x14e/0x3a0 [ 1203.029836][ C1] netlink_unicast+0x486/0x750 [ 1203.029967][ C1] netlink_sendmsg+0x735/0xc60 [ 1203.030098][ C1] ____sys_sendmsg+0x419/0x850 [ 1203.030229][ C1] ___sys_sendmsg+0x14e/0x1d0 [ 1203.030363][ C1] __sys_sendmsg+0x145/0x1f0 [ 1203.030496][ C1] do_syscall_64+0x117/0x590 [ 1203.030630][ C1] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1203.030796][ C1] irq event stamp: 5369852 [ 1203.030929][ C1] hardirqs last enabled at (5369852): [] _raw_spin_unlock_irqrestore+0x53/0x80 [ 1203.031196][ C1] hardirqs last disabled at (5369851): [] _raw_spin_lock_irqsave+0x50/0x60 [ 1203.031455][ C1] softirqs last enabled at (5369424): [] __alloc_skb+0x4c2/0x5f0 [ 1203.031669][ C1] softirqs last disabled at (5369801): [] __irq_exit_rcu+0x103/0x1c0 [ 1203.031900][ C1] [ 1203.031900][ C1] other info that might help us debug this: [ 1203.032103][ C1] Possible unsafe locking scenario: [ 1203.032103][ C1] [ 1203.032297][ C1] CPU0 [ 1203.032399][ C1] ---- [ 1203.032497][ C1] lock(mirred_list_lock); [ 1203.032632][ C1] [ 1203.032731][ C1] lock(mirred_list_lock); [ 1203.032862][ C1] [ 1203.032862][ C1] *** DEADLOCK *** [ 1203.032862][ C1] [ 1203.033055][ C1] 5 locks held by kworker/u16:0/12: [ 1203.033188][ C1] #0: ff110000019e9d40 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0xd55/0x1410 [ 1203.033463][ C1] #1: ffa00000000c7d10 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdb7/0x1410 [ 1203.033694][ C1] #2: ffffffffad898528 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbf/0x940 [ 1203.033930][ C1] #3: ffffffffad8b4300 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x9a/0x600 [ 1203.034197][ C1] #4: ffffffffad18bc80 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x389/0x1020 [ 1203.034434][ C1] [ 1203.034434][ C1] stack backtrace: [ 1203.034597][ C1] CPU: 1 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 1203.034601][ C1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1203.034604][ C1] Workqueue: netns cleanup_net [ 1203.034609][ C1] Call Trace: [ 1203.034611][ C1] [ 1203.034614][ C1] dump_stack_lvl+0x6f/0xa0 [ 1203.034620][ C1] print_usage_bug.part.0.cold+0xa9/0xb7 [ 1203.034624][ C1] ? filter_irq_stacks+0xd0/0xd0 [ 1203.034629][ C1] mark_lock_irq+0x4e3/0x9c0 [ 1203.034632][ C1] ? sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1203.034635][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1203.034638][ C1] ? save_trace+0x68/0x280 [ 1203.034640][ C1] ? net_alloc_generic+0x20/0x60 [ 1203.034643][ C1] mark_lock+0x1d7/0xa00 [ 1203.034646][ C1] mark_usage+0x42/0x170 [ 1203.034648][ C1] __lock_acquire+0x378/0xc10 [ 1203.034651][ C1] ? mark_held_locks+0x40/0x70 [ 1203.034653][ C1] ? rcu_do_batch+0x2b4/0x1020 [ 1203.034657][ C1] lock_acquire.part.0+0xbc/0x260 [ 1203.034660][ C1] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1203.034663][ C1] ? rcu_is_watching+0x15/0xd0 [ 1203.034666][ C1] ? lock_acquire+0x134/0x160 [ 1203.034669][ C1] _raw_spin_lock+0x33/0x40 [ 1203.034672][ C1] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1203.034674][ C1] tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1203.034677][ C1] tcf_action_rcu_free+0x74/0x1a0 [ 1203.034680][ C1] ? rcu_do_batch+0x2b4/0x1020 [ 1203.034683][ C1] rcu_do_batch+0x2b6/0x1020 [ 1203.034687][ C1] ? trace_rcu_batch_end+0x330/0x330 [ 1203.034691][ C1] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 1203.034693][ C1] ? lockdep_hardirqs_on+0x8c/0x130 [ 1203.034695][ C1] ? _raw_spin_unlock_irqrestore+0x53/0x80 [ 1203.034697][ C1] ? _raw_spin_unlock_irqrestore+0x40/0x80 [ 1203.034700][ C1] rcu_core+0x2bf/0x640 [ 1203.034703][ C1] handle_softirqs+0x1d8/0x940 [ 1203.034706][ C1] ? find_held_lock+0x2b/0x80 [ 1203.034708][ C1] ? __lock_release.isra.0+0x6b/0x1a0 [ 1203.034711][ C1] ? _local_bh_enable+0xd0/0xd0 [ 1203.034714][ C1] __irq_exit_rcu+0x103/0x1c0 [ 1203.034717][ C1] irq_exit_rcu+0xe/0x30 [ 1203.034719][ C1] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 1203.034721][ C1] [ 1203.034722][ C1] [ 1203.034723][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1203.034726][ C1] RIP: 0010:preempt_schedule_irq+0x4c/0xa0 [ 1203.034730][ C1] Code: 00 00 fc ff df 53 65 48 8b 1d 10 d9 5f 02 48 c1 eb 03 48 01 c3 bf 01 00 00 00 e8 ff 42 92 fd e8 ca fc c6 fd fb bf 01 00 00 00 ef de ff ff 9c 58 fa f6 c4 02 75 22 bf 01 00 00 00 e8 3d b3 91 [ 1203.034732][ C1] RSP: 0018:ffa00000000c7750 EFLAGS: 00000286 [ 1203.034735][ C1] RAX: 000000000051efc5 RBX: ffe21c000035d8c8 RCX: ffffffffabd5c726 [ 1203.034737][ C1] RDX: ff11000001aec640 RSI: ffffffffac693d1a RDI: 0000000000000001 [ 1203.034738][ C1] RBP: ffa00000000c7798 R08: 0000000000000000 R09: 0000000000000000 [ 1203.034740][ C1] R10: 0000000000000001 R11: 0000000000000001 R12: 0000000000000000 [ 1203.034741][ C1] R13: ffa00000000c77a8 R14: 0000000000000000 R15: 0000000000000000 [ 1203.034744][ C1] ? preempt_schedule_irq+0x46/0xa0 [ 1203.034747][ C1] irqentry_exit+0x1de/0x710 [ 1203.034750][ C1] ? lockdep_hardirqs_off+0x91/0xf0 [ 1203.034752][ C1] ? sysvec_apic_timer_interrupt+0xaa/0xe0 [ 1203.034754][ C1] ? rcu_read_lock_any_held+0x3c/0x90 [ 1203.034757][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 1203.034759][ C1] RIP: 0010:lockdep_unregister_key+0x1a3/0x320 [ 1203.034761][ C1] Code: c6 05 80 87 33 06 00 e8 3b ef 60 02 65 ff 0d d4 ba c1 04 9c 58 f6 c4 02 0f 85 fa 00 00 00 41 f7 c4 00 02 00 00 74 01 fb 84 db <0f> 85 af 00 00 00 48 8b 6c 24 10 4c 8b 64 24 18 48 8b 5c 24 08 48 [ 1203.034763][ C1] RSP: 0018:ffa00000000c7850 EFLAGS: 00000202 [ 1203.034765][ C1] RAX: 0000000000000046 RBX: 0000000000000001 RCX: 0000000000000001 [ 1203.034766][ C1] RDX: 0000000000000000 RSI: ffffffffac6c6d05 RDI: ffffffffac0727c0 [ 1203.034768][ C1] RBP: ffffffffaf8b02e8 R08: 0000000000000001 R09: 0000000000006a1d [ 1203.034769][ C1] R10: 0000000000000001 R11: 0000000000000008 R12: 0000000000000213 [ 1203.034770][ C1] R13: 0000000000000007 R14: ff110000191bc000 R15: ff110000191bc000 [ 1203.034775][ C1] __qdisc_destroy+0x139/0x430 [ 1203.034779][ C1] dev_shutdown+0x176/0x370 [ 1203.034782][ C1] unregister_netdevice_many_notify+0x8c2/0x1b30 [ 1203.034786][ C1] ? unregister_netdevice_queued+0x80/0x80 [ 1203.034789][ C1] ? mutex_is_locked+0x1c/0x50 [ 1203.034792][ C1] ? rtnl_is_locked+0x15/0x20 [ 1203.034795][ C1] ? unregister_netdevice_queue+0x6a/0x470 [ 1203.034800][ C1] default_device_exit_batch+0x38b/0x600 [ 1203.034804][ C1] ? unregister_netdev+0x60/0x60 [ 1203.034807][ C1] ? perf_trace_sched_switch+0x7d0/0x7d0 [ 1203.034811][ C1] ? fou_exit_net+0x30/0x110 [ 1203.034816][ C1] ops_undo_list+0x2ce/0x8f0 [ 1203.034819][ C1] ? lockdep_hardirqs_on+0x8c/0x130 [ 1203.034821][ C1] ? netns_install+0x2a0/0x2a0 [ 1203.034823][ C1] ? __lock_release.isra.0+0x6b/0x1a0 [ 1203.034826][ C1] ? idr_destroy+0x121/0x250 [ 1203.034830][ C1] cleanup_net+0x431/0x940 [ 1203.034833][ C1] ? net_passive_dec+0x1c0/0x1c0 [ 1203.034835][ C1] ? process_one_work+0xdb7/0x1410 [ 1203.034839][ C1] ? lock_acquire+0x134/0x160 [ 1203.034841][ C1] ? rcu_is_watching+0x15/0xd0 [ 1203.034844][ C1] process_one_work+0xdf8/0x1410 [ 1203.034849][ C1] ? pwq_dec_nr_in_flight+0x710/0x710 [ 1203.034851][ C1] ? lock_acquire.part.0+0xbc/0x260 [ 1203.034856][ C1] worker_thread+0x4f1/0xd60 [ 1203.034861][ C1] ? rescuer_thread+0x1320/0x1320 [ 1203.034863][ C1] kthread+0x367/0x460 [ 1203.034866][ C1] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 1203.034871][ C1] ? kthread_affine_node+0x330/0x330 [ 1203.034874][ C1] ret_from_fork+0x474/0x6b0 [ 1203.034878][ C1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1203.034881][ C1] ? __switch_to+0x5a3/0xe00 [ 1203.034885][ C1] ? kthread_affine_node+0x330/0x330 [ 1203.034887][ C1] ret_from_fork_asm+0x11/0x20 [ 1203.034893][ C1] [ 1267.700738][ T355] veth2: entered promiscuous mode [ 1269.712947][ T355] veth2: left promiscuous mode [ 1269.780174][ T358] veth2: entered promiscuous mode [ 1269.791858][ T358] veth2: left promiscuous mode [ 1269.864606][ T361] veth2: entered promiscuous mode [ 1269.874195][ T361] veth2: left promiscuous mode [ 1269.950509][ T364] veth2: entered promiscuous mode [ 1269.960331][ T364] veth2: left promiscuous mode [ 1270.036360][ T367] veth2: entered promiscuous mode [ 1270.047046][ T367] veth2: left promiscuous mode [ 1270.451946][ T403] veth2: entered promiscuous mode [ 1270.463723][ T403] veth2: left promiscuous mode [ 1321.664792][ T4340] veth2: entered promiscuous mode [ 1321.674579][ T4340] veth2: left promiscuous mode [ 1322.795523][ T4352] veth2: entered promiscuous mode [ 1322.804401][ T4352] veth2: left promiscuous mode [ 1323.961901][ T4366] veth2: entered promiscuous mode [ 1323.973768][ T4366] veth2: left promiscuous mode [ 1324.648283][ T4411] veth2: entered promiscuous mode [ 1324.658678][ T4411] veth2: left promiscuous mode [ 1327.721037][ T4414] veth2: entered promiscuous mode [ 1327.729371][ T4414] veth2: left promiscuous mode [ 1330.792586][ T4417] veth2: entered promiscuous mode [ 1330.801276][ T4417] veth2: left promiscuous mode