[ 1148.470221][T27463] IPv6: Can't replace route, no match found [ 1149.484224][T27533] IPv6: Can't replace route, no match found [ 1156.486831][ C0] clocksource: Watchdog remote CPU 3 read timed out [ 1170.276448][T28471] Mirror/redirect action on [ 1171.210503][ C1] [ 1171.210583][ C1] ================================ [ 1171.210676][ C1] WARNING: inconsistent lock state [ 1171.210769][ C1] 7.1.0-rc5-virtme #1 Not tainted [ 1171.210872][ C1] -------------------------------- [ 1171.210961][ C1] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 1171.211076][ C1] kworker/u16:0/12 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 1171.211188][ C1] ffffffffc08497b8 (mirred_list_lock){+.?.}-{3:3}, at: tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1171.211378][ C1] {SOFTIRQ-ON-W} state was registered at: [ 1171.211472][ C1] __lock_acquire+0x378/0xc10 [ 1171.211569][ C1] lock_acquire.part.0+0xbc/0x260 [ 1171.211660][ C1] _raw_spin_lock+0x33/0x40 [ 1171.211753][ C1] tcf_mirred_init+0x844/0xd70 [act_mirred] [ 1171.211866][ C1] tcf_action_init_1+0x428/0x6b0 [ 1171.211956][ C1] tcf_action_init+0x3cf/0x890 [ 1171.212044][ C1] tcf_exts_validate_ex+0x411/0x670 [ 1171.212133][ C1] tcf_exts_validate+0x14/0x20 [ 1171.212222][ C1] basic_change+0x362/0x1307 [cls_basic] [ 1171.212312][ C1] tc_new_tfilter+0x875/0x21e0 [ 1171.212402][ C1] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 1171.212494][ C1] netlink_rcv_skb+0x14e/0x3a0 [ 1171.212586][ C1] netlink_unicast+0x486/0x750 [ 1171.212677][ C1] netlink_sendmsg+0x735/0xc60 [ 1171.212766][ C1] ____sys_sendmsg+0x419/0x850 [ 1171.212865][ C1] ___sys_sendmsg+0x14e/0x1d0 [ 1171.212954][ C1] __sys_sendmsg+0x145/0x1f0 [ 1171.213045][ C1] do_syscall_64+0x117/0x590 [ 1171.213137][ C1] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 1171.213249][ C1] irq event stamp: 3477306 [ 1171.213341][ C1] hardirqs last enabled at (3477306): [] _raw_spin_unlock_irqrestore+0x53/0x80 [ 1171.213520][ C1] hardirqs last disabled at (3477305): [] _raw_spin_lock_irqsave+0x50/0x60 [ 1171.213710][ C1] softirqs last enabled at (3476162): [] __alloc_skb+0x4c2/0x5f0 [ 1171.213876][ C1] softirqs last disabled at (3476163): [] do_softirq+0xa9/0xe0 [ 1171.214036][ C1] [ 1171.214036][ C1] other info that might help us debug this: [ 1171.214172][ C1] Possible unsafe locking scenario: [ 1171.214172][ C1] [ 1171.214304][ C1] CPU0 [ 1171.214374][ C1] ---- [ 1171.214441][ C1] lock(mirred_list_lock); [ 1171.214530][ C1] [ 1171.214597][ C1] lock(mirred_list_lock); [ 1171.214686][ C1] [ 1171.214686][ C1] *** DEADLOCK *** [ 1171.214686][ C1] [ 1171.214821][ C1] 6 locks held by kworker/u16:0/12: [ 1171.214911][ C1] #0: ff110000019e9d40 ((wq_completion)netns){+.+.}-{0:0}, at: process_one_work+0xd55/0x1410 [ 1171.215097][ C1] #1: ffa00000000c7d10 (net_cleanup_work){+.+.}-{0:0}, at: process_one_work+0xdb7/0x1410 [ 1171.215252][ C1] #2: ffffffffb3698528 (pernet_ops_rwsem){++++}-{4:4}, at: cleanup_net+0xbf/0x940 [ 1171.215416][ C1] #3: ffffffffb36b4300 (rtnl_mutex){+.+.}-{4:4}, at: default_device_exit_batch+0x9a/0x600 [ 1171.215607][ C1] #4: ffffffffb375dca8 ((inetaddr_chain).rwsem){++++}-{4:4}, at: blocking_notifier_call_chain+0x54/0xb0 [ 1171.215787][ C1] #5: ffffffffb2f8bc80 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x389/0x1020 [ 1171.215949][ C1] [ 1171.215949][ C1] stack backtrace: [ 1171.216061][ C1] CPU: 1 UID: 0 PID: 12 Comm: kworker/u16:0 Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 1171.216064][ C1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1171.216066][ C1] Workqueue: netns cleanup_net [ 1171.216069][ C1] Call Trace: [ 1171.216071][ C1] [ 1171.216072][ C1] dump_stack_lvl+0x6f/0xa0 [ 1171.216077][ C1] print_usage_bug.part.0.cold+0xa9/0xb7 [ 1171.216080][ C1] mark_lock_irq+0x4e3/0x9c0 [ 1171.216082][ C1] ? __alloc_skb+0x4eb/0x5f0 [ 1171.216084][ C1] ? save_trace+0x68/0x280 [ 1171.216085][ C1] ? __lock_acquire+0x508/0xc10 [ 1171.216087][ C1] ? netdev_compute_master_upper_features+0x280/0xdd0 [ 1171.216089][ C1] mark_lock+0x1d7/0xa00 [ 1171.216091][ C1] mark_usage+0x42/0x170 [ 1171.216093][ C1] __lock_acquire+0x378/0xc10 [ 1171.216094][ C1] ? mark_held_locks+0x40/0x70 [ 1171.216096][ C1] lock_acquire.part.0+0xbc/0x260 [ 1171.216098][ C1] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1171.216099][ C1] ? rcu_is_watching+0x15/0xd0 [ 1171.216101][ C1] ? lock_acquire+0x134/0x160 [ 1171.216103][ C1] _raw_spin_lock+0x33/0x40 [ 1171.216105][ C1] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1171.216106][ C1] tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 1171.216108][ C1] tcf_action_rcu_free+0x74/0x1a0 [ 1171.216109][ C1] ? rcu_do_batch+0x2b4/0x1020 [ 1171.216111][ C1] rcu_do_batch+0x2b6/0x1020 [ 1171.216113][ C1] ? trace_rcu_batch_end+0x330/0x330 [ 1171.216115][ C1] ? mark_held_locks+0x40/0x70 [ 1171.216117][ C1] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 1171.216118][ C1] ? lockdep_hardirqs_on+0x8c/0x130 [ 1171.216120][ C1] rcu_core+0x2bf/0x640 [ 1171.216121][ C1] handle_softirqs+0x1d8/0x940 [ 1171.216123][ C1] ? __lock_release.isra.0+0x6b/0x1a0 [ 1171.216125][ C1] ? _local_bh_enable+0xd0/0xd0 [ 1171.216126][ C1] ? rcu_is_watching+0x15/0xd0 [ 1171.216128][ C1] do_softirq+0xa9/0xe0 [ 1171.216130][ C1] [ 1171.216130][ C1] [ 1171.216131][ C1] __local_bh_enable_ip+0x113/0x140 [ 1171.216132][ C1] __alloc_skb+0x4eb/0x5f0 [ 1171.216134][ C1] ? __alloc_skb+0x4c2/0x5f0 [ 1171.216136][ C1] ? napi_skb_cache_get+0x7b0/0x7b0 [ 1171.216137][ C1] ? atomic_notifier_call_chain+0x86/0x130 [ 1171.216139][ C1] rtmsg_fib+0x131/0x4e0 [ 1171.216142][ C1] ? fib_dump_info+0x1550/0x1550 [ 1171.216144][ C1] fib_table_delete+0x514/0xa90 [ 1171.216147][ C1] ? find_held_lock+0x2b/0x80 [ 1171.216148][ C1] ? fib_table_lookup+0x18f0/0x18f0 [ 1171.216150][ C1] ? lockdep_rtnl_is_held+0x1a/0x20 [ 1171.216152][ C1] ? fib_get_table+0xd7/0x180 [ 1171.216155][ C1] fib_magic+0x304/0x4e0 [ 1171.216157][ C1] ? fib_new_table+0x330/0x330 [ 1171.216160][ C1] fib_del_ifaddr+0x9d5/0x1160 [ 1171.216162][ C1] ? lock_acquire+0x134/0x160 [ 1171.216164][ C1] fib_inetaddr_event+0xa9/0x270 [ 1171.216165][ C1] notifier_call_chain+0xb0/0x320 [ 1171.216167][ C1] blocking_notifier_call_chain+0x6d/0xb0 [ 1171.216169][ C1] __inet_del_ifa+0x3a9/0xe20 [ 1171.216171][ C1] ? lockdep_rtnl_is_held+0x1a/0x20 [ 1171.216173][ C1] inetdev_event+0x297/0xf90 [ 1171.216174][ C1] ? mutex_is_locked+0x1c/0x50 [ 1171.216177][ C1] notifier_call_chain+0xb0/0x320 [ 1171.216179][ C1] unregister_netdevice_many_notify+0xc4b/0x1b30 [ 1171.216182][ C1] ? unregister_netdevice_queued+0x80/0x80 [ 1171.216184][ C1] ? mutex_is_locked+0x1c/0x50 [ 1171.216185][ C1] ? rtnl_is_locked+0x15/0x20 [ 1171.216187][ C1] ? unregister_netdevice_queue+0x6a/0x470 [ 1171.216190][ C1] default_device_exit_batch+0x38b/0x600 [ 1171.216192][ C1] ? unregister_netdev+0x60/0x60 [ 1171.216194][ C1] ? perf_trace_sched_switch+0x7d0/0x7d0 [ 1171.216197][ C1] ? fou_exit_net+0x30/0x110 [ 1171.216200][ C1] ops_undo_list+0x2ce/0x8f0 [ 1171.216202][ C1] ? lockdep_hardirqs_on+0x8c/0x130 [ 1171.216203][ C1] ? netns_install+0x2a0/0x2a0 [ 1171.216204][ C1] ? __lock_release.isra.0+0x6b/0x1a0 [ 1171.216206][ C1] ? idr_destroy+0x121/0x250 [ 1171.216208][ C1] cleanup_net+0x431/0x940 [ 1171.216210][ C1] ? net_passive_dec+0x1c0/0x1c0 [ 1171.216211][ C1] ? process_one_work+0xdb7/0x1410 [ 1171.216213][ C1] ? lock_acquire+0x134/0x160 [ 1171.216214][ C1] ? rcu_is_watching+0x15/0xd0 [ 1171.216216][ C1] process_one_work+0xdf8/0x1410 [ 1171.216219][ C1] ? pwq_dec_nr_in_flight+0x710/0x710 [ 1171.216221][ C1] ? lock_acquire.part.0+0xbc/0x260 [ 1171.216223][ C1] worker_thread+0x4f1/0xd60 [ 1171.216226][ C1] ? rescuer_thread+0x1320/0x1320 [ 1171.216228][ C1] kthread+0x367/0x460 [ 1171.216230][ C1] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 1171.216233][ C1] ? kthread_affine_node+0x330/0x330 [ 1171.216234][ C1] ret_from_fork+0x474/0x6b0 [ 1171.216237][ C1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1171.216239][ C1] ? __switch_to+0x5a3/0xe00 [ 1171.216242][ C1] ? kthread_affine_node+0x330/0x330 [ 1171.216243][ C1] ret_from_fork_asm+0x11/0x20 [ 1171.216247][ C1] [ 1235.226144][T29127] veth2: entered promiscuous mode [ 1237.237960][T29127] veth2: left promiscuous mode [ 1237.313853][T29130] veth2: entered promiscuous mode [ 1237.326489][T29130] veth2: left promiscuous mode [ 1237.393905][T29133] veth2: entered promiscuous mode [ 1237.408631][T29133] veth2: left promiscuous mode [ 1237.480019][T29136] veth2: entered promiscuous mode [ 1237.490625][T29136] veth2: left promiscuous mode [ 1237.561918][T29139] veth2: entered promiscuous mode [ 1237.571575][T29139] veth2: left promiscuous mode [ 1237.984419][T29175] veth2: entered promiscuous mode [ 1237.998793][T29175] veth2: left promiscuous mode [ 1288.699944][ T643] veth2: entered promiscuous mode [ 1288.712577][ T643] veth2: left promiscuous mode [ 1289.833624][ T655] veth2: entered promiscuous mode [ 1289.845874][ T655] veth2: left promiscuous mode [ 1291.007965][ T669] veth2: entered promiscuous mode [ 1291.020271][ T669] veth2: left promiscuous mode [ 1291.662137][ T714] veth2: entered promiscuous mode [ 1291.674653][ T714] veth2: left promiscuous mode [ 1294.735605][ T717] veth2: entered promiscuous mode [ 1294.743340][ T717] veth2: left promiscuous mode [ 1297.798576][ T720] veth2: entered promiscuous mode [ 1297.807281][ T720] veth2: left promiscuous mode