[ 10.700670][ T249] gre: GRE over IPv4 demultiplexer driver [ 10.708122][ T249] ip_gre: GRE over IPv4 tunneling driver [ 10.949734][ T259] GACT probability NOT on [ 11.033537][ T261] ip6_gre: GRE over IPv6 tunneling driver [ 11.082393][ T10] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 11.136994][ T10] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 11.457232][ T276] br1: port 1(veth1) entered blocking state [ 11.457545][ T276] br1: port 1(veth1) entered disabled state [ 11.457886][ T276] veth1: entered allmulticast mode [ 11.460087][ T276] veth1: entered promiscuous mode [ 11.496710][ T38] br1: port 1(veth1) entered blocking state [ 11.497131][ T38] br1: port 1(veth1) entered forwarding state [ 11.534486][ T278] br1: port 2(veth2) entered blocking state [ 11.534820][ T278] br1: port 2(veth2) entered disabled state [ 11.535798][ T278] veth2: entered allmulticast mode [ 11.539834][ T278] veth2: entered promiscuous mode [ 11.573238][ T38] br1: port 2(veth2) entered blocking state [ 11.573435][ T38] br1: port 2(veth2) entered forwarding state [ 11.745981][ T10] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 11.928223][ T10] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 12.120149][ T12] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 12.439965][ T12] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 12.759950][ T10] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 13.145024][ T12] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 13.145409][ T12] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 13.975975][ T70] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.177313][ C3] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 17.278026][ T322] Mirror/redirect action on [ 22.728894][ C3] [ 22.728982][ C3] ================================ [ 22.729080][ C3] WARNING: inconsistent lock state [ 22.729167][ C3] 7.1.0-rc5-virtme #1 Not tainted [ 22.729256][ C3] -------------------------------- [ 22.729345][ C3] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 22.729451][ C3] mirror_gre_chan/171 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 22.729563][ C3] ffffffffc08a47b8 (mirred_list_lock){+.?.}-{3:3}, at: tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 22.729743][ C3] {SOFTIRQ-ON-W} state was registered at: [ 22.729830][ C3] __lock_acquire+0x378/0xc10 [ 22.729923][ C3] lock_acquire.part.0+0xbc/0x260 [ 22.730007][ C3] _raw_spin_lock+0x33/0x40 [ 22.730094][ C3] tcf_mirred_init+0x844/0xd70 [act_mirred] [ 22.730199][ C3] tcf_action_init_1+0x428/0x6b0 [ 22.730285][ C3] tcf_action_init+0x3cf/0x890 [ 22.730369][ C3] tcf_exts_validate_ex+0x411/0x670 [ 22.730457][ C3] fl_change+0xed4/0x4e77 [cls_flower] [ 22.730547][ C3] tc_new_tfilter+0x875/0x21e0 [ 22.730634][ C3] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 22.730722][ C3] netlink_rcv_skb+0x14e/0x3a0 [ 22.730808][ C3] netlink_unicast+0x486/0x750 [ 22.730892][ C3] netlink_sendmsg+0x735/0xc60 [ 22.730977][ C3] ____sys_sendmsg+0x419/0x850 [ 22.731060][ C3] ___sys_sendmsg+0x14e/0x1d0 [ 22.731147][ C3] __sys_sendmsg+0x145/0x1f0 [ 22.731231][ C3] do_syscall_64+0x117/0x590 [ 22.731315][ C3] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 22.731421][ C3] irq event stamp: 270648 [ 22.731484][ C3] hardirqs last enabled at (270648): [] _raw_spin_unlock_irqrestore+0x53/0x80 [ 22.731661][ C3] hardirqs last disabled at (270647): [] _raw_spin_lock_irqsave+0x50/0x60 [ 22.731837][ C3] softirqs last enabled at (267076): [] handle_softirqs+0x611/0x940 [ 22.731986][ C3] softirqs last disabled at (270555): [] __irq_exit_rcu+0x103/0x1c0 [ 22.732134][ C3] [ 22.732134][ C3] other info that might help us debug this: [ 22.732259][ C3] Possible unsafe locking scenario: [ 22.732259][ C3] [ 22.732388][ C3] CPU0 [ 22.732470][ C3] ---- [ 22.732544][ C3] lock(mirred_list_lock); [ 22.732632][ C3] [ 22.732710][ C3] lock(mirred_list_lock); [ 22.732799][ C3] [ 22.732799][ C3] *** DEADLOCK *** [ 22.732799][ C3] [ 22.732925][ C3] 2 locks held by mirror_gre_chan/171: [ 22.733011][ C3] #0: ffffffffb11905f8 (remove_cache_srcu){.+.+}-{0:0}, at: kasan_quarantine_reduce+0x84/0x240 [ 22.733188][ C3] #1: ffffffffb0f77c00 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x389/0x1020 [ 22.733339][ C3] [ 22.733339][ C3] stack backtrace: [ 22.733445][ C3] CPU: 3 UID: 0 PID: 171 Comm: mirror_gre_chan Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 22.733447][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 22.733449][ C3] Call Trace: [ 22.733451][ C3] [ 22.733452][ C3] dump_stack_lvl+0x6f/0xa0 [ 22.733457][ C3] print_usage_bug.part.0.cold+0xa9/0xb7 [ 22.733460][ C3] ? filter_irq_stacks+0xd0/0xd0 [ 22.733463][ C3] mark_lock_irq+0x4e3/0x9c0 [ 22.733464][ C3] ? sysvec_apic_timer_interrupt+0x9d/0xe0 [ 22.733466][ C3] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 22.733469][ C3] ? save_trace+0x68/0x280 [ 22.733470][ C3] ? __noinstr_text_start+0xce0/0xce0 [ 22.733472][ C3] mark_lock+0x1d7/0xa00 [ 22.733474][ C3] mark_usage+0x42/0x170 [ 22.733475][ C3] __lock_acquire+0x378/0xc10 [ 22.733477][ C3] ? mark_held_locks+0x40/0x70 [ 22.733478][ C3] ? rcu_do_batch+0x2b4/0x1020 [ 22.733480][ C3] lock_acquire.part.0+0xbc/0x260 [ 22.733482][ C3] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 22.733484][ C3] ? rcu_is_watching+0x15/0xd0 [ 22.733486][ C3] ? lock_acquire+0x134/0x160 [ 22.733487][ C3] _raw_spin_lock+0x33/0x40 [ 22.733489][ C3] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 22.733490][ C3] tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 22.733492][ C3] tcf_action_rcu_free+0x74/0x1a0 [ 22.733494][ C3] ? rcu_do_batch+0x2b4/0x1020 [ 22.733495][ C3] rcu_do_batch+0x2b6/0x1020 [ 22.733498][ C3] ? trace_rcu_batch_end+0x330/0x330 [ 22.733500][ C3] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 22.733501][ C3] ? lockdep_hardirqs_on+0x8c/0x130 [ 22.733503][ C3] ? _raw_spin_unlock_irqrestore+0x53/0x80 [ 22.733504][ C3] ? _raw_spin_unlock_irqrestore+0x40/0x80 [ 22.733506][ C3] rcu_core+0x2bf/0x640 [ 22.733508][ C3] handle_softirqs+0x1d8/0x940 [ 22.733510][ C3] ? find_held_lock+0x2b/0x80 [ 22.733518][ C3] ? __lock_release.isra.0+0x6b/0x1a0 [ 22.733519][ C3] ? _local_bh_enable+0xd0/0xd0 [ 22.733521][ C3] __irq_exit_rcu+0x103/0x1c0 [ 22.733523][ C3] irq_exit_rcu+0xe/0x30 [ 22.733524][ C3] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 22.733526][ C3] [ 22.733527][ C3] [ 22.733527][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 22.733529][ C3] RIP: 0010:qlist_free_all+0x3a/0x110 [ 22.733532][ C3] Code: ec 00 00 00 4c 89 6c 24 18 49 89 f5 4c 89 74 24 20 49 89 fe 48 89 6c 24 08 4c 89 64 24 10 eb 34 48 63 85 b8 00 00 00 4c 8b 23 <48> 89 ef 48 29 c3 48 89 de e8 28 ef ff ff 66 90 48 89 de 48 89 ef [ 22.733533][ C3] RSP: 0018:ffa0000000857a40 EFLAGS: 00000246 [ 22.733536][ C3] RAX: 0000000000000000 RBX: ff110000027c8d70 RCX: ffffffffffffffff [ 22.733537][ C3] RDX: ffd400000009f200 RSI: 00000000027c8d70 RDI: ff110000027c8d70 [ 22.733538][ C3] RBP: ff1100000103fe40 R08: 0000000000000000 R09: 0000000000000000 [ 22.733539][ C3] R10: 0000000000000003 R11: 0000000000000001 R12: ff11000008fb0be8 [ 22.733540][ C3] R13: 0000000000000000 R14: ffa0000000857a70 R15: 0000000000000000 [ 22.733542][ C3] kasan_quarantine_reduce+0x196/0x240 [ 22.733544][ C3] __kasan_slab_alloc+0x4b/0x70 [ 22.733546][ C3] kmem_cache_alloc_node_noprof+0x224/0x640 [ 22.733550][ C3] dup_task_struct+0x2e/0x5e0 [ 22.733552][ C3] ? lockdep_hardirqs_on+0x8c/0x130 [ 22.733554][ C3] copy_process+0x3bd/0x58e0 [ 22.733555][ C3] ? restore_fpregs_from_user+0x490/0x490 [ 22.733559][ C3] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 22.733561][ C3] ? rcu_read_lock_any_held+0x3c/0x90 [ 22.733562][ C3] ? validate_chain+0x38b/0xc20 [ 22.733564][ C3] ? pidfd_prepare+0x160/0x160 [ 22.733566][ C3] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 22.733567][ C3] ? rcu_lockdep_current_cpu_online+0x39/0x1b0 [ 22.733569][ C3] ? rcu_read_lock_any_held+0x3c/0x90 [ 22.733570][ C3] kernel_clone+0x1a4/0x6e0 [ 22.733572][ C3] ? create_io_thread+0x130/0x130 [ 22.733574][ C3] ? __might_fault+0x97/0x140 [ 22.733576][ C3] ? find_held_lock+0x2b/0x80 [ 22.733579][ C3] __do_sys_clone+0xe3/0x130 [ 22.733580][ C3] ? kernel_clone+0x6e0/0x6e0 [ 22.733583][ C3] ? rcu_is_watching+0x15/0xd0 [ 22.733585][ C3] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 22.733588][ C3] do_syscall_64+0x117/0x590 [ 22.733589][ C3] ? trace_hardirqs_off+0xd/0x30 [ 22.733591][ C3] ? exc_page_fault+0xee/0x100 [ 22.733592][ C3] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 22.733594][ C3] RIP: 0033:0x7feddd846226 [ 22.733596][ C3] Code: 7d e0 e8 7d a4 f5 ff 45 31 c0 31 d2 31 f6 64 48 8b 04 25 10 00 00 00 bf 11 00 20 01 4c 8d 90 d0 02 00 00 b8 38 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 5a 89 c3 85 c0 75 2f 64 48 8b 04 25 10 00 00 [ 22.733597][ C3] RSP: 002b:00007fff3429f8f0 EFLAGS: 00000246 ORIG_RAX: 0000000000000038 [ 22.733598][ C3] RAX: ffffffffffffffda RBX: 0000000000000001 RCX: 00007feddd846226 [ 22.733599][ C3] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000001200011 [ 22.733600][ C3] RBP: 00007fff3429f910 R08: 0000000000000000 R09: 0000000000000040 [ 22.733601][ C3] R10: 00007feddd783e50 R11: 0000000000000246 R12: 00005561b6451d20 [ 22.733601][ C3] R13: 00005561b644d600 R14: 0000000000000000 R15: 00000000ffffffff [ 22.733604][ C3] [ 24.920034][ C3] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 28.161141][ C2] tc mirred to Houston: device gt4 is down [ 28.261744][ C2] tc mirred to Houston: device gt4 is down [ 28.362336][ C2] tc mirred to Houston: device gt4 is down [ 28.462814][ C2] tc mirred to Houston: device gt4 is down [ 28.563259][ C2] tc mirred to Houston: device gt4 is down [ 28.663688][ C2] tc mirred to Houston: device gt4 is down [ 28.764114][ C2] tc mirred to Houston: device gt4 is down [ 28.864549][ C2] tc mirred to Houston: device gt4 is down [ 28.965057][ C2] tc mirred to Houston: device gt4 is down [ 29.065497][ C2] tc mirred to Houston: device gt4 is down [ 34.756138][ C3] net_ratelimit: 10 callbacks suppressed [ 34.756146][ C3] tc mirred to Houston: device gt6 is down [ 34.856708][ C3] tc mirred to Houston: device gt6 is down [ 34.957219][ C3] tc mirred to Houston: device gt6 is down [ 35.057588][ C3] tc mirred to Houston: device gt6 is down [ 35.157924][ C3] tc mirred to Houston: device gt6 is down [ 35.258296][ C3] tc mirred to Houston: device gt6 is down [ 35.358657][ C3] tc mirred to Houston: device gt6 is down [ 35.459064][ C3] tc mirred to Houston: device gt6 is down [ 35.559416][ C3] tc mirred to Houston: device gt6 is down [ 35.659752][ C3] tc mirred to Houston: device gt6 is down [ 40.792931][ C3] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 44.056939][ C1] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 53.014205][ C3] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 53.114789][ C3] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 53.215467][ C3] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 53.316026][ C3] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 53.416579][ C3] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 53.517128][ C3] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 53.617637][ C3] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 53.718178][ C3] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 53.818717][ C3] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 53.919264][ C3] ip6_tunnel: gt6 xmit: Local address not yet configured! [ 73.048975][ C3] ip6_tnl_xmit_ctl: 10 callbacks suppressed [ 73.048986][ C3] ip6_tunnel: h3-gt6 xmit: Local address not yet configured! [ 81.211147][ C3] tc mirred: target device is gone [ 117.892685][ T986] br1: port 1(veth1) entered disabled state [ 117.914436][ T987] br1: port 2(veth2) entered disabled state [ 117.932038][ T988] veth2: left allmulticast mode [ 117.932179][ T988] veth2: left promiscuous mode [ 117.932399][ T988] br1: port 2(veth2) entered disabled state [ 117.933112][ T988] veth1: left allmulticast mode [ 117.933235][ T988] veth1: left promiscuous mode [ 117.933437][ T988] br1: port 1(veth1) entered disabled state