[ 9.642169][ T194] ip (194) used greatest stack depth: 24304 bytes left [ 11.459596][ T294] modprobe (294) used greatest stack depth: 24112 bytes left [ 11.517811][ T300] br: port 1(veth1) entered blocking state [ 11.518076][ T300] br: port 1(veth1) entered disabled state [ 11.518294][ T300] veth1: entered allmulticast mode [ 11.520101][ T300] veth1: entered promiscuous mode [ 11.522229][ T90] br: port 1(veth1) entered blocking state [ 11.522456][ T90] br: port 1(veth1) entered forwarding state [ 11.565904][ T305] br: port 2(veth3) entered blocking state [ 11.566169][ T305] br: port 2(veth3) entered disabled state [ 11.566402][ T305] veth3: entered allmulticast mode [ 11.568785][ T305] veth3: entered promiscuous mode [ 11.570125][ T38] br: port 2(veth3) entered blocking state [ 11.570556][ T38] br: port 2(veth3) entered forwarding state [ 11.631504][ T310] br: port 3(veth4) entered blocking state [ 11.631715][ T310] br: port 3(veth4) entered disabled state [ 11.631976][ T310] veth4: entered allmulticast mode [ 11.633361][ T310] veth4: entered promiscuous mode [ 11.634529][ T190] br: port 3(veth4) entered blocking state [ 11.634710][ T190] br: port 3(veth4) entered forwarding state [ 89.337409][ T742] Mirror/redirect action on [ 102.587666][ C1] [ 102.587759][ C1] ================================ [ 102.587854][ C1] WARNING: inconsistent lock state [ 102.587947][ C1] 7.1.0-rc5-virtme #1 Not tainted [ 102.588040][ C1] -------------------------------- [ 102.588129][ C1] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 102.588238][ C1] kworker/1:1/50 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 102.588350][ C1] ffffffffc080d7b8 (mirred_list_lock){+.?.}-{3:3}, at: tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 102.588532][ C1] {SOFTIRQ-ON-W} state was registered at: [ 102.588621][ C1] __lock_acquire+0x378/0xc10 [ 102.588714][ C1] lock_acquire.part.0+0xbc/0x260 [ 102.588800][ C1] _raw_spin_lock+0x33/0x40 [ 102.588888][ C1] tcf_mirred_init+0x844/0xd70 [act_mirred] [ 102.588999][ C1] tcf_action_init_1+0x428/0x6b0 [ 102.589090][ C1] tcf_action_init+0x3cf/0x890 [ 102.589178][ C1] tcf_exts_validate_ex+0x411/0x670 [ 102.589265][ C1] mall_change+0x3cd/0xe9b [cls_matchall] [ 102.589378][ C1] tc_new_tfilter+0x875/0x21e0 [ 102.589465][ C1] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 102.589555][ C1] netlink_rcv_skb+0x14e/0x3a0 [ 102.589642][ C1] netlink_unicast+0x486/0x750 [ 102.589727][ C1] netlink_sendmsg+0x735/0xc60 [ 102.589812][ C1] ____sys_sendmsg+0x419/0x850 [ 102.589899][ C1] ___sys_sendmsg+0x14e/0x1d0 [ 102.589986][ C1] __sys_sendmsg+0x145/0x1f0 [ 102.590074][ C1] do_syscall_64+0x117/0x590 [ 102.590162][ C1] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 102.590343][ C1] irq event stamp: 1214124 [ 102.590433][ C1] hardirqs last enabled at (1214124): [] _raw_spin_unlock_irqrestore+0x53/0x80 [ 102.590653][ C1] hardirqs last disabled at (1214123): [] _raw_spin_lock_irqsave+0x50/0x60 [ 102.590824][ C1] softirqs last enabled at (1212056): [] handle_softirqs+0x611/0x940 [ 102.590977][ C1] softirqs last disabled at (1214047): [] __irq_exit_rcu+0x103/0x1c0 [ 102.591179][ C1] [ 102.591179][ C1] other info that might help us debug this: [ 102.591313][ C1] Possible unsafe locking scenario: [ 102.591313][ C1] [ 102.591500][ C1] CPU0 [ 102.591565][ C1] ---- [ 102.591629][ C1] lock(mirred_list_lock); [ 102.591716][ C1] [ 102.591786][ C1] lock(mirred_list_lock); [ 102.591921][ C1] [ 102.591921][ C1] *** DEADLOCK *** [ 102.591921][ C1] [ 102.592044][ C1] 3 locks held by kworker/1:1/50: [ 102.592129][ C1] #0: ff11000001139b40 ((wq_completion)events){+.+.}-{0:0}, at: process_one_work+0xd55/0x1410 [ 102.592362][ C1] #1: ffa000000036fd10 ((work_completion)(&fsvq->done_work)){+.+.}-{0:0}, at: process_one_work+0xdb7/0x1410 [ 102.592550][ C1] #2: ffffffffac977c00 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x389/0x1020 [ 102.592749][ C1] [ 102.592749][ C1] stack backtrace: [ 102.592856][ C1] CPU: 1 UID: 0 PID: 50 Comm: kworker/1:1 Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 102.592859][ C1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 102.592860][ C1] Workqueue: events virtio_fs_requests_done_work [ 102.592866][ C1] Call Trace: [ 102.592867][ C1] [ 102.592869][ C1] dump_stack_lvl+0x6f/0xa0 [ 102.592874][ C1] print_usage_bug.part.0.cold+0xa9/0xb7 [ 102.592877][ C1] ? filter_irq_stacks+0xd0/0xd0 [ 102.592880][ C1] mark_lock_irq+0x4e3/0x9c0 [ 102.592882][ C1] ? sysvec_apic_timer_interrupt+0x9d/0xe0 [ 102.592884][ C1] ? asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 102.592886][ C1] ? save_trace+0x68/0x280 [ 102.592889][ C1] mark_lock+0x1d7/0xa00 [ 102.592891][ C1] mark_usage+0x42/0x170 [ 102.592892][ C1] __lock_acquire+0x378/0xc10 [ 102.592893][ C1] ? mark_held_locks+0x40/0x70 [ 102.592895][ C1] ? rcu_do_batch+0x2b4/0x1020 [ 102.592897][ C1] lock_acquire.part.0+0xbc/0x260 [ 102.592899][ C1] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 102.592901][ C1] ? rcu_is_watching+0x15/0xd0 [ 102.592903][ C1] ? lock_acquire+0x134/0x160 [ 102.592904][ C1] _raw_spin_lock+0x33/0x40 [ 102.592906][ C1] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 102.592908][ C1] tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 102.592910][ C1] tcf_action_rcu_free+0x74/0x1a0 [ 102.592911][ C1] ? rcu_do_batch+0x2b4/0x1020 [ 102.592913][ C1] rcu_do_batch+0x2b6/0x1020 [ 102.592915][ C1] ? mark_held_locks+0x40/0x70 [ 102.592916][ C1] ? sched_balance_softirq+0x260/0x320 [ 102.592920][ C1] ? trace_rcu_batch_end+0x330/0x330 [ 102.592921][ C1] ? sched_balance_domains+0xcd0/0xcd0 [ 102.592923][ C1] ? mark_held_locks+0x40/0x70 [ 102.592925][ C1] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 102.592926][ C1] ? lockdep_hardirqs_on+0x8c/0x130 [ 102.592928][ C1] rcu_core+0x2bf/0x640 [ 102.592930][ C1] handle_softirqs+0x1d8/0x940 [ 102.592932][ C1] ? find_held_lock+0x2b/0x80 [ 102.592935][ C1] ? __lock_release.isra.0+0x6b/0x1a0 [ 102.592936][ C1] ? _local_bh_enable+0xd0/0xd0 [ 102.592938][ C1] __irq_exit_rcu+0x103/0x1c0 [ 102.592940][ C1] irq_exit_rcu+0xe/0x30 [ 102.592941][ C1] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 102.592943][ C1] [ 102.592944][ C1] [ 102.592944][ C1] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 102.592946][ C1] RIP: 0010:memset+0xf/0x20 [ 102.592949][ C1] Code: 44 89 54 17 fe eb 0c 48 83 fa 01 72 06 44 8a 1e 44 88 1f c3 0f 1f 80 00 00 00 00 f3 0f 1e fa 66 90 49 89 f9 40 88 f0 48 89 d1 aa 4c 89 c8 c3 66 66 2e 0f 1f 84 00 00 00 00 00 49 89 fa 40 0f [ 102.592951][ C1] RSP: 0018:ffa000000036fae8 EFLAGS: 00000286 [ 102.592953][ C1] RAX: 0000000000000000 RBX: dffffc0000000000 RCX: 00000000000003ff [ 102.592954][ C1] RDX: 0000000000000ff6 RSI: 0000000000000000 RDI: ff1100000bf57c00 [ 102.592955][ C1] RBP: 0000000000000009 R08: ffffffffaa2e1198 R09: ff1100000bf57009 [ 102.592956][ C1] R10: ffe21c00017eb000 R11: 0000000000000000 R12: ffd40000002fd5c0 [ 102.592957][ C1] R13: ffd40000002fd5c0 R14: ffd40000002fd5c0 R15: 0000000000000000 [ 102.592959][ C1] ? virtio_fs_request_complete+0x768/0xc10 [ 102.592961][ C1] virtio_fs_request_complete+0x768/0xc10 [ 102.592964][ C1] virtio_fs_requests_done_work+0x543/0x8f0 [ 102.592967][ C1] ? virtio_fs_complete_req_work+0x90/0x90 [ 102.592968][ C1] ? process_one_work+0xdb7/0x1410 [ 102.592970][ C1] ? lock_acquire+0x134/0x160 [ 102.592972][ C1] ? rcu_is_watching+0x15/0xd0 [ 102.592974][ C1] process_one_work+0xdf8/0x1410 [ 102.592976][ C1] ? pwq_dec_nr_in_flight+0x710/0x710 [ 102.592978][ C1] ? lock_acquire.part.0+0xbc/0x260 [ 102.592981][ C1] worker_thread+0x4f1/0xd60 [ 102.592983][ C1] ? rescuer_thread+0x1320/0x1320 [ 102.592985][ C1] ? __kthread_parkme+0xbd/0x210 [ 102.592987][ C1] ? rescuer_thread+0x1320/0x1320 [ 102.592989][ C1] kthread+0x367/0x460 [ 102.592990][ C1] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 102.592994][ C1] ? kthread_affine_node+0x330/0x330 [ 102.592995][ C1] ret_from_fork+0x474/0x6b0 [ 102.592998][ C1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 102.593000][ C1] ? __switch_to+0x5a3/0xe00 [ 102.593003][ C1] ? kthread_affine_node+0x330/0x330 [ 102.593005][ C1] ret_from_fork_asm+0x11/0x20 [ 102.593008][ C1] [ 118.411522][ T920] br: port 3(veth4) entered disabled state [ 118.411847][ T920] veth4: left allmulticast mode [ 118.411937][ T920] veth4: left promiscuous mode [ 118.412078][ T920] br: port 3(veth4) entered disabled state [ 118.434895][ T922] br: port 2(veth3) entered disabled state [ 118.435206][ T922] veth3: left allmulticast mode [ 118.435336][ T922] veth3: left promiscuous mode [ 118.435537][ T922] br: port 2(veth3) entered disabled state [ 118.454821][ T924] br: port 1(veth1) entered disabled state [ 118.455059][ T924] veth1: left allmulticast mode [ 118.455145][ T924] veth1: left promiscuous mode [ 118.455279][ T924] br: port 1(veth1) entered disabled state