[ 42.655006][ T865] GACT probability NOT on [ 45.133171][ T1112] Mirror/redirect action on [ 45.276081][ C1] [ 45.276156][ C1] ================================ [ 45.276239][ C1] WARNING: inconsistent lock state [ 45.276316][ C1] 7.1.0-rc5-virtme #1 Not tainted [ 45.276405][ C1] -------------------------------- [ 45.276488][ C1] inconsistent {SOFTIRQ-ON-W} -> {IN-SOFTIRQ-W} usage. [ 45.276584][ C1] ksoftirqd/1/23 [HC0[0]:SC1[1]:HE1:SE0] takes: [ 45.276682][ C1] ffffffffc057e7b8 (mirred_list_lock){+.?.}-{3:3}, at: tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 45.276844][ C1] {SOFTIRQ-ON-W} state was registered at: [ 45.276921][ C1] __lock_acquire+0x378/0xc10 [ 45.277012][ C1] lock_acquire.part.0+0xbc/0x260 [ 45.277089][ C1] _raw_spin_lock+0x33/0x40 [ 45.277167][ C1] tcf_mirred_init+0x844/0xd70 [act_mirred] [ 45.277268][ C1] tcf_action_init_1+0x428/0x6b0 [ 45.277353][ C1] tcf_action_init+0x3cf/0x890 [ 45.277428][ C1] tcf_exts_validate_ex+0x411/0x670 [ 45.277503][ C1] fl_change+0xed4/0x4e77 [cls_flower] [ 45.277584][ C1] tc_new_tfilter+0x875/0x21e0 [ 45.277660][ C1] rtnetlink_rcv_msg+0x6fd/0xbd0 [ 45.277738][ C1] netlink_rcv_skb+0x14e/0x3a0 [ 45.277815][ C1] netlink_unicast+0x486/0x750 [ 45.277891][ C1] netlink_sendmsg+0x735/0xc60 [ 45.277969][ C1] ____sys_sendmsg+0x419/0x850 [ 45.278047][ C1] ___sys_sendmsg+0x14e/0x1d0 [ 45.278126][ C1] __sys_sendmsg+0x145/0x1f0 [ 45.278202][ C1] do_syscall_64+0x117/0x590 [ 45.278278][ C1] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 45.278379][ C1] irq event stamp: 919900 [ 45.278438][ C1] hardirqs last enabled at (919900): [] _raw_spin_unlock_irqrestore+0x53/0x80 [ 45.278591][ C1] hardirqs last disabled at (919899): [] _raw_spin_lock_irqsave+0x50/0x60 [ 45.278743][ C1] softirqs last enabled at (919836): [] handle_softirqs+0x611/0x940 [ 45.278879][ C1] softirqs last disabled at (919841): [] run_ksoftirqd+0x39/0x60 [ 45.279010][ C1] [ 45.279010][ C1] other info that might help us debug this: [ 45.279122][ C1] Possible unsafe locking scenario: [ 45.279122][ C1] [ 45.279237][ C1] CPU0 [ 45.279294][ C1] ---- [ 45.279356][ C1] lock(mirred_list_lock); [ 45.279434][ C1] [ 45.279491][ C1] lock(mirred_list_lock); [ 45.279568][ C1] [ 45.279568][ C1] *** DEADLOCK *** [ 45.279568][ C1] [ 45.279678][ C1] 1 lock held by ksoftirqd/1/23: [ 45.279756][ C1] #0: ffffffff8d977c00 (rcu_callback){....}-{0:0}, at: rcu_do_batch+0x389/0x1020 [ 45.279897][ C1] [ 45.279897][ C1] stack backtrace: [ 45.279999][ C1] CPU: 1 UID: 0 PID: 23 Comm: ksoftirqd/1 Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 45.280002][ C1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 45.280004][ C1] Call Trace: [ 45.280006][ C1] [ 45.280007][ C1] dump_stack_lvl+0x6f/0xa0 [ 45.280012][ C1] print_usage_bug.part.0.cold+0xa9/0xb7 [ 45.280015][ C1] mark_lock_irq+0x4e3/0x9c0 [ 45.280017][ C1] ? kthread+0x367/0x460 [ 45.280020][ C1] ? save_trace+0x68/0x280 [ 45.280021][ C1] ? __lock_acquire+0x508/0xc10 [ 45.280023][ C1] mark_lock+0x1d7/0xa00 [ 45.280025][ C1] mark_usage+0x42/0x170 [ 45.280026][ C1] __lock_acquire+0x378/0xc10 [ 45.280027][ C1] ? rcu_is_watching+0x15/0xd0 [ 45.280030][ C1] lock_acquire.part.0+0xbc/0x260 [ 45.280032][ C1] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 45.280034][ C1] ? rcu_is_watching+0x15/0xd0 [ 45.280035][ C1] ? lock_acquire+0x134/0x160 [ 45.280037][ C1] _raw_spin_lock+0x33/0x40 [ 45.280039][ C1] ? tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 45.280040][ C1] tcf_mirred_release+0x1d/0x2e0 [act_mirred] [ 45.280042][ C1] tcf_action_rcu_free+0x74/0x1a0 [ 45.280043][ C1] ? rcu_do_batch+0x2b4/0x1020 [ 45.280045][ C1] rcu_do_batch+0x2b6/0x1020 [ 45.280047][ C1] ? rcu_is_watching+0x15/0xd0 [ 45.280049][ C1] ? trace_rcu_batch_end+0x330/0x330 [ 45.280051][ C1] ? finish_task_switch.isra.0+0x216/0x990 [ 45.280053][ C1] ? rcu_is_watching+0x15/0xd0 [ 45.280055][ C1] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 45.280058][ C1] ? trace_irq_disable.constprop.0+0x9b/0x180 [ 45.280059][ C1] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 45.280061][ C1] ? lockdep_hardirqs_on+0x8c/0x130 [ 45.280063][ C1] rcu_core+0x2bf/0x640 [ 45.280065][ C1] handle_softirqs+0x1d8/0x940 [ 45.280066][ C1] ? find_held_lock+0x2b/0x80 [ 45.280070][ C1] ? _local_bh_enable+0xd0/0xd0 [ 45.280071][ C1] ? rcu_is_watching+0x15/0xd0 [ 45.280073][ C1] run_ksoftirqd+0x39/0x60 [ 45.280074][ C1] smpboot_thread_fn+0x2fb/0x9b0 [ 45.280077][ C1] ? sort_range+0x20/0x20 [ 45.280078][ C1] kthread+0x367/0x460 [ 45.280080][ C1] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 45.280081][ C1] ? kthread_affine_node+0x330/0x330 [ 45.280083][ C1] ret_from_fork+0x474/0x6b0 [ 45.280086][ C1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 45.280088][ C1] ? __switch_to+0x5a3/0xe00 [ 45.280090][ C1] ? kthread_affine_node+0x330/0x330 [ 45.280092][ C1] ret_from_fork_asm+0x11/0x20 [ 45.280095][ C1] [ 51.812138][ C3] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:623 [ 51.812342][ C3] in_atomic(): 1, irqs_disabled(): 0, non_block: 0, pid: 763, name: perl [ 51.812467][ C3] preempt_count: 101, expected: 0 [ 51.812550][ C3] RCU nest depth: 0, expected: 0 [ 51.812634][ C3] INFO: lockdep is turned off. [ 51.812720][ C3] Preemption disabled at: [ 51.812721][ C3] [<0000000000000000>] 0x0 [ 51.812868][ C3] CPU: 3 UID: 0 PID: 763 Comm: perl Not tainted 7.1.0-rc5-virtme #1 PREEMPT(full) [ 51.812871][ C3] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 51.812873][ C3] Call Trace: [ 51.812875][ C3] [ 51.812876][ C3] dump_stack_lvl+0x6f/0xa0 [ 51.812884][ C3] __might_resched.cold+0x20d/0x2d6 [ 51.812887][ C3] ? process_output_block+0x110/0x760 [ 51.812892][ C3] ? perf_trace_sched_switch+0x7d0/0x7d0 [ 51.812896][ C3] ? new_sync_write+0x333/0x750 [ 51.812899][ C3] ? ksys_write+0x116/0x250 [ 51.812901][ C3] ? do_syscall_64+0x117/0x590 [ 51.812904][ C3] ? entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 51.812906][ C3] __mutex_lock+0x118/0x2010 [ 51.812908][ C3] ? __tcf_chain_put+0x5f/0xb20 [ 51.812912][ C3] ? ww_mutex_lock+0x160/0x160 [ 51.812915][ C3] ? __tcf_chain_put+0x5f/0xb20 [ 51.812917][ C3] __tcf_chain_put+0x5f/0xb20 [ 51.812919][ C3] ? free_percpu.part.0+0x5f7/0xc80 [ 51.812922][ C3] tcf_action_rcu_free+0x14f/0x1a0 [ 51.812924][ C3] ? rcu_do_batch+0x2b4/0x1020 [ 51.812927][ C3] rcu_do_batch+0x2b6/0x1020 [ 51.812930][ C3] ? trace_rcu_batch_end+0x330/0x330 [ 51.812932][ C3] ? rcu_is_watching+0x15/0xd0 [ 51.812934][ C3] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 51.812937][ C3] ? trace_irq_disable.constprop.0+0x9b/0x180 [ 51.812939][ C3] rcu_core+0x2bf/0x640 [ 51.812941][ C3] handle_softirqs+0x1d8/0x940 [ 51.812943][ C3] ? clockevents_tick_resume+0x60/0x60 [ 51.812946][ C3] ? _local_bh_enable+0xd0/0xd0 [ 51.812948][ C3] ? lock_release+0x17c/0x1f0 [ 51.812950][ C3] __irq_exit_rcu+0x103/0x1c0 [ 51.812952][ C3] irq_exit_rcu+0xe/0x30 [ 51.812953][ C3] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 51.812956][ C3] [ 51.812956][ C3] [ 51.812957][ C3] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 51.812959][ C3] RIP: 0010:_raw_spin_unlock_irqrestore+0x36/0x80 [ 51.812962][ C3] Code: f5 53 48 8b 74 24 10 48 89 fb 48 83 c7 18 e8 21 7e ca fd 48 89 df e8 a9 d4 ca fd f7 c5 00 02 00 00 75 1f 9c 58 f6 c4 02 75 2f 01 00 00 00 e8 30 62 bd fd 65 8b 05 29 0a fe 01 85 c0 74 12 5b [ 51.812964][ C3] RSP: 0018:ffa00000015f7a78 EFLAGS: 00000246 [ 51.812967][ C3] RAX: 0000000000000046 RBX: ffffffff907137a0 RCX: 0000000000000000 [ 51.812968][ C3] RDX: 0000000000000003 RSI: ffffffff8ce6f640 RDI: ffffffff8ca90613 [ 51.812969][ C3] RBP: 0000000000000286 R08: ffffffff8a9b3820 R09: 1ffffffff1c47d1a [ 51.812970][ C3] R10: 0000000000000003 R11: 0000000000000000 R12: ffffffff907138a8 [ 51.812971][ C3] R13: 000000000000000e R14: ffffffff907138e0 R15: ff110000019d4000 [ 51.812972][ C3] ? trace_irq_enable.constprop.0+0x30/0x180 [ 51.812974][ C3] ? _raw_spin_unlock_irqrestore+0x53/0x80 [ 51.812976][ C3] uart_write+0x231/0x990 [ 51.812979][ C3] process_output_block+0x110/0x760 [ 51.812981][ C3] ? trace_irq_enable.constprop.0+0x9b/0x180 [ 51.812982][ C3] ? do_raw_spin_unlock+0x59/0x250 [ 51.812985][ C3] n_tty_write+0x3b9/0x950 [ 51.812987][ C3] ? n_tty_receive_signal_char+0x110/0x110 [ 51.812989][ C3] ? _mutex_trylock_nest_lock+0x235/0x390 [ 51.812990][ C3] ? __init_waitqueue_head+0x160/0x160 [ 51.812997][ C3] ? do_raw_spin_unlock+0x59/0x250 [ 51.812998][ C3] ? trace_hardirqs_on+0x36/0x40 [ 51.813000][ C3] ? _raw_spin_unlock_irqrestore+0x40/0x80 [ 51.813002][ C3] iterate_tty_write+0x291/0x590 [ 51.813004][ C3] ? tty_ldisc_ref_wait+0x28/0x80 [ 51.813006][ C3] file_tty_write.isra.0+0x1bd/0x290 [ 51.813007][ C3] ? redirected_tty_write+0xd0/0xd0 [ 51.813009][ C3] new_sync_write+0x333/0x750 [ 51.813011][ C3] ? do_raw_spin_lock+0x131/0x280 [ 51.813013][ C3] ? rcu_is_watching+0x15/0xd0 [ 51.813014][ C3] ? timerqueue_linked_add+0x207/0x560 [ 51.813016][ C3] ? new_sync_read+0x740/0x740 [ 51.813020][ C3] vfs_write+0x6a4/0xc10 [ 51.813022][ C3] ksys_write+0x116/0x250 [ 51.813023][ C3] ? __ia32_sys_read+0xc0/0xc0 [ 51.813024][ C3] ? restore_fpregs_from_fpstate+0x44/0x130 [ 51.813027][ C3] ? rcu_is_watching+0x15/0xd0 [ 51.813029][ C3] do_syscall_64+0x117/0x590 [ 51.813031][ C3] ? irq_exit_rcu+0x1a/0x30 [ 51.813032][ C3] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 51.813033][ C3] RIP: 0033:0x7faa08ecf08e [ 51.813035][ C3] Code: 4d 89 d8 e8 94 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 51.813036][ C3] RSP: 002b:00007fff813409e0 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 51.813037][ C3] RAX: ffffffffffffffda RBX: 00005560c0c5a290 RCX: 00007faa08ecf08e [ 51.813038][ C3] RDX: 000000000000000e RSI: 00005560c0c5a290 RDI: 0000000000000001 [ 51.813039][ C3] RBP: 00007fff813409f0 R08: 0000000000000000 R09: 0000000000000000 [ 51.813040][ C3] R10: 0000000000000000 R11: 0000000000000202 R12: 000000000000000e [ 51.813040][ C3] R13: 00005560c0c21010 R14: 0000000000000001 R15: 00005560c0c5a290 [ 51.813042][ C3]