[ 18.194326][ C0] tun0: no available key for peer 2, key-id: 0 [ 18.194361][ C0] [ 18.194363][ C0] ======================================================== [ 18.194364][ C0] WARNING: possible irq lock inversion dependency detected [ 18.194366][ C0] 7.2.0-virtme #1 Tainted: G W [ 18.194368][ C0] -------------------------------------------------------- [ 18.194368][ C0] ovpn-cli/356 just changed the state of lock: [ 18.194370][ C0] ffffffff87499660 (console_owner){..-.}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 18.194382][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 18.194383][ C0] (fs_reclaim){+.+.}-{0:0} [ 18.194384][ C0] [ 18.194384][ C0] [ 18.194384][ C0] and interrupts could create inverse lock ordering between them. [ 18.194384][ C0] [ 18.194386][ C0] [ 18.194386][ C0] other info that might help us debug this: [ 18.194386][ C0] Possible interrupt unsafe locking scenario: [ 18.194386][ C0] [ 18.194387][ C0] CPU0 CPU1 [ 18.194387][ C0] ---- ---- [ 18.194388][ C0] lock(fs_reclaim); [ 18.194389][ C0] local_irq_disable(); [ 18.194389][ C0] lock(console_owner); [ 18.194390][ C0] lock(fs_reclaim); [ 18.194391][ C0] [ 18.194391][ C0] lock(console_owner); [ 18.194392][ C0] [ 18.194392][ C0] *** DEADLOCK *** [ 18.194392][ C0] [ 18.194393][ C0] locks held by ovpn-cli/356: 6, last CPU#0: [ 18.194394][ C0] #0: ffffffff87590b00 (rcu_read_lock){....}-{1:3}, at: process_backlog+0x3f1/0x14c0 [ 18.194400][ C0] #1: ffffffff87590b00 (rcu_read_lock){....}-{1:3}, at: ip_local_deliver_finish+0x2ba/0x610 [ 18.194405][ C0] #2: ff1100001004b818 (slock-AF_INET/1){+.-.}-{3:3}, at: tcp_v4_rcv+0x1a81/0x2b70 [ 18.194409][ C0] #3: ffffffff87590b00 (rcu_read_lock){....}-{1:3}, at: ovpn_tcp_data_ready+0x62/0x390 [ovpn] [ 18.194416][ C0] #4: ffffffff87579cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 18.194420][ C0] #5: ffffffff87579d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 18.194423][ C0] [ 18.194423][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 18.194428][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 18.194430][ C0] HARDIRQ-ON-W at: [ 18.194432][ C0] __lock_acquire+0x388/0xc20 [ 18.194435][ C0] lock_acquire.part.0+0xd4/0x280 [ 18.194436][ C0] fs_reclaim_acquire+0xd5/0x120 [ 18.194439][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 18.194441][ C0] kthread_create_worker_on_node+0xea/0x210 [ 18.194444][ C0] workqueue_init+0x2a/0x680 [ 18.194447][ C0] kernel_init_freeable+0x2fe/0x630 [ 18.194450][ C0] kernel_init+0x21/0x150 [ 18.194453][ C0] ret_from_fork+0x474/0x6b0 [ 18.194456][ C0] ret_from_fork_asm+0x11/0x20 [ 18.194459][ C0] SOFTIRQ-ON-W at: [ 18.194460][ C0] __lock_acquire+0x388/0xc20 [ 18.194461][ C0] lock_acquire.part.0+0xd4/0x280 [ 18.194462][ C0] fs_reclaim_acquire+0xd5/0x120 [ 18.194464][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 18.194465][ C0] kthread_create_worker_on_node+0xea/0x210 [ 18.194466][ C0] workqueue_init+0x2a/0x680 [ 18.194467][ C0] kernel_init_freeable+0x2fe/0x630 [ 18.194469][ C0] kernel_init+0x21/0x150 [ 18.194470][ C0] ret_from_fork+0x474/0x6b0 [ 18.194471][ C0] ret_from_fork_asm+0x11/0x20 [ 18.194473][ C0] INITIAL USE at: [ 18.194474][ C0] __lock_acquire+0x388/0xc20 [ 18.194475][ C0] lock_acquire.part.0+0xd4/0x280 [ 18.194476][ C0] fs_reclaim_acquire+0xd5/0x120 [ 18.194477][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 18.194479][ C0] kthread_create_worker_on_node+0xea/0x210 [ 18.194480][ C0] workqueue_init+0x2a/0x680 [ 18.194481][ C0] kernel_init_freeable+0x2fe/0x630 [ 18.194483][ C0] kernel_init+0x21/0x150 [ 18.194484][ C0] ret_from_fork+0x474/0x6b0 [ 18.194485][ C0] ret_from_fork_asm+0x11/0x20 [ 18.194486][ C0] } [ 18.194487][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 18.194490][ C0] ... acquired at: [ 18.194491][ C0] __lock_acquire+0x518/0xc20 [ 18.194493][ C0] lock_acquire.part.0+0xd4/0x280 [ 18.194494][ C0] fs_reclaim_acquire+0xd5/0x120 [ 18.194495][ C0] __kmalloc_noprof+0xd3/0x760 [ 18.194496][ C0] alloc_buf.isra.0+0x4b/0x260 [ 18.194499][ C0] put_chars+0x1e1/0x2f0 [ 18.194501][ C0] hvc_console_print+0x292/0x780 [ 18.194503][ C0] console_emit_next_record+0x22f/0x4c0 [ 18.194505][ C0] console_flush_one_record+0x46f/0x710 [ 18.194506][ C0] console_unlock+0xee/0x1f0 [ 18.194508][ C0] vprintk_emit+0x37c/0x3e0 [ 18.194510][ C0] _printk+0xc7/0x100 [ 18.194513][ C0] dm_interface_init+0x50/0x60 [ 18.194516][ C0] dm_init+0x51/0xd0 [ 18.194517][ C0] do_one_initcall+0x124/0x4f0 [ 18.194519][ C0] kernel_init_freeable+0x596/0x630 [ 18.194521][ C0] kernel_init+0x21/0x150 [ 18.194522][ C0] ret_from_fork+0x474/0x6b0 [ 18.194523][ C0] ret_from_fork_asm+0x11/0x20 [ 18.194524][ C0] [ 18.194525][ C0] -> (console_owner){..-.}-{0:0} { [ 18.194526][ C0] IN-SOFTIRQ-W at: [ 18.194527][ C0] __lock_acquire+0x388/0xc20 [ 18.194528][ C0] lock_acquire.part.0+0xd4/0x280 [ 18.194530][ C0] console_lock_spinning_enable+0x5c/0x60 [ 18.194531][ C0] console_emit_next_record+0x1d1/0x4c0 [ 18.194533][ C0] console_flush_one_record+0x46f/0x710 [ 18.194535][ C0] console_unlock+0xee/0x1f0 [ 18.194536][ C0] vprintk_emit+0x37c/0x3e0 [ 18.194538][ C0] _printk+0xc7/0x100 [ 18.194539][ C0] ovpn_recv.cold+0x7e/0x94 [ovpn] [ 18.194542][ C0] ovpn_tcp_rcv+0x274/0x9a0 [ovpn] [ 18.194544][ C0] __strp_recv+0x20f/0x1c20 [ 18.194548][ C0] __tcp_read_sock+0x1c7/0x850 [ 18.194550][ C0] strp_read_sock+0x20f/0x2b0 [ 18.194552][ C0] strp_data_ready+0x18e/0x2c0 [ 18.194553][ C0] ovpn_tcp_data_ready+0xf1/0x390 [ovpn] [ 18.194556][ C0] tcp_rcv_established+0x1e1d/0x3910 [ 18.194558][ C0] tcp_v4_do_rcv+0x4f6/0xb90 [ 18.194559][ C0] tcp_v4_rcv+0x1caa/0x2b70 [ 18.194561][ C0] ip_protocol_deliver_rcu+0x82/0x350 [ 18.194562][ C0] ip_local_deliver_finish+0x36f/0x610 [ 18.194563][ C0] ip_local_deliver+0x184/0x4c0 [ 18.194565][ C0] ip_rcv+0xdc/0x3d0 [ 18.194566][ C0] __netif_receive_skb_one_core+0xfc/0x180 [ 18.194568][ C0] process_backlog+0x431/0x14c0 [ 18.194570][ C0] __napi_poll+0xa7/0x3b0 [ 18.194571][ C0] net_rx_action+0x513/0xf50 [ 18.194573][ C0] handle_softirqs+0x1d3/0x900 [ 18.194576][ C0] do_softirq+0xac/0xe0 [ 18.194577][ C0] __local_bh_enable_ip+0x118/0x150 [ 18.194578][ C0] ovpn_tcp_sendmsg+0x2c2/0x7d0 [ovpn] [ 18.194580][ C0] __sys_sendto+0x2aa/0x400 [ 18.194583][ C0] __x64_sys_sendto+0xe4/0x1f0 [ 18.194585][ C0] do_syscall_64+0xff/0x530 [ 18.194587][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 18.194589][ C0] INITIAL USE at: [ 18.194590][ C0] } [ 18.194590][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 18.194594][ C0] ... acquired at: [ 18.194594][ C0] mark_lock+0x1d7/0xa00 [ 18.194596][ C0] mark_usage+0x42/0x170 [ 18.194597][ C0] __lock_acquire+0x388/0xc20 [ 18.194598][ C0] lock_acquire.part.0+0xd4/0x280 [ 18.194600][ C0] console_lock_spinning_enable+0x5c/0x60 [ 18.194601][ C0] console_emit_next_record+0x1d1/0x4c0 [ 18.194603][ C0] console_flush_one_record+0x46f/0x710 [ 18.194604][ C0] console_unlock+0xee/0x1f0 [ 18.194606][ C0] vprintk_emit+0x37c/0x3e0 [ 18.194607][ C0] _printk+0xc7/0x100 [ 18.194609][ C0] ovpn_recv.cold+0x7e/0x94 [ovpn] [ 18.194611][ C0] ovpn_tcp_rcv+0x274/0x9a0 [ovpn] [ 18.194613][ C0] __strp_recv+0x20f/0x1c20 [ 18.194615][ C0] __tcp_read_sock+0x1c7/0x850 [ 18.194616][ C0] strp_read_sock+0x20f/0x2b0 [ 18.194618][ C0] strp_data_ready+0x18e/0x2c0 [ 18.194619][ C0] ovpn_tcp_data_ready+0xf1/0x390 [ovpn] [ 18.194622][ C0] tcp_rcv_established+0x1e1d/0x3910 [ 18.194623][ C0] tcp_v4_do_rcv+0x4f6/0xb90 [ 18.194625][ C0] tcp_v4_rcv+0x1caa/0x2b70 [ 18.194626][ C0] ip_protocol_deliver_rcu+0x82/0x350 [ 18.194628][ C0] ip_local_deliver_finish+0x36f/0x610 [ 18.194629][ C0] ip_local_deliver+0x184/0x4c0 [ 18.194630][ C0] ip_rcv+0xdc/0x3d0 [ 18.194631][ C0] __netif_receive_skb_one_core+0xfc/0x180 [ 18.194633][ C0] process_backlog+0x431/0x14c0 [ 18.194635][ C0] __napi_poll+0xa7/0x3b0 [ 18.194636][ C0] net_rx_action+0x513/0xf50 [ 18.194638][ C0] handle_softirqs+0x1d3/0x900 [ 18.194639][ C0] do_softirq+0xac/0xe0 [ 18.194640][ C0] __local_bh_enable_ip+0x118/0x150 [ 18.194642][ C0] ovpn_tcp_sendmsg+0x2c2/0x7d0 [ovpn] [ 18.194644][ C0] __sys_sendto+0x2aa/0x400 [ 18.194645][ C0] __x64_sys_sendto+0xe4/0x1f0 [ 18.194647][ C0] do_syscall_64+0xff/0x530 [ 18.194649][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 18.194650][ C0] [ 18.194650][ C0] [ 18.194650][ C0] stack backtrace: [ 18.194653][ C0] CPU: 0 UID: 0 PID: 356 Comm: ovpn-cli Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 18.194656][ C0] Tainted: [W]=WARN [ 18.194656][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 18.194658][ C0] Call Trace: [ 18.194659][ C0] [ 18.194660][ C0] dump_stack_lvl+0x6f/0xa0 [ 18.194664][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 18.194667][ C0] mark_lock_irq+0x989/0x9c0 [ 18.194669][ C0] mark_lock+0x1d7/0xa00 [ 18.194671][ C0] mark_usage+0x42/0x170 [ 18.194673][ C0] __lock_acquire+0x388/0xc20 [ 18.194675][ C0] lock_acquire.part.0+0xd4/0x280 [ 18.194677][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 18.194679][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194682][ C0] ? lock_acquire+0x13c/0x160 [ 18.194686][ C0] console_lock_spinning_enable+0x5c/0x60 [ 18.194688][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 18.194690][ C0] console_emit_next_record+0x1d1/0x4c0 [ 18.194692][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 18.194694][ C0] ? console_flush_one_record+0x106/0x710 [ 18.194696][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194697][ C0] ? lock_acquire+0x13c/0x160 [ 18.194699][ C0] console_flush_one_record+0x46f/0x710 [ 18.194702][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 18.194703][ C0] ? __lock_acquire+0x518/0xc20 [ 18.194706][ C0] console_unlock+0xee/0x1f0 [ 18.194708][ C0] ? console_flush_one_record+0x710/0x710 [ 18.194709][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194711][ C0] ? lock_acquire+0x60/0x160 [ 18.194713][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 18.194715][ C0] ? vprintk_emit+0x320/0x3e0 [ 18.194717][ C0] vprintk_emit+0x37c/0x3e0 [ 18.194719][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 18.194721][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 18.194723][ C0] _printk+0xc7/0x100 [ 18.194725][ C0] ? snapshot_read.cold+0x21/0x21 [ 18.194727][ C0] ? ___ratelimit+0x4e7/0xa00 [ 18.194730][ C0] ? ovpn_netdev_write+0x730/0x730 [ovpn] [ 18.194733][ C0] ? idr_get_free+0x830/0x830 [ 18.194736][ C0] ovpn_recv.cold+0x7e/0x94 [ovpn] [ 18.194739][ C0] ovpn_tcp_rcv+0x274/0x9a0 [ovpn] [ 18.194742][ C0] ? ovpn_tcp_write_space+0x2e0/0x2e0 [ovpn] [ 18.194744][ C0] ? __copy_skb_header+0xb7/0x510 [ 18.194747][ C0] ? ovpn_tcp_disconnect+0x10/0x10 [ovpn] [ 18.194749][ C0] ? sock_queue_err_skb+0xb0/0x680 [ 18.194752][ C0] __strp_recv+0x20f/0x1c20 [ 18.194755][ C0] __tcp_read_sock+0x1c7/0x850 [ 18.194756][ C0] ? strp_process+0xb0/0xb0 [ 18.194759][ C0] ? __tcp_transmit_skb+0x1b6e/0x3c10 [ 18.194760][ C0] ? tcp_cleanup_rbuf+0x1c0/0x1c0 [ 18.194762][ C0] ? mark_usage+0x61/0x170 [ 18.194764][ C0] strp_read_sock+0x20f/0x2b0 [ 18.194766][ C0] ? strp_stop+0x50/0x50 [ 18.194768][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194770][ C0] ? lock_acquire+0x13c/0x160 [ 18.194772][ C0] strp_data_ready+0x18e/0x2c0 [ 18.194774][ C0] ovpn_tcp_data_ready+0xf1/0x390 [ovpn] [ 18.194777][ C0] tcp_rcv_established+0x1e1d/0x3910 [ 18.194780][ C0] ? __tcp_check_space+0x600/0x600 [ 18.194781][ C0] ? tcp_v4_rcv+0x1a81/0x2b70 [ 18.194783][ C0] ? do_raw_spin_lock+0x131/0x280 [ 18.194786][ C0] tcp_v4_do_rcv+0x4f6/0xb90 [ 18.194788][ C0] tcp_v4_rcv+0x1caa/0x2b70 [ 18.194790][ C0] ? mark_usage+0x61/0x170 [ 18.194792][ C0] ? tcp_add_backlog+0x1e30/0x1e30 [ 18.194794][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 18.194796][ C0] ? ip_local_deliver_finish+0x2ba/0x610 [ 18.194798][ C0] ip_protocol_deliver_rcu+0x82/0x350 [ 18.194800][ C0] ? process_backlog+0x3f1/0x14c0 [ 18.194802][ C0] ip_local_deliver_finish+0x36f/0x610 [ 18.194803][ C0] ip_local_deliver+0x184/0x4c0 [ 18.194805][ C0] ? ip_local_deliver_finish+0x610/0x610 [ 18.194807][ C0] ? ip_rcv_finish_core+0x6ed/0x14c0 [ 18.194809][ C0] ? process_backlog+0x3f1/0x14c0 [ 18.194811][ C0] ip_rcv+0xdc/0x3d0 [ 18.194813][ C0] ? ip_local_deliver+0x4c0/0x4c0 [ 18.194814][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194816][ C0] ? mark_usage+0x61/0x170 [ 18.194818][ C0] ? __lock_acquire+0x518/0xc20 [ 18.194819][ C0] ? trace_raw_output_rcu_invoke_kfree_bulk_callback+0x57/0x130 [ 18.194822][ C0] __netif_receive_skb_one_core+0xfc/0x180 [ 18.194824][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 18.194825][ C0] ? process_backlog+0x3f1/0x14c0 [ 18.194827][ C0] ? __netif_receive_skb_list_core+0x9e0/0x9e0 [ 18.194829][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194831][ C0] process_backlog+0x431/0x14c0 [ 18.194834][ C0] __napi_poll+0xa7/0x3b0 [ 18.194836][ C0] net_rx_action+0x513/0xf50 [ 18.194839][ C0] ? __lock_acquire+0x518/0xc20 [ 18.194841][ C0] ? __napi_poll+0x3b0/0x3b0 [ 18.194844][ C0] ? ktime_get_update_offsets_now+0x2a8/0x490 [ 18.194847][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194849][ C0] handle_softirqs+0x1d3/0x900 [ 18.194851][ C0] ? _local_bh_enable+0xc0/0xc0 [ 18.194853][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 18.194855][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194857][ C0] do_softirq+0xac/0xe0 [ 18.194858][ C0] [ 18.194859][ C0] [ 18.194859][ C0] __local_bh_enable_ip+0x118/0x150 [ 18.194861][ C0] ovpn_tcp_sendmsg+0x2c2/0x7d0 [ovpn] [ 18.194864][ C0] ? ovpn_tcp_recvmsg+0x6d0/0x6d0 [ovpn] [ 18.194868][ C0] __sys_sendto+0x2aa/0x400 [ 18.194870][ C0] ? __ia32_sys_getpeername+0xd0/0xd0 [ 18.194874][ C0] ? fput_close_sync+0xde/0x1b0 [ 18.194876][ C0] ? alloc_file_clone+0xe0/0xe0 [ 18.194878][ C0] __x64_sys_sendto+0xe4/0x1f0 [ 18.194880][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 18.194883][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 18.194884][ C0] ? do_syscall_64+0xa6/0x530 [ 18.194885][ C0] do_syscall_64+0xff/0x530 [ 18.194887][ C0] ? exc_page_fault+0xee/0x100 [ 18.194889][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 18.194890][ C0] RIP: 0033:0x7f2e7d9e454e [ 18.194893][ C0] Code: 4d 89 d8 e8 b4 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 18.194895][ C0] RSP: 002b:00007ffe09d5bc50 EFLAGS: 00000202 ORIG_RAX: 000000000000002c [ 18.194897][ C0] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f2e7d9e454e [ 18.194899][ C0] RDX: 00000000000003ea RSI: 00007ffe09d5bcc0 RDI: 0000000000000005 [ 18.194900][ C0] RBP: 00007ffe09d5bc60 R08: 0000000000000000 R09: 0000000000000000 [ 18.194901][ C0] R10: 0000000000004000 R11: 0000000000000202 R12: 00007ffe09d5c5e8 [ 18.194901][ C0] R13: 0000000000000008 R14: 00007f2e7dccf000 R15: 000000000040bda8 [ 18.194904][ C0] [ 18.194908][ C0] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 18.194909][ C0] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 356, name: ovpn-cli [ 18.194911][ C0] preempt_count: 103, expected: 0 [ 18.194911][ C0] RCU nest depth: 3, expected: 0 [ 18.194912][ C0] INFO: lockdep is turned off. [ 18.194912][ C0] irq event stamp: 39119 [ 18.194913][ C0] hardirqs last enabled at (39118): [] __down_trylock_console_sem+0x86/0xa0 [ 18.194916][ C0] hardirqs last disabled at (39119): [] console_emit_next_record+0x3d4/0x4c0 [ 18.194918][ C0] softirqs last enabled at (39002): [] ovpn_tcp_sendmsg+0x2c2/0x7d0 [ovpn] [ 18.194920][ C0] softirqs last disabled at (39003): [] do_softirq+0xac/0xe0 [ 18.194922][ C0] Preemption disabled at: [ 18.194922][ C0] [<0000000000000000>] 0x0 [ 18.194925][ C0] CPU: 0 UID: 0 PID: 356 Comm: ovpn-cli Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 18.194927][ C0] Tainted: [W]=WARN [ 18.194927][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 18.194928][ C0] Call Trace: [ 18.194929][ C0] [ 18.194929][ C0] dump_stack_lvl+0x6f/0xa0 [ 18.194932][ C0] __might_resched.cold+0x1fe/0x2c1 [ 18.194934][ C0] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 18.194937][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194940][ C0] __kmalloc_noprof+0x443/0x760 [ 18.194941][ C0] ? __rwlock_init+0x150/0x150 [ 18.194943][ C0] ? alloc_buf.isra.0+0x4b/0x260 [ 18.194945][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 18.194946][ C0] alloc_buf.isra.0+0x4b/0x260 [ 18.194948][ C0] put_chars+0x1e1/0x2f0 [ 18.194950][ C0] ? __send_to_port+0x420/0x420 [ 18.194953][ C0] hvc_console_print+0x292/0x780 [ 18.194955][ C0] ? __lock_acquire+0x388/0xc20 [ 18.194957][ C0] ? hvc_write+0x3a0/0x3a0 [ 18.194959][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194961][ C0] ? lock_acquire+0x13c/0x160 [ 18.194963][ C0] console_emit_next_record+0x22f/0x4c0 [ 18.194965][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 18.194966][ C0] ? console_flush_one_record+0x106/0x710 [ 18.194968][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194970][ C0] ? lock_acquire+0x13c/0x160 [ 18.194972][ C0] console_flush_one_record+0x46f/0x710 [ 18.194974][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 18.194976][ C0] ? __lock_acquire+0x518/0xc20 [ 18.194978][ C0] console_unlock+0xee/0x1f0 [ 18.194980][ C0] ? console_flush_one_record+0x710/0x710 [ 18.194982][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.194984][ C0] ? lock_acquire+0x60/0x160 [ 18.194986][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 18.194987][ C0] ? vprintk_emit+0x320/0x3e0 [ 18.194989][ C0] vprintk_emit+0x37c/0x3e0 [ 18.194991][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 18.194993][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 18.194995][ C0] _printk+0xc7/0x100 [ 18.194997][ C0] ? snapshot_read.cold+0x21/0x21 [ 18.194999][ C0] ? ___ratelimit+0x4e7/0xa00 [ 18.195001][ C0] ? ovpn_netdev_write+0x730/0x730 [ovpn] [ 18.195003][ C0] ? idr_get_free+0x830/0x830 [ 18.195005][ C0] ovpn_recv.cold+0x7e/0x94 [ovpn] [ 18.195008][ C0] ovpn_tcp_rcv+0x274/0x9a0 [ovpn] [ 18.195011][ C0] ? ovpn_tcp_write_space+0x2e0/0x2e0 [ovpn] [ 18.195013][ C0] ? __copy_skb_header+0xb7/0x510 [ 18.195015][ C0] ? ovpn_tcp_disconnect+0x10/0x10 [ovpn] [ 18.195018][ C0] ? sock_queue_err_skb+0xb0/0x680 [ 18.195020][ C0] __strp_recv+0x20f/0x1c20 [ 18.195023][ C0] __tcp_read_sock+0x1c7/0x850 [ 18.195025][ C0] ? strp_process+0xb0/0xb0 [ 18.195027][ C0] ? __tcp_transmit_skb+0x1b6e/0x3c10 [ 18.195028][ C0] ? tcp_cleanup_rbuf+0x1c0/0x1c0 [ 18.195030][ C0] ? mark_usage+0x61/0x170 [ 18.195032][ C0] strp_read_sock+0x20f/0x2b0 [ 18.195034][ C0] ? strp_stop+0x50/0x50 [ 18.195036][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.195038][ C0] ? lock_acquire+0x13c/0x160 [ 18.195039][ C0] strp_data_ready+0x18e/0x2c0 [ 18.195042][ C0] ovpn_tcp_data_ready+0xf1/0x390 [ovpn] [ 18.195044][ C0] tcp_rcv_established+0x1e1d/0x3910 [ 18.195047][ C0] ? __tcp_check_space+0x600/0x600 [ 18.195049][ C0] ? tcp_v4_rcv+0x1a81/0x2b70 [ 18.195051][ C0] ? do_raw_spin_lock+0x131/0x280 [ 18.195053][ C0] tcp_v4_do_rcv+0x4f6/0xb90 [ 18.195055][ C0] tcp_v4_rcv+0x1caa/0x2b70 [ 18.195057][ C0] ? mark_usage+0x61/0x170 [ 18.195059][ C0] ? tcp_add_backlog+0x1e30/0x1e30 [ 18.195061][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 18.195063][ C0] ? ip_local_deliver_finish+0x2ba/0x610 [ 18.195065][ C0] ip_protocol_deliver_rcu+0x82/0x350 [ 18.195067][ C0] ? process_backlog+0x3f1/0x14c0 [ 18.195069][ C0] ip_local_deliver_finish+0x36f/0x610 [ 18.195071][ C0] ip_local_deliver+0x184/0x4c0 [ 18.195072][ C0] ? ip_local_deliver_finish+0x610/0x610 [ 18.195074][ C0] ? ip_rcv_finish_core+0x6ed/0x14c0 [ 18.195076][ C0] ? process_backlog+0x3f1/0x14c0 [ 18.195078][ C0] ip_rcv+0xdc/0x3d0 [ 18.195080][ C0] ? ip_local_deliver+0x4c0/0x4c0 [ 18.195081][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.195083][ C0] ? mark_usage+0x61/0x170 [ 18.195085][ C0] ? __lock_acquire+0x518/0xc20 [ 18.195086][ C0] ? trace_raw_output_rcu_invoke_kfree_bulk_callback+0x57/0x130 [ 18.195088][ C0] __netif_receive_skb_one_core+0xfc/0x180 [ 18.195090][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 18.195092][ C0] ? process_backlog+0x3f1/0x14c0 [ 18.195093][ C0] ? __netif_receive_skb_list_core+0x9e0/0x9e0 [ 18.195095][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.195098][ C0] process_backlog+0x431/0x14c0 [ 18.195101][ C0] __napi_poll+0xa7/0x3b0 [ 18.195103][ C0] net_rx_action+0x513/0xf50 [ 18.195105][ C0] ? __lock_acquire+0x518/0xc20 [ 18.195107][ C0] ? __napi_poll+0x3b0/0x3b0 [ 18.195110][ C0] ? ktime_get_update_offsets_now+0x2a8/0x490 [ 18.195112][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.195114][ C0] handle_softirqs+0x1d3/0x900 [ 18.195117][ C0] ? _local_bh_enable+0xc0/0xc0 [ 18.195118][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 18.195119][ C0] ? rcu_is_watching+0x16/0xd0 [ 18.195122][ C0] do_softirq+0xac/0xe0 [ 18.195123][ C0] [ 18.195124][ C0] [ 18.195124][ C0] __local_bh_enable_ip+0x118/0x150 [ 18.195126][ C0] ovpn_tcp_sendmsg+0x2c2/0x7d0 [ovpn] [ 18.195129][ C0] ? ovpn_tcp_recvmsg+0x6d0/0x6d0 [ovpn] [ 18.195132][ C0] __sys_sendto+0x2aa/0x400 [ 18.195134][ C0] ? __ia32_sys_getpeername+0xd0/0xd0 [ 18.195138][ C0] ? fput_close_sync+0xde/0x1b0 [ 18.195139][ C0] ? alloc_file_clone+0xe0/0xe0 [ 18.195141][ C0] __x64_sys_sendto+0xe4/0x1f0 [ 18.195143][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 18.195144][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 18.195145][ C0] ? do_syscall_64+0xa6/0x530 [ 18.195147][ C0] do_syscall_64+0xff/0x530 [ 18.195149][ C0] ? exc_page_fault+0xee/0x100 [ 18.195150][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 18.195151][ C0] RIP: 0033:0x7f2e7d9e454e [ 18.195153][ C0] Code: 4d 89 d8 e8 b4 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 18.195154][ C0] RSP: 002b:00007ffe09d5bc50 EFLAGS: 00000202 ORIG_RAX: 000000000000002c [ 18.195155][ C0] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f2e7d9e454e [ 18.195156][ C0] RDX: 00000000000003ea RSI: 00007ffe09d5bcc0 RDI: 0000000000000005 [ 18.195157][ C0] RBP: 00007ffe09d5bc60 R08: 0000000000000000 R09: 0000000000000000 [ 18.195157][ C0] R10: 0000000000004000 R11: 0000000000000202 R12: 00007ffe09d5c5e8 [ 18.195158][ C0] R13: 0000000000000008 R14: 00007f2e7dccf000 R15: 000000000040bda8 [ 18.195160][ C0] [ 18.343882][ C0] tun0: no available key for peer 3, key-id: 0 [ 18.410162][ C0] tun0: no available key for peer 4, key-id: 0 [ 18.534979][ C2] tun0: no available key for peer 6, key-id: 0 [ 23.911210][ T479] iperf3 (479) used greatest stack depth: 23128 bytes left [ 23.911227][ T479] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 23.911230][ T479] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 479, name: iperf3 [ 23.911231][ T479] preempt_count: 2, expected: 0 [ 23.911232][ T479] RCU nest depth: 0, expected: 0 [ 23.911233][ T479] INFO: lockdep is turned off. [ 23.911234][ T479] irq event stamp: 0 [ 23.911235][ T479] hardirqs last enabled at (0): [<0000000000000000>] 0x0 [ 23.911239][ T479] hardirqs last disabled at (0): [] copy_process+0x1ccd/0x6240 [ 23.911255][ T479] softirqs last enabled at (0): [] copy_process+0x1d21/0x6240 [ 23.911256][ T479] softirqs last disabled at (0): [<0000000000000000>] 0x0 [ 23.911258][ T479] Preemption disabled at: [ 23.911259][ T479] [<0000000000000000>] 0x0 [ 23.911264][ T479] CPU: 1 UID: 0 PID: 479 Comm: iperf3 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 23.911267][ T479] Tainted: [W]=WARN [ 23.911268][ T479] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 23.911270][ T479] Call Trace: [ 23.911271][ T479] [ 23.911272][ T479] dump_stack_lvl+0x6f/0xa0 [ 23.911278][ T479] __might_resched.cold+0x1fe/0x2c1 [ 23.911282][ T479] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 23.911286][ T479] ? prb_next_reserve_seq+0x2d0/0x2d0 [ 23.911288][ T479] ? rcu_is_watching+0x16/0xd0 [ 23.911292][ T479] __kmalloc_noprof+0x443/0x760 [ 23.911295][ T479] ? __rwlock_init+0x150/0x150 [ 23.911297][ T479] ? alloc_buf.isra.0+0x4b/0x260 [ 23.911302][ T479] ? do_raw_spin_unlock+0x59/0x250 [ 23.911303][ T479] alloc_buf.isra.0+0x4b/0x260 [ 23.911305][ T479] put_chars+0x1e1/0x2f0 [ 23.911307][ T479] ? prb_final_commit+0x50/0x50 [ 23.911309][ T479] ? __send_to_port+0x420/0x420 [ 23.911310][ T479] ? printk_get_next_message+0x240/0x650 [ 23.911313][ T479] hvc_console_print+0x292/0x780 [ 23.911317][ T479] ? hvc_write+0x3a0/0x3a0 [ 23.911318][ T479] ? do_raw_spin_lock+0x131/0x280 [ 23.911320][ T479] ? vsnprintf+0x668/0x1700 [ 23.911322][ T479] ? __rwlock_init+0x150/0x150 [ 23.911324][ T479] ? rcu_is_watching+0x16/0xd0 [ 23.911326][ T479] ? lock_acquire+0x13c/0x160 [ 23.911328][ T479] console_emit_next_record+0x22f/0x4c0 [ 23.911331][ T479] ? devkmsg_read+0x4b0/0x4b0 [ 23.911332][ T479] ? rcu_is_watching+0x16/0xd0 [ 23.911334][ T479] ? rcu_is_watching+0x16/0xd0 [ 23.911335][ T479] ? rcu_is_watching+0x16/0xd0 [ 23.911337][ T479] ? lock_acquire+0x13c/0x160 [ 23.911339][ T479] ? console_flush_one_record+0x111/0x710 [ 23.911341][ T479] console_flush_one_record+0x46f/0x710 [ 23.911343][ T479] ? console_emit_next_record+0x4c0/0x4c0 [ 23.911345][ T479] console_unlock+0xee/0x1f0 [ 23.911347][ T479] ? lock_acquire+0x13c/0x160 [ 23.911349][ T479] ? console_flush_one_record+0x710/0x710 [ 23.911350][ T479] ? rcu_is_watching+0x16/0xd0 [ 23.911352][ T479] ? lock_release+0x184/0x1f0 [ 23.911353][ T479] ? lock_acquire+0x60/0x160 [ 23.911354][ T479] ? __rcu_read_lock+0x30/0x70 [ 23.911356][ T479] ? __down_trylock_console_sem+0x5e/0xa0 [ 23.911358][ T479] ? vprintk_emit+0x320/0x3e0 [ 23.911360][ T479] vprintk_emit+0x37c/0x3e0 [ 23.911362][ T479] ? wake_up_klogd_work_func+0x90/0x90 [ 23.911365][ T479] _printk+0xc7/0x100 [ 23.911367][ T479] ? snapshot_read.cold+0x21/0x21 [ 23.911369][ T479] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 23.911372][ T479] ? do_raw_spin_lock+0x131/0x280 [ 23.911373][ T479] ? __rwlock_init+0x150/0x150 [ 23.911375][ T479] ? do_raw_spin_lock+0x131/0x280 [ 23.911377][ T479] do_exit.cold+0x82/0x9c [ 23.911380][ T479] ? exit_notify+0x890/0x890 [ 23.911382][ T479] __x64_sys_exit+0x42/0x50 [ 23.911384][ T479] x64_sys_call+0x156c/0x1570 [ 23.911386][ T479] do_syscall_64+0xff/0x530 [ 23.911388][ T479] ? exc_page_fault+0xee/0x100 [ 23.911390][ T479] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 23.911392][ T479] RIP: 0033:0x7f6df331bc49 [ 23.911394][ T479] Code: Unable to access opcode bytes at 0x7f6df331bc1f. [ 23.911395][ T479] RSP: 002b:00007f6df2adae60 EFLAGS: 00000246 ORIG_RAX: 000000000000003c [ 23.911399][ T479] RAX: ffffffffffffffda RBX: 00007f6df2adb6c0 RCX: 00007f6df331bc49 [ 23.911400][ T479] RDX: 0000000000000000 RSI: 0000000000801000 RDI: 0000000000000000 [ 23.911401][ T479] RBP: 00007f6df2adaf70 R08: 0000000000000001 R09: 00007f6df2adb6c0 [ 23.911402][ T479] R10: 0000000000000008 R11: 0000000000000246 R12: 00007f6df22db000 [ 23.911403][ T479] R13: 00007fffd7884300 R14: 0000000000000002 R15: 00007fffd7884407 [ 23.911405][ T479] [ 24.078610][ T350] tun1: deleting peer with id 10, reason 4 [ 24.079045][ T357] tun2: deleting peer with id 11, reason 4 [ 24.079055][ T364] tun3: deleting peer with id 12, reason 4 [ 24.079299][ T387] tun0: deleting peer with id 6, reason 4 [ 24.079495][ T379] tun5: deleting peer with id 14, reason 4 [ 24.079841][ T371] tun4: deleting peer with id 13, reason 4 [ 24.081011][ T386] tun6: deleting peer with id 15, reason 4 [ 24.084510][ T387] tun0: deleting peer with id 5, reason 4 [ 24.087922][ T387] tun0: deleting peer with id 4, reason 4 [ 24.093238][ T387] tun0: deleting peer with id 3, reason 4 [ 24.094968][ T387] tun0: deleting peer with id 2, reason 4 [ 24.103915][ T387] tun0: deleting peer with id 1, reason 4