[ 12.883898][ T214] ip (214) used greatest stack depth: 23928 bytes left [ 12.883916][ T214] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 12.883918][ T214] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 214, name: ip [ 12.883920][ T214] preempt_count: 2, expected: 0 [ 12.883921][ T214] RCU nest depth: 0, expected: 0 [ 12.883921][ T214] locks held by ip/214: 5, last CPU#0: [ 12.883923][ T214] #0: ffffffffa4e167b8 (low_water_lock){+.+.}-{3:3}, at: do_exit+0x887/0xdc0 [ 12.883935][ T214] #1: ffffffffa4f7ddc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 12.883940][ T214] #2: ffffffffa4f7de38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 12.883944][ T214] #3: ffffffffa4e9d760 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 12.883948][ T214] #4: ffffffffa4e9d660 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 12.883952][ T214] irq event stamp: 19582 [ 12.883953][ T214] hardirqs last enabled at (19581): [] __down_trylock_console_sem+0x86/0xa0 [ 12.883956][ T214] hardirqs last disabled at (19582): [] console_emit_next_record+0x3d4/0x4c0 [ 12.883958][ T214] softirqs last enabled at (18018): [] netlink_release+0x17b/0xcf0 [ 12.883962][ T214] softirqs last disabled at (18016): [] netlink_release+0xd2/0xcf0 [ 12.883965][ T214] Preemption disabled at: [ 12.883965][ T214] [<0000000000000000>] 0x0 [ 12.883972][ T214] CPU: 0 UID: 0 PID: 214 Comm: ip Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 12.883976][ T214] Tainted: [W]=WARN [ 12.883976][ T214] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 12.883978][ T214] Call Trace: [ 12.883980][ T214] [ 12.883981][ T214] dump_stack_lvl+0x6f/0xa0 [ 12.883988][ T214] __might_resched.cold+0x1fe/0x2c1 [ 12.883992][ T214] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 12.883996][ T214] ? __kmalloc_noprof+0xdb/0x760 [ 12.884000][ T214] __kmalloc_noprof+0x443/0x760 [ 12.884002][ T214] ? alloc_buf.isra.0+0x4b/0x260 [ 12.884010][ T214] ? do_raw_spin_unlock+0x59/0x250 [ 12.884013][ T214] alloc_buf.isra.0+0x4b/0x260 [ 12.884017][ T214] put_chars+0x1e1/0x2f0 [ 12.884019][ T214] ? __send_to_port+0x420/0x420 [ 12.884020][ T214] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 12.884024][ T214] ? validate_chain+0x38b/0xc20 [ 12.884029][ T214] hvc_console_print+0x292/0x780 [ 12.884037][ T214] ? hvc_write+0x3a0/0x3a0 [ 12.884039][ T214] ? rcu_is_watching+0x16/0xd0 [ 12.884041][ T214] ? lock_acquire+0x13c/0x160 [ 12.884045][ T214] console_emit_next_record+0x22f/0x4c0 [ 12.884049][ T214] ? devkmsg_read+0x4b0/0x4b0 [ 12.884051][ T214] ? console_flush_one_record+0x106/0x710 [ 12.884054][ T214] ? rcu_is_watching+0x16/0xd0 [ 12.884056][ T214] ? lock_acquire+0x13c/0x160 [ 12.884060][ T214] console_flush_one_record+0x46f/0x710 [ 12.884064][ T214] ? console_emit_next_record+0x4c0/0x4c0 [ 12.884066][ T214] ? __lock_acquire+0x518/0xc20 [ 12.884071][ T214] console_unlock+0xee/0x1f0 [ 12.884074][ T214] ? console_flush_one_record+0x710/0x710 [ 12.884075][ T214] ? rcu_is_watching+0x16/0xd0 [ 12.884077][ T214] ? lock_acquire+0xe0/0x160 [ 12.884081][ T214] ? __down_trylock_console_sem+0x5e/0xa0 [ 12.884082][ T214] ? vprintk_emit+0x320/0x3e0 [ 12.884085][ T214] vprintk_emit+0x37c/0x3e0 [ 12.884088][ T214] ? wake_up_klogd_work_func+0x90/0x90 [ 12.884091][ T214] ? __lock_acquire+0x518/0xc20 [ 12.884094][ T214] _printk+0xc7/0x100 [ 12.884098][ T214] ? snapshot_read.cold+0x21/0x21 [ 12.884101][ T214] ? do_raw_spin_lock+0x131/0x280 [ 12.884103][ T214] ? __rwlock_init+0x150/0x150 [ 12.884107][ T214] ? do_raw_spin_lock+0x131/0x280 [ 12.884110][ T214] do_exit.cold+0x82/0x9c [ 12.884113][ T214] ? exit_notify+0x890/0x890 [ 12.884115][ T214] ? __lock_release.isra.0+0x69/0x1a0 [ 12.884117][ T214] ? rcu_is_watching+0x16/0xd0 [ 12.884121][ T214] do_group_exit+0xb8/0x370 [ 12.884123][ T214] __x64_sys_exit_group+0x3c/0x50 [ 12.884125][ T214] x64_sys_call+0x1567/0x1570 [ 12.884128][ T214] do_syscall_64+0xff/0x530 [ 12.884132][ T214] ? exc_page_fault+0xee/0x100 [ 12.884134][ T214] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 12.884137][ T214] RIP: 0033:0x7fc86e6bd1b8 [ 12.884139][ T214] Code: Unable to access opcode bytes at 0x7fc86e6bd18e. [ 12.884140][ T214] RSP: 002b:00007ffe2fa61158 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7 [ 12.884142][ T214] RAX: ffffffffffffffda RBX: 00007fc86e7edf88 RCX: 00007fc86e6bd1b8 [ 12.884143][ T214] RDX: 00007fc86e407fc8 RSI: fffffffffffffeb8 RDI: 0000000000000000 [ 12.884144][ T214] RBP: 00007ffe2fa611b0 R08: 0000000000000000 R09: 0000000000000050 [ 12.884145][ T214] R10: 00007ffe2fa60f70 R11: 0000000000000246 R12: 0000000000000001 [ 12.884146][ T214] R13: 0000000000000000 R14: 00007fc86e7ec680 R15: 00007fc86e7edfa0 [ 12.884152][ T214] [ 26.004329][ C0] clocksource: Watchdog remote CPU 2 read timed out [ 26.004367][ C0] [ 26.004368][ C0] ======================================================== [ 26.004369][ C0] WARNING: possible irq lock inversion dependency detected [ 26.004371][ C0] 7.2.0-virtme #1 Tainted: G W [ 26.004373][ C0] -------------------------------------------------------- [ 26.004374][ C0] udpgso_bench_tx/277 just changed the state of lock: [ 26.004375][ C0] ffffffffa4e9d760 (console_owner){..-.}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 26.004388][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 26.004389][ C0] (fs_reclaim){+.+.}-{0:0} [ 26.004391][ C0] [ 26.004391][ C0] [ 26.004391][ C0] and interrupts could create inverse lock ordering between them. [ 26.004391][ C0] [ 26.004391][ C0] [ 26.004391][ C0] other info that might help us debug this: [ 26.004392][ C0] Possible interrupt unsafe locking scenario: [ 26.004392][ C0] [ 26.004393][ C0] CPU0 CPU1 [ 26.004393][ C0] ---- ---- [ 26.004393][ C0] lock(fs_reclaim); [ 26.004394][ C0] local_irq_disable(); [ 26.004395][ C0] lock(console_owner); [ 26.004396][ C0] lock(fs_reclaim); [ 26.004396][ C0] [ 26.004397][ C0] lock(console_owner); [ 26.004398][ C0] [ 26.004398][ C0] *** DEADLOCK *** [ 26.004398][ C0] [ 26.004398][ C0] locks held by udpgso_bench_tx/277: 6, last CPU#0: [ 26.004399][ C0] #0: ffffffffa4f94c00 (rcu_read_lock){....}-{1:3}, at: ip_output+0xa9/0x660 [ 26.004405][ C0] #1: ffffffffa4f94c00 (rcu_read_lock){....}-{1:3}, at: ip_finish_output2+0x2c6/0x1c60 [ 26.004408][ C0] #2: ffa0000000007ca8 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 26.004413][ C0] #3: ffffffffa4fe29f8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 26.004416][ C0] #4: ffffffffa4f7ddc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 26.004419][ C0] #5: ffffffffa4f7de38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 26.004422][ C0] [ 26.004422][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 26.004427][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 26.004429][ C0] HARDIRQ-ON-W at: [ 26.004430][ C0] __lock_acquire+0x388/0xc20 [ 26.004434][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.004435][ C0] fs_reclaim_acquire+0xd5/0x120 [ 26.004439][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 26.004441][ C0] kthread_create_worker_on_node+0xea/0x210 [ 26.004443][ C0] workqueue_init+0x2a/0x680 [ 26.004447][ C0] kernel_init_freeable+0x2fe/0x630 [ 26.004451][ C0] kernel_init+0x21/0x150 [ 26.004454][ C0] ret_from_fork+0x474/0x6b0 [ 26.004457][ C0] ret_from_fork_asm+0x11/0x20 [ 26.004460][ C0] SOFTIRQ-ON-W at: [ 26.004461][ C0] __lock_acquire+0x388/0xc20 [ 26.004462][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.004464][ C0] fs_reclaim_acquire+0xd5/0x120 [ 26.004465][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 26.004466][ C0] kthread_create_worker_on_node+0xea/0x210 [ 26.004467][ C0] workqueue_init+0x2a/0x680 [ 26.004469][ C0] kernel_init_freeable+0x2fe/0x630 [ 26.004470][ C0] kernel_init+0x21/0x150 [ 26.004472][ C0] ret_from_fork+0x474/0x6b0 [ 26.004473][ C0] ret_from_fork_asm+0x11/0x20 [ 26.004474][ C0] INITIAL USE at: [ 26.004475][ C0] __lock_acquire+0x388/0xc20 [ 26.004476][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.004478][ C0] fs_reclaim_acquire+0xd5/0x120 [ 26.004479][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 26.004480][ C0] kthread_create_worker_on_node+0xea/0x210 [ 26.004481][ C0] workqueue_init+0x2a/0x680 [ 26.004483][ C0] kernel_init_freeable+0x2fe/0x630 [ 26.004484][ C0] kernel_init+0x21/0x150 [ 26.004486][ C0] ret_from_fork+0x474/0x6b0 [ 26.004487][ C0] ret_from_fork_asm+0x11/0x20 [ 26.004488][ C0] } [ 26.004488][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 26.004492][ C0] ... acquired at: [ 26.004493][ C0] __lock_acquire+0x518/0xc20 [ 26.004494][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.004495][ C0] fs_reclaim_acquire+0xd5/0x120 [ 26.004497][ C0] __kmalloc_noprof+0xd3/0x760 [ 26.004498][ C0] alloc_buf.isra.0+0x4b/0x260 [ 26.004502][ C0] put_chars+0x1e1/0x2f0 [ 26.004503][ C0] hvc_console_print+0x292/0x780 [ 26.004506][ C0] console_emit_next_record+0x22f/0x4c0 [ 26.004508][ C0] console_flush_one_record+0x46f/0x710 [ 26.004509][ C0] console_unlock+0xee/0x1f0 [ 26.004511][ C0] vprintk_emit+0x37c/0x3e0 [ 26.004511][ C0] _printk+0xc7/0x100 [ 26.004515][ C0] i8042_pnp_init+0xf7/0x3c0 [ 26.004517][ C0] i8042_platform_init+0x3f9/0x460 [ 26.004519][ C0] i8042_init+0x45/0x130 [ 26.004520][ C0] do_one_initcall+0x124/0x4f0 [ 26.004521][ C0] kernel_init_freeable+0x596/0x630 [ 26.004523][ C0] kernel_init+0x21/0x150 [ 26.004524][ C0] ret_from_fork+0x474/0x6b0 [ 26.004525][ C0] ret_from_fork_asm+0x11/0x20 [ 26.004527][ C0] [ 26.004527][ C0] -> (console_owner){..-.}-{0:0} { [ 26.004529][ C0] IN-SOFTIRQ-W at: [ 26.004529][ C0] __lock_acquire+0x388/0xc20 [ 26.004531][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.004532][ C0] console_lock_spinning_enable+0x5c/0x60 [ 26.004534][ C0] console_emit_next_record+0x1d1/0x4c0 [ 26.004535][ C0] console_flush_one_record+0x46f/0x710 [ 26.004537][ C0] console_unlock+0xee/0x1f0 [ 26.004538][ C0] vprintk_emit+0x37c/0x3e0 [ 26.004539][ C0] _printk+0xc7/0x100 [ 26.004540][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 26.004543][ C0] call_timer_fn+0x160/0x4d0 [ 26.004544][ C0] __run_timers+0x68f/0xaa0 [ 26.004546][ C0] run_timer_softirq+0xf0/0x160 [ 26.004547][ C0] handle_softirqs+0x1d3/0x900 [ 26.004550][ C0] do_softirq+0xac/0xe0 [ 26.004551][ C0] __local_bh_enable_ip+0x118/0x150 [ 26.004552][ C0] __dev_queue_xmit+0x989/0x1b90 [ 26.004555][ C0] ip_finish_output2+0x7c4/0x1c60 [ 26.004556][ C0] ip_output+0x1ca/0x660 [ 26.004557][ C0] ip_send_skb+0xa3/0x1c0 [ 26.004558][ C0] udp_send_skb+0x87a/0x1270 [ 26.004561][ C0] udp_sendmsg+0x164e/0x2680 [ 26.004562][ C0] __sock_sendmsg+0xce/0x190 [ 26.004565][ C0] ____sys_sendmsg+0x61a/0x860 [ 26.004566][ C0] ___sys_sendmsg+0x14e/0x1d0 [ 26.004568][ C0] __sys_sendmsg+0x12c/0x1d0 [ 26.004569][ C0] do_syscall_64+0xff/0x530 [ 26.004572][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 26.004573][ C0] INITIAL USE at: [ 26.004574][ C0] } [ 26.004574][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 26.004577][ C0] ... acquired at: [ 26.004577][ C0] mark_lock+0x1d7/0xa00 [ 26.004578][ C0] mark_usage+0x42/0x170 [ 26.004580][ C0] __lock_acquire+0x388/0xc20 [ 26.004581][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.004582][ C0] console_lock_spinning_enable+0x5c/0x60 [ 26.004584][ C0] console_emit_next_record+0x1d1/0x4c0 [ 26.004585][ C0] console_flush_one_record+0x46f/0x710 [ 26.004587][ C0] console_unlock+0xee/0x1f0 [ 26.004588][ C0] vprintk_emit+0x37c/0x3e0 [ 26.004589][ C0] _printk+0xc7/0x100 [ 26.004590][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 26.004591][ C0] call_timer_fn+0x160/0x4d0 [ 26.004593][ C0] __run_timers+0x68f/0xaa0 [ 26.004594][ C0] run_timer_softirq+0xf0/0x160 [ 26.004596][ C0] handle_softirqs+0x1d3/0x900 [ 26.004597][ C0] do_softirq+0xac/0xe0 [ 26.004598][ C0] __local_bh_enable_ip+0x118/0x150 [ 26.004599][ C0] __dev_queue_xmit+0x989/0x1b90 [ 26.004601][ C0] ip_finish_output2+0x7c4/0x1c60 [ 26.004602][ C0] ip_output+0x1ca/0x660 [ 26.004603][ C0] ip_send_skb+0xa3/0x1c0 [ 26.004604][ C0] udp_send_skb+0x87a/0x1270 [ 26.004605][ C0] udp_sendmsg+0x164e/0x2680 [ 26.004606][ C0] __sock_sendmsg+0xce/0x190 [ 26.004607][ C0] ____sys_sendmsg+0x61a/0x860 [ 26.004608][ C0] ___sys_sendmsg+0x14e/0x1d0 [ 26.004609][ C0] __sys_sendmsg+0x12c/0x1d0 [ 26.004611][ C0] do_syscall_64+0xff/0x530 [ 26.004612][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 26.004613][ C0] [ 26.004614][ C0] [ 26.004614][ C0] stack backtrace: [ 26.004617][ C0] CPU: 0 UID: 0 PID: 277 Comm: udpgso_bench_tx Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 26.004620][ C0] Tainted: [W]=WARN [ 26.004620][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 26.004623][ C0] Call Trace: [ 26.004624][ C0] [ 26.004625][ C0] dump_stack_lvl+0x6f/0xa0 [ 26.004629][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 26.004631][ C0] mark_lock_irq+0x989/0x9c0 [ 26.004634][ C0] mark_lock+0x1d7/0xa00 [ 26.004636][ C0] mark_usage+0x42/0x170 [ 26.004638][ C0] __lock_acquire+0x388/0xc20 [ 26.004640][ C0] lock_acquire.part.0+0xd4/0x280 [ 26.004642][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 26.004644][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004646][ C0] ? lock_acquire+0x13c/0x160 [ 26.004648][ C0] console_lock_spinning_enable+0x5c/0x60 [ 26.004650][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 26.004651][ C0] console_emit_next_record+0x1d1/0x4c0 [ 26.004654][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 26.004655][ C0] ? console_flush_one_record+0x106/0x710 [ 26.004657][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004658][ C0] ? lock_acquire+0x13c/0x160 [ 26.004660][ C0] console_flush_one_record+0x46f/0x710 [ 26.004662][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 26.004664][ C0] ? __lock_acquire+0x518/0xc20 [ 26.004666][ C0] console_unlock+0xee/0x1f0 [ 26.004668][ C0] ? console_flush_one_record+0x710/0x710 [ 26.004670][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004671][ C0] ? lock_acquire+0xe0/0x160 [ 26.004673][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 26.004675][ C0] ? vprintk_emit+0x320/0x3e0 [ 26.004676][ C0] vprintk_emit+0x37c/0x3e0 [ 26.004677][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 26.004679][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 26.004684][ C0] _printk+0xc7/0x100 [ 26.004686][ C0] ? snapshot_read.cold+0x21/0x21 [ 26.004688][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 26.004690][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.004692][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 26.004693][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 26.004695][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 26.004697][ C0] call_timer_fn+0x160/0x4d0 [ 26.004698][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004700][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 26.004702][ C0] ? find_held_lock+0x2b/0x80 [ 26.004703][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.004705][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004707][ C0] __run_timers+0x68f/0xaa0 [ 26.004708][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 26.004711][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 26.004712][ C0] ? __lock_acquire+0x518/0xc20 [ 26.004715][ C0] ? __rwlock_init+0x150/0x150 [ 26.004718][ C0] run_timer_softirq+0xf0/0x160 [ 26.004720][ C0] ? __run_timers+0xaa0/0xaa0 [ 26.004722][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004723][ C0] handle_softirqs+0x1d3/0x900 [ 26.004725][ C0] ? _local_bh_enable+0xc0/0xc0 [ 26.004726][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 26.004728][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004729][ C0] ? __dev_queue_xmit+0x974/0x1b90 [ 26.004731][ C0] do_softirq+0xac/0xe0 [ 26.004733][ C0] [ 26.004733][ C0] [ 26.004734][ C0] __local_bh_enable_ip+0x118/0x150 [ 26.004735][ C0] __dev_queue_xmit+0x989/0x1b90 [ 26.004737][ C0] ? sk_reset_timer+0x90/0x90 [ 26.004740][ C0] ? netdev_core_pick_tx+0x2c0/0x2c0 [ 26.004741][ C0] ? lock_acquire.part.0+0x60/0x280 [ 26.004743][ C0] ? find_held_lock+0x2b/0x80 [ 26.004744][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.004746][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004747][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004748][ C0] ? __asan_memcpy+0x3c/0x60 [ 26.004751][ C0] ? neigh_hh_output+0x152/0x4c0 [ 26.004753][ C0] ip_finish_output2+0x7c4/0x1c60 [ 26.004755][ C0] ? ip_dst_mtu_maybe_forward+0x2c7/0x720 [ 26.004756][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 26.004758][ C0] ? ip_fragment.constprop.0+0x2c0/0x2c0 [ 26.004759][ C0] ? skb_gso_validate_network_len+0x96/0x2a0 [ 26.004762][ C0] ip_output+0x1ca/0x660 [ 26.004764][ C0] ? ip_finish_output+0x460/0x460 [ 26.004765][ C0] ? ip_make_skb+0x26a/0x300 [ 26.004767][ C0] ? ip_frag_init+0x4f0/0x4f0 [ 26.004768][ C0] ? ip_flush_pending_frames+0x20/0x20 [ 26.004770][ C0] ip_send_skb+0xa3/0x1c0 [ 26.004772][ C0] udp_send_skb+0x87a/0x1270 [ 26.004775][ C0] udp_sendmsg+0x164e/0x2680 [ 26.004777][ C0] ? udp_cmsg_send+0x360/0x360 [ 26.004778][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 26.004780][ C0] ? validate_chain+0x38b/0xc20 [ 26.004782][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 26.004783][ C0] ? validate_chain+0x38b/0xc20 [ 26.004785][ C0] ? __lock_acquire+0x518/0xc20 [ 26.004787][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 26.004790][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.004792][ C0] __sock_sendmsg+0xce/0x190 [ 26.004794][ C0] ____sys_sendmsg+0x61a/0x860 [ 26.004795][ C0] ? copy_msghdr_from_user+0x279/0x420 [ 26.004797][ C0] ? sock_write_iter+0x400/0x400 [ 26.004798][ C0] ? move_addr_to_kernel+0x40/0x40 [ 26.004800][ C0] ? pick_eevdf+0x1b0/0x800 [ 26.004803][ C0] ? trace_kfree+0xd2/0x100 [ 26.004805][ C0] ? kfree+0x22/0x590 [ 26.004806][ C0] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 26.004808][ C0] ___sys_sendmsg+0x14e/0x1d0 [ 26.004809][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 26.004811][ C0] ? copy_msghdr_from_user+0x420/0x420 [ 26.004813][ C0] ? __lock_acquire+0x518/0xc20 [ 26.004816][ C0] ? trace_sched_exit_tp+0x9b/0x160 [ 26.004819][ C0] ? __schedule+0xfa5/0x20e0 [ 26.004822][ C0] __sys_sendmsg+0x12c/0x1d0 [ 26.004824][ C0] ? __sys_sendmsg_sock+0x20/0x20 [ 26.004826][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004828][ C0] do_syscall_64+0xff/0x530 [ 26.004829][ C0] ? irq_exit_rcu+0x1a/0x30 [ 26.004831][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 26.004833][ C0] RIP: 0033:0x7fd4bd40754e [ 26.004836][ C0] Code: 4d 89 d8 e8 b4 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 26.004839][ C0] RSP: 002b:00007ffdf209d790 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 26.004842][ C0] RAX: ffffffffffffffda RBX: 000001a046c168e1 RCX: 00007fd4bd40754e [ 26.004843][ C0] RDX: 0000000000000000 RSI: 00007ffdf209d890 RDI: 0000000000000005 [ 26.004844][ C0] RBP: 00007ffdf209d7a0 R08: 0000000000000000 R09: 0000000000000000 [ 26.004845][ C0] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000005 [ 26.004845][ C0] R13: 000000000000f180 R14: 0000000000405140 R15: 0000000000404e00 [ 26.004848][ C0] [ 26.004853][ C0] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 26.004854][ C0] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 277, name: udpgso_bench_tx [ 26.004855][ C0] preempt_count: 103, expected: 0 [ 26.004856][ C0] RCU nest depth: 2, expected: 0 [ 26.004857][ C0] INFO: lockdep is turned off. [ 26.004857][ C0] irq event stamp: 2364529 [ 26.004858][ C0] hardirqs last enabled at (2364528): [] __down_trylock_console_sem+0x86/0xa0 [ 26.004860][ C0] hardirqs last disabled at (2364529): [] console_emit_next_record+0x3d4/0x4c0 [ 26.004862][ C0] softirqs last enabled at (2363382): [] __dev_queue_xmit+0x974/0x1b90 [ 26.004864][ C0] softirqs last disabled at (2363383): [] do_softirq+0xac/0xe0 [ 26.004865][ C0] Preemption disabled at: [ 26.004866][ C0] [] __dev_queue_xmit+0x20c/0x1b90 [ 26.004869][ C0] CPU: 0 UID: 0 PID: 277 Comm: udpgso_bench_tx Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 26.004871][ C0] Tainted: [W]=WARN [ 26.004871][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 26.004872][ C0] Call Trace: [ 26.004873][ C0] [ 26.004873][ C0] dump_stack_lvl+0x6f/0xa0 [ 26.004876][ C0] ? __dev_queue_xmit+0x20c/0x1b90 [ 26.004877][ C0] __might_resched.cold+0x1fe/0x2c1 [ 26.004880][ C0] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 26.004882][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004884][ C0] __kmalloc_noprof+0x443/0x760 [ 26.004885][ C0] ? __rwlock_init+0x150/0x150 [ 26.004886][ C0] ? alloc_buf.isra.0+0x4b/0x260 [ 26.004889][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 26.004890][ C0] alloc_buf.isra.0+0x4b/0x260 [ 26.004893][ C0] put_chars+0x1e1/0x2f0 [ 26.004895][ C0] ? __send_to_port+0x420/0x420 [ 26.004897][ C0] hvc_console_print+0x292/0x780 [ 26.004899][ C0] ? __lock_acquire+0x388/0xc20 [ 26.004901][ C0] ? hvc_write+0x3a0/0x3a0 [ 26.004903][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004904][ C0] ? lock_acquire+0x13c/0x160 [ 26.004906][ C0] console_emit_next_record+0x22f/0x4c0 [ 26.004909][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 26.004910][ C0] ? console_flush_one_record+0x106/0x710 [ 26.004912][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004913][ C0] ? lock_acquire+0x13c/0x160 [ 26.004915][ C0] console_flush_one_record+0x46f/0x710 [ 26.004917][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 26.004919][ C0] ? __lock_acquire+0x518/0xc20 [ 26.004921][ C0] console_unlock+0xee/0x1f0 [ 26.004923][ C0] ? console_flush_one_record+0x710/0x710 [ 26.004925][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004926][ C0] ? lock_acquire+0xe0/0x160 [ 26.004928][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 26.004929][ C0] ? vprintk_emit+0x320/0x3e0 [ 26.004931][ C0] vprintk_emit+0x37c/0x3e0 [ 26.004932][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 26.004934][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 26.004935][ C0] _printk+0xc7/0x100 [ 26.004937][ C0] ? snapshot_read.cold+0x21/0x21 [ 26.004939][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 26.004940][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.004943][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 26.004944][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 26.004946][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 26.004947][ C0] call_timer_fn+0x160/0x4d0 [ 26.004949][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004950][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 26.004952][ C0] ? find_held_lock+0x2b/0x80 [ 26.004953][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.004955][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004957][ C0] __run_timers+0x68f/0xaa0 [ 26.004958][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 26.004960][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 26.004962][ C0] ? __lock_acquire+0x518/0xc20 [ 26.004965][ C0] ? __rwlock_init+0x150/0x150 [ 26.004967][ C0] run_timer_softirq+0xf0/0x160 [ 26.004969][ C0] ? __run_timers+0xaa0/0xaa0 [ 26.004971][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004972][ C0] handle_softirqs+0x1d3/0x900 [ 26.004974][ C0] ? _local_bh_enable+0xc0/0xc0 [ 26.004976][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 26.004977][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004978][ C0] ? __dev_queue_xmit+0x974/0x1b90 [ 26.004980][ C0] do_softirq+0xac/0xe0 [ 26.004981][ C0] [ 26.004982][ C0] [ 26.004983][ C0] __local_bh_enable_ip+0x118/0x150 [ 26.004984][ C0] __dev_queue_xmit+0x989/0x1b90 [ 26.004986][ C0] ? sk_reset_timer+0x90/0x90 [ 26.004988][ C0] ? netdev_core_pick_tx+0x2c0/0x2c0 [ 26.004990][ C0] ? lock_acquire.part.0+0x60/0x280 [ 26.004991][ C0] ? find_held_lock+0x2b/0x80 [ 26.004992][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.004994][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004995][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.004996][ C0] ? __asan_memcpy+0x3c/0x60 [ 26.004998][ C0] ? neigh_hh_output+0x152/0x4c0 [ 26.004999][ C0] ip_finish_output2+0x7c4/0x1c60 [ 26.005001][ C0] ? ip_dst_mtu_maybe_forward+0x2c7/0x720 [ 26.005002][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 26.005004][ C0] ? ip_fragment.constprop.0+0x2c0/0x2c0 [ 26.005005][ C0] ? skb_gso_validate_network_len+0x96/0x2a0 [ 26.005007][ C0] ip_output+0x1ca/0x660 [ 26.005008][ C0] ? ip_finish_output+0x460/0x460 [ 26.005011][ C0] ? ip_make_skb+0x26a/0x300 [ 26.005013][ C0] ? ip_frag_init+0x4f0/0x4f0 [ 26.005014][ C0] ? ip_flush_pending_frames+0x20/0x20 [ 26.005016][ C0] ip_send_skb+0xa3/0x1c0 [ 26.005018][ C0] udp_send_skb+0x87a/0x1270 [ 26.005020][ C0] udp_sendmsg+0x164e/0x2680 [ 26.005022][ C0] ? udp_cmsg_send+0x360/0x360 [ 26.005023][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 26.005025][ C0] ? validate_chain+0x38b/0xc20 [ 26.005027][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 26.005028][ C0] ? validate_chain+0x38b/0xc20 [ 26.005030][ C0] ? __lock_acquire+0x518/0xc20 [ 26.005032][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 26.005034][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 26.005036][ C0] __sock_sendmsg+0xce/0x190 [ 26.005038][ C0] ____sys_sendmsg+0x61a/0x860 [ 26.005040][ C0] ? copy_msghdr_from_user+0x279/0x420 [ 26.005041][ C0] ? sock_write_iter+0x400/0x400 [ 26.005043][ C0] ? move_addr_to_kernel+0x40/0x40 [ 26.005044][ C0] ? pick_eevdf+0x1b0/0x800 [ 26.005046][ C0] ? trace_kfree+0xd2/0x100 [ 26.005048][ C0] ? kfree+0x22/0x590 [ 26.005048][ C0] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 26.005050][ C0] ___sys_sendmsg+0x14e/0x1d0 [ 26.005051][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 26.005053][ C0] ? copy_msghdr_from_user+0x420/0x420 [ 26.005055][ C0] ? __lock_acquire+0x518/0xc20 [ 26.005058][ C0] ? trace_sched_exit_tp+0x9b/0x160 [ 26.005060][ C0] ? __schedule+0xfa5/0x20e0 [ 26.005062][ C0] __sys_sendmsg+0x12c/0x1d0 [ 26.005064][ C0] ? __sys_sendmsg_sock+0x20/0x20 [ 26.005067][ C0] ? rcu_is_watching+0x16/0xd0 [ 26.005068][ C0] do_syscall_64+0xff/0x530 [ 26.005070][ C0] ? irq_exit_rcu+0x1a/0x30 [ 26.005071][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 26.005073][ C0] RIP: 0033:0x7fd4bd40754e [ 26.005074][ C0] Code: 4d 89 d8 e8 b4 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 26.005075][ C0] RSP: 002b:00007ffdf209d790 EFLAGS: 00000202 ORIG_RAX: 000000000000002e [ 26.005076][ C0] RAX: ffffffffffffffda RBX: 000001a046c168e1 RCX: 00007fd4bd40754e [ 26.005077][ C0] RDX: 0000000000000000 RSI: 00007ffdf209d890 RDI: 0000000000000005 [ 26.005077][ C0] RBP: 00007ffdf209d7a0 R08: 0000000000000000 R09: 0000000000000000 [ 26.005078][ C0] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000005 [ 26.005079][ C0] R13: 000000000000f180 R14: 0000000000405140 R15: 0000000000404e00 [ 26.005081][ C0]