[ 21.992013][ C0] clocksource: Watchdog remote CPU 2 read timed out [ 21.992379][ C0] [ 21.992380][ C0] ======================================================== [ 21.992381][ C0] WARNING: possible irq lock inversion dependency detected [ 21.992383][ C0] 7.2.0-virtme #1 Tainted: G W [ 21.992385][ C0] -------------------------------------------------------- [ 21.992385][ C0] modprobe/272 just changed the state of lock: [ 21.992386][ C0] ffffffffb1a9d760 (console_owner){..-.}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 21.992399][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 21.992400][ C0] (fs_reclaim){+.+.}-{0:0} [ 21.992401][ C0] [ 21.992401][ C0] [ 21.992401][ C0] and interrupts could create inverse lock ordering between them. [ 21.992401][ C0] [ 21.992402][ C0] [ 21.992402][ C0] other info that might help us debug this: [ 21.992402][ C0] Possible interrupt unsafe locking scenario: [ 21.992402][ C0] [ 21.992403][ C0] CPU0 CPU1 [ 21.992404][ C0] ---- ---- [ 21.992404][ C0] lock(fs_reclaim); [ 21.992405][ C0] local_irq_disable(); [ 21.992406][ C0] lock(console_owner); [ 21.992406][ C0] lock(fs_reclaim); [ 21.992407][ C0] [ 21.992407][ C0] lock(console_owner); [ 21.992408][ C0] [ 21.992408][ C0] *** DEADLOCK *** [ 21.992408][ C0] [ 21.992409][ C0] locks held by modprobe/272: 5, last CPU#0: [ 21.992410][ C0] #0: ff11000005f485d8 (&fsvq->lock){+.+.}-{3:3}, at: virtio_fs_enqueue_req+0x5a2/0xfa0 [ 21.992416][ C0] #1: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 21.992421][ C0] #2: ffffffffb1be29f8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 21.992425][ C0] #3: ffffffffb1b7ddc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 21.992428][ C0] #4: ffffffffb1b7de38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 21.992431][ C0] [ 21.992431][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 21.992436][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 21.992438][ C0] HARDIRQ-ON-W at: [ 21.992440][ C0] __lock_acquire+0x388/0xc20 [ 21.992443][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.992445][ C0] fs_reclaim_acquire+0xd5/0x120 [ 21.992448][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 21.992450][ C0] kthread_create_worker_on_node+0xea/0x210 [ 21.992453][ C0] workqueue_init+0x2a/0x680 [ 21.992457][ C0] kernel_init_freeable+0x2fe/0x630 [ 21.992460][ C0] kernel_init+0x21/0x150 [ 21.992464][ C0] ret_from_fork+0x474/0x6b0 [ 21.992471][ C0] ret_from_fork_asm+0x11/0x20 [ 21.992475][ C0] SOFTIRQ-ON-W at: [ 21.992475][ C0] __lock_acquire+0x388/0xc20 [ 21.992477][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.992478][ C0] fs_reclaim_acquire+0xd5/0x120 [ 21.992480][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 21.992481][ C0] kthread_create_worker_on_node+0xea/0x210 [ 21.992482][ C0] workqueue_init+0x2a/0x680 [ 21.992484][ C0] kernel_init_freeable+0x2fe/0x630 [ 21.992485][ C0] kernel_init+0x21/0x150 [ 21.992487][ C0] ret_from_fork+0x474/0x6b0 [ 21.992488][ C0] ret_from_fork_asm+0x11/0x20 [ 21.992489][ C0] INITIAL USE at: [ 21.992490][ C0] __lock_acquire+0x388/0xc20 [ 21.992491][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.992493][ C0] fs_reclaim_acquire+0xd5/0x120 [ 21.992494][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 21.992495][ C0] kthread_create_worker_on_node+0xea/0x210 [ 21.992496][ C0] workqueue_init+0x2a/0x680 [ 21.992498][ C0] kernel_init_freeable+0x2fe/0x630 [ 21.992499][ C0] kernel_init+0x21/0x150 [ 21.992501][ C0] ret_from_fork+0x474/0x6b0 [ 21.992502][ C0] ret_from_fork_asm+0x11/0x20 [ 21.992503][ C0] } [ 21.992504][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 21.992508][ C0] ... acquired at: [ 21.992508][ C0] __lock_acquire+0x518/0xc20 [ 21.992510][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.992511][ C0] fs_reclaim_acquire+0xd5/0x120 [ 21.992512][ C0] __kmalloc_noprof+0xd3/0x760 [ 21.992513][ C0] alloc_buf.isra.0+0x4b/0x260 [ 21.992517][ C0] put_chars+0x1e1/0x2f0 [ 21.992518][ C0] hvc_console_print+0x292/0x780 [ 21.992521][ C0] console_emit_next_record+0x22f/0x4c0 [ 21.992523][ C0] console_flush_one_record+0x46f/0x710 [ 21.992525][ C0] console_unlock+0xee/0x1f0 [ 21.992526][ C0] vprintk_emit+0x37c/0x3e0 [ 21.992527][ C0] _printk+0xc7/0x100 [ 21.992530][ C0] tun_init+0x24/0xb0 [ 21.992533][ C0] do_one_initcall+0x124/0x4f0 [ 21.992534][ C0] kernel_init_freeable+0x596/0x630 [ 21.992535][ C0] kernel_init+0x21/0x150 [ 21.992537][ C0] ret_from_fork+0x474/0x6b0 [ 21.992538][ C0] ret_from_fork_asm+0x11/0x20 [ 21.992539][ C0] [ 21.992539][ C0] -> (console_owner){..-.}-{0:0} { [ 21.992541][ C0] IN-SOFTIRQ-W at: [ 21.992542][ C0] __lock_acquire+0x388/0xc20 [ 21.992543][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.992545][ C0] console_lock_spinning_enable+0x5c/0x60 [ 21.992546][ C0] console_emit_next_record+0x1d1/0x4c0 [ 21.992548][ C0] console_flush_one_record+0x46f/0x710 [ 21.992549][ C0] console_unlock+0xee/0x1f0 [ 21.992551][ C0] vprintk_emit+0x37c/0x3e0 [ 21.992552][ C0] _printk+0xc7/0x100 [ 21.992553][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 21.992555][ C0] call_timer_fn+0x160/0x4d0 [ 21.992557][ C0] __run_timers+0x68f/0xaa0 [ 21.992558][ C0] run_timer_softirq+0xf0/0x160 [ 21.992560][ C0] handle_softirqs+0x1d3/0x900 [ 21.992562][ C0] __irq_exit_rcu+0x145/0x1c0 [ 21.992564][ C0] irq_exit_rcu+0xe/0x30 [ 21.992565][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 21.992567][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 21.992568][ C0] _raw_spin_unlock_irqrestore+0x36/0x80 [ 21.992570][ C0] get_from_partial_node+0x21d/0x500 [ 21.992572][ C0] ___slab_alloc+0x71/0x2f0 [ 21.992574][ C0] kmem_cache_alloc_noprof+0x2fc/0x5c0 [ 21.992575][ C0] __alloc_object+0x30/0x260 [ 21.992578][ C0] __create_object+0x30/0x110 [ 21.992579][ C0] __kmalloc_noprof+0x4e5/0x760 [ 21.992580][ C0] virtqueue_add_split+0xca9/0x1df0 [ 21.992582][ C0] virtqueue_add_sgs+0x136/0x280 [ 21.992584][ C0] virtio_fs_enqueue_req+0x639/0xfa0 [ 21.992585][ C0] virtio_fs_send_req+0xf6/0x480 [ 21.992587][ C0] fuse_chan_send+0x45f/0x7a0 [ 21.992590][ C0] fuse_readlink_folio+0x261/0x480 [ 21.992591][ C0] fuse_get_link+0x131/0x350 [ 21.992592][ C0] pick_link+0xebf/0x1650 [ 21.992594][ C0] step_into_slowpath+0x4c8/0x1240 [ 21.992596][ C0] link_path_walk+0x9a7/0x1830 [ 21.992598][ C0] path_lookupat+0x63/0xbf0 [ 21.992599][ C0] filename_lookup+0x1e7/0x4c0 [ 21.992601][ C0] vfs_statx+0xd7/0x3b0 [ 21.992602][ C0] vfs_fstatat+0x4d/0x90 [ 21.992603][ C0] __do_sys_newfstatat+0xa0/0xf0 [ 21.992604][ C0] do_syscall_64+0xff/0x530 [ 21.992606][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.992608][ C0] INITIAL USE at: [ 21.992608][ C0] } [ 21.992609][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 21.992611][ C0] ... acquired at: [ 21.992612][ C0] mark_lock+0x1d7/0xa00 [ 21.992613][ C0] mark_usage+0x42/0x170 [ 21.992614][ C0] __lock_acquire+0x388/0xc20 [ 21.992616][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.992617][ C0] console_lock_spinning_enable+0x5c/0x60 [ 21.992619][ C0] console_emit_next_record+0x1d1/0x4c0 [ 21.992620][ C0] console_flush_one_record+0x46f/0x710 [ 21.992622][ C0] console_unlock+0xee/0x1f0 [ 21.992623][ C0] vprintk_emit+0x37c/0x3e0 [ 21.992624][ C0] _printk+0xc7/0x100 [ 21.992625][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 21.992626][ C0] call_timer_fn+0x160/0x4d0 [ 21.992628][ C0] __run_timers+0x68f/0xaa0 [ 21.992629][ C0] run_timer_softirq+0xf0/0x160 [ 21.992631][ C0] handle_softirqs+0x1d3/0x900 [ 21.992632][ C0] __irq_exit_rcu+0x145/0x1c0 [ 21.992633][ C0] irq_exit_rcu+0xe/0x30 [ 21.992634][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 21.992635][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 21.992637][ C0] _raw_spin_unlock_irqrestore+0x36/0x80 [ 21.992638][ C0] get_from_partial_node+0x21d/0x500 [ 21.992639][ C0] ___slab_alloc+0x71/0x2f0 [ 21.992641][ C0] kmem_cache_alloc_noprof+0x2fc/0x5c0 [ 21.992642][ C0] __alloc_object+0x30/0x260 [ 21.992643][ C0] __create_object+0x30/0x110 [ 21.992644][ C0] __kmalloc_noprof+0x4e5/0x760 [ 21.992644][ C0] virtqueue_add_split+0xca9/0x1df0 [ 21.992646][ C0] virtqueue_add_sgs+0x136/0x280 [ 21.992647][ C0] virtio_fs_enqueue_req+0x639/0xfa0 [ 21.992649][ C0] virtio_fs_send_req+0xf6/0x480 [ 21.992650][ C0] fuse_chan_send+0x45f/0x7a0 [ 21.992651][ C0] fuse_readlink_folio+0x261/0x480 [ 21.992652][ C0] fuse_get_link+0x131/0x350 [ 21.992653][ C0] pick_link+0xebf/0x1650 [ 21.992655][ C0] step_into_slowpath+0x4c8/0x1240 [ 21.992656][ C0] link_path_walk+0x9a7/0x1830 [ 21.992658][ C0] path_lookupat+0x63/0xbf0 [ 21.992659][ C0] filename_lookup+0x1e7/0x4c0 [ 21.992661][ C0] vfs_statx+0xd7/0x3b0 [ 21.992661][ C0] vfs_fstatat+0x4d/0x90 [ 21.992662][ C0] __do_sys_newfstatat+0xa0/0xf0 [ 21.992663][ C0] do_syscall_64+0xff/0x530 [ 21.992665][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.992666][ C0] [ 21.992666][ C0] [ 21.992666][ C0] stack backtrace: [ 21.992669][ C0] CPU: 0 UID: 0 PID: 272 Comm: modprobe Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 21.992672][ C0] Tainted: [W]=WARN [ 21.992672][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 21.992674][ C0] Call Trace: [ 21.992675][ C0] [ 21.992676][ C0] dump_stack_lvl+0x6f/0xa0 [ 21.992681][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 21.992684][ C0] mark_lock_irq+0x989/0x9c0 [ 21.992685][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 21.992688][ C0] mark_lock+0x1d7/0xa00 [ 21.992690][ C0] mark_usage+0x42/0x170 [ 21.992692][ C0] __lock_acquire+0x388/0xc20 [ 21.992694][ C0] lock_acquire.part.0+0xd4/0x280 [ 21.992696][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 21.992698][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.992700][ C0] ? lock_acquire+0x13c/0x160 [ 21.992703][ C0] console_lock_spinning_enable+0x5c/0x60 [ 21.992704][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 21.992706][ C0] console_emit_next_record+0x1d1/0x4c0 [ 21.992708][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 21.992710][ C0] ? console_flush_one_record+0x106/0x710 [ 21.992712][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.992713][ C0] ? lock_acquire+0x13c/0x160 [ 21.992715][ C0] console_flush_one_record+0x46f/0x710 [ 21.992718][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 21.992719][ C0] ? __lock_acquire+0x518/0xc20 [ 21.992722][ C0] console_unlock+0xee/0x1f0 [ 21.992724][ C0] ? console_flush_one_record+0x710/0x710 [ 21.992725][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.992727][ C0] ? lock_acquire+0xe0/0x160 [ 21.992729][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 21.992731][ C0] ? vprintk_emit+0x320/0x3e0 [ 21.992732][ C0] vprintk_emit+0x37c/0x3e0 [ 21.992734][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 21.992736][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 21.992738][ C0] _printk+0xc7/0x100 [ 21.992740][ C0] ? snapshot_read.cold+0x21/0x21 [ 21.992741][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 21.992743][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.992746][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 21.992747][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.992749][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.992751][ C0] call_timer_fn+0x160/0x4d0 [ 21.992753][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 21.992755][ C0] ? debug_object_active_state+0x430/0x430 [ 21.992757][ C0] ? find_held_lock+0x2b/0x80 [ 21.992759][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.992761][ C0] ? mark_held_locks+0x40/0x70 [ 21.992763][ C0] __run_timers+0x68f/0xaa0 [ 21.992765][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.992767][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 21.992769][ C0] ? __lock_acquire+0x518/0xc20 [ 21.992772][ C0] ? __rwlock_init+0x150/0x150 [ 21.992775][ C0] run_timer_softirq+0xf0/0x160 [ 21.992777][ C0] ? __run_timers+0xaa0/0xaa0 [ 21.992779][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.992780][ C0] handle_softirqs+0x1d3/0x900 [ 21.992782][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.992784][ C0] ? _local_bh_enable+0xc0/0xc0 [ 21.992786][ C0] __irq_exit_rcu+0x145/0x1c0 [ 21.992788][ C0] irq_exit_rcu+0xe/0x30 [ 21.992789][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 21.992791][ C0] [ 21.992791][ C0] [ 21.992792][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 21.992794][ C0] RIP: 0010:_raw_spin_unlock_irqrestore+0x36/0x80 [ 21.992796][ C0] Code: f5 53 48 8b 74 24 10 48 89 fb 48 83 c7 18 e8 41 80 78 fd 48 89 df e8 49 d6 78 fd f7 c5 00 02 00 00 75 1f 9c 58 f6 c4 02 75 2f 01 00 00 00 e8 d0 9e 6a fd 65 48 83 3d af ab 65 02 00 74 12 5b [ 21.992798][ C0] RSP: 0018:ffa0000000566fb8 EFLAGS: 00000246 [ 21.992800][ C0] RAX: 0000000000000092 RBX: ff11000001041440 RCX: ffffffffb07e1483 [ 21.992801][ C0] RDX: ff1100000f0123c0 RSI: ffffffffb1111011 RDI: ffffffffb0a949e0 [ 21.992802][ C0] RBP: 0000000000000246 R08: 0000000000000000 R09: 0000000000000000 [ 21.992803][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: ff11000001041440 [ 21.992803][ C0] R13: ffd4000000307010 R14: ffd4000000307000 R15: ff1100000c1c1b88 [ 21.992805][ C0] ? _raw_spin_unlock_irqrestore+0x53/0x80 [ 21.992808][ C0] get_from_partial_node+0x21d/0x500 [ 21.992811][ C0] ___slab_alloc+0x71/0x2f0 [ 21.992813][ C0] ? __pcs_replace_empty_main+0x42f/0x6a0 [ 21.992814][ C0] kmem_cache_alloc_noprof+0x2fc/0x5c0 [ 21.992816][ C0] ? pick_link+0xebf/0x1650 [ 21.992817][ C0] ? __alloc_object+0x30/0x260 [ 21.992819][ C0] __alloc_object+0x30/0x260 [ 21.992821][ C0] __create_object+0x30/0x110 [ 21.992822][ C0] __kmalloc_noprof+0x4e5/0x760 [ 21.992824][ C0] ? virtqueue_add_split+0xca9/0x1df0 [ 21.992826][ C0] virtqueue_add_split+0xca9/0x1df0 [ 21.992828][ C0] ? fuse_readlink_folio+0x261/0x480 [ 21.992829][ C0] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 21.992831][ C0] ? entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.992832][ C0] ? write_profile+0xf0/0xf0 [ 21.992834][ C0] ? virtqueue_add_packed+0x16e0/0x16e0 [ 21.992836][ C0] ? __lock_acquire+0x518/0xc20 [ 21.992839][ C0] virtqueue_add_sgs+0x136/0x280 [ 21.992842][ C0] virtio_fs_enqueue_req+0x639/0xfa0 [ 21.992844][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.992845][ C0] ? pick_link+0xebf/0x1650 [ 21.992847][ C0] ? virtio_fs_probe+0x310/0x310 [ 21.992849][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 21.992851][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.992853][ C0] ? __create_object+0x78/0x110 [ 21.992856][ C0] ? __rwlock_init+0x150/0x150 [ 21.992858][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 21.992860][ C0] virtio_fs_send_req+0xf6/0x480 [ 21.992862][ C0] fuse_chan_send+0x45f/0x7a0 [ 21.992864][ C0] fuse_readlink_folio+0x261/0x480 [ 21.992866][ C0] ? fuse_invalidate_attr_mask+0x100/0x100 [ 21.992867][ C0] ? __alloc_pages_slowpath.constprop.0+0x1af0/0x1af0 [ 21.992869][ C0] ? __lock_acquire+0x518/0xc20 [ 21.992873][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.992876][ C0] fuse_get_link+0x131/0x350 [ 21.992877][ C0] pick_link+0xebf/0x1650 [ 21.992881][ C0] ? fuse_symlink_read_folio+0xe0/0xe0 [ 21.992883][ C0] step_into_slowpath+0x4c8/0x1240 [ 21.992885][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.992887][ C0] ? pick_link+0x1650/0x1650 [ 21.992889][ C0] ? lookup_fast+0x310/0x630 [ 21.992891][ C0] link_path_walk+0x9a7/0x1830 [ 21.992893][ C0] ? path_init+0x77c/0x1a60 [ 21.992895][ C0] ? vfs_rename+0x1d00/0x1d00 [ 21.992897][ C0] ? is_bpf_text_address+0x68/0x110 [ 21.992900][ C0] ? is_bpf_text_address+0x72/0x110 [ 21.992902][ C0] path_lookupat+0x63/0xbf0 [ 21.992903][ C0] ? arch_stack_walk+0xed/0x130 [ 21.992906][ C0] filename_lookup+0x1e7/0x4c0 [ 21.992908][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 21.992909][ C0] ? validate_chain+0x38b/0xc20 [ 21.992911][ C0] ? may_linkat+0x280/0x280 [ 21.992915][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 21.992916][ C0] ? __might_fault+0x97/0x140 [ 21.992918][ C0] ? find_held_lock+0x2b/0x80 [ 21.992920][ C0] vfs_statx+0xd7/0x3b0 [ 21.992922][ C0] ? inode_sub_bytes+0x100/0x100 [ 21.992924][ C0] vfs_fstatat+0x4d/0x90 [ 21.992925][ C0] __do_sys_newfstatat+0xa0/0xf0 [ 21.992927][ C0] ? vfs_fstatat+0x90/0x90 [ 21.992928][ C0] ? __call_rcu_common.constprop.0+0x3d3/0xa20 [ 21.992932][ C0] ? fpregs_restore_userregs+0x14b/0x300 [ 21.992934][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.992935][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 21.992937][ C0] do_syscall_64+0xff/0x530 [ 21.992939][ C0] ? exc_page_fault+0xee/0x100 [ 21.992941][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.992942][ C0] RIP: 0033:0x7fca03d1412e [ 21.992944][ C0] Code: 0f 1f 40 00 48 8b 15 c9 9c 10 00 f7 d8 64 89 02 b8 ff ff ff ff c3 66 0f 1f 44 00 00 f3 0f 1e fa 41 89 ca b8 06 01 00 00 0f 05 <3d> 00 f0 ff ff 77 0b 31 c0 c3 0f 1f 84 00 00 00 00 00 48 8b 15 91 [ 21.992945][ C0] RSP: 002b:00007fffdc2e2828 EFLAGS: 00000246 ORIG_RAX: 0000000000000106 [ 21.992947][ C0] RAX: ffffffffffffffda RBX: 0000565517ff72b0 RCX: 00007fca03d1412e [ 21.992948][ C0] RDX: 00007fffdc2e28e0 RSI: 000056551763fd0f RDI: 00000000ffffff9c [ 21.992949][ C0] RBP: 00007fffdc2e39b0 R08: 0000565517ff7410 R09: 0000565517fff2c0 [ 21.992949][ C0] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000013 [ 21.992950][ C0] R13: 000056551763fd0f R14: 00005655176488e8 R15: 0000565517ff7120 [ 21.992952][ C0] [ 21.992957][ C0] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 21.992958][ C0] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 272, name: modprobe [ 21.992959][ C0] preempt_count: 104, expected: 0 [ 21.992960][ C0] RCU nest depth: 0, expected: 0 [ 21.992961][ C0] INFO: lockdep is turned off. [ 21.992961][ C0] irq event stamp: 11011 [ 21.992962][ C0] hardirqs last enabled at (11010): [] __down_trylock_console_sem+0x86/0xa0 [ 21.992964][ C0] hardirqs last disabled at (11011): [] console_emit_next_record+0x3d4/0x4c0 [ 21.992966][ C0] softirqs last enabled at (10066): [] handle_softirqs+0x67c/0x900 [ 21.992968][ C0] softirqs last disabled at (10991): [] __irq_exit_rcu+0x145/0x1c0 [ 21.992969][ C0] Preemption disabled at: [ 21.992970][ C0] [<0000000000000000>] 0x0 [ 21.992972][ C0] CPU: 0 UID: 0 PID: 272 Comm: modprobe Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 21.992974][ C0] Tainted: [W]=WARN [ 21.992974][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 21.992975][ C0] Call Trace: [ 21.992975][ C0] [ 21.992976][ C0] dump_stack_lvl+0x6f/0xa0 [ 21.992978][ C0] __might_resched.cold+0x1fe/0x2c1 [ 21.992981][ C0] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 21.992984][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.992986][ C0] __kmalloc_noprof+0x443/0x760 [ 21.992987][ C0] ? __rwlock_init+0x150/0x150 [ 21.992989][ C0] ? alloc_buf.isra.0+0x4b/0x260 [ 21.992991][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 21.992992][ C0] alloc_buf.isra.0+0x4b/0x260 [ 21.992995][ C0] put_chars+0x1e1/0x2f0 [ 21.992997][ C0] ? __send_to_port+0x420/0x420 [ 21.992998][ C0] ? mark_lock+0x1d7/0xa00 [ 21.993001][ C0] hvc_console_print+0x292/0x780 [ 21.993004][ C0] ? hvc_write+0x3a0/0x3a0 [ 21.993006][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.993007][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.993008][ C0] console_emit_next_record+0x22f/0x4c0 [ 21.993011][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 21.993013][ C0] ? console_flush_one_record+0x106/0x710 [ 21.993015][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.993016][ C0] ? lock_acquire+0x13c/0x160 [ 21.993018][ C0] console_flush_one_record+0x46f/0x710 [ 21.993020][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 21.993022][ C0] ? __lock_acquire+0x518/0xc20 [ 21.993024][ C0] console_unlock+0xee/0x1f0 [ 21.993026][ C0] ? console_flush_one_record+0x710/0x710 [ 21.993028][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.993029][ C0] ? lock_acquire+0xe0/0x160 [ 21.993031][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 21.993033][ C0] ? vprintk_emit+0x320/0x3e0 [ 21.993034][ C0] vprintk_emit+0x37c/0x3e0 [ 21.993036][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 21.993038][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 21.993039][ C0] _printk+0xc7/0x100 [ 21.993041][ C0] ? snapshot_read.cold+0x21/0x21 [ 21.993043][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 21.993044][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.993047][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 21.993048][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.993050][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.993052][ C0] call_timer_fn+0x160/0x4d0 [ 21.993054][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 21.993056][ C0] ? debug_object_active_state+0x430/0x430 [ 21.993057][ C0] ? find_held_lock+0x2b/0x80 [ 21.993059][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.993061][ C0] ? mark_held_locks+0x40/0x70 [ 21.993063][ C0] __run_timers+0x68f/0xaa0 [ 21.993065][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 21.993067][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 21.993069][ C0] ? __lock_acquire+0x518/0xc20 [ 21.993072][ C0] ? __rwlock_init+0x150/0x150 [ 21.993075][ C0] run_timer_softirq+0xf0/0x160 [ 21.993077][ C0] ? __run_timers+0xaa0/0xaa0 [ 21.993079][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.993080][ C0] handle_softirqs+0x1d3/0x900 [ 21.993082][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.993083][ C0] ? _local_bh_enable+0xc0/0xc0 [ 21.993086][ C0] __irq_exit_rcu+0x145/0x1c0 [ 21.993087][ C0] irq_exit_rcu+0xe/0x30 [ 21.993089][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 21.993090][ C0] [ 21.993091][ C0] [ 21.993092][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 21.993093][ C0] RIP: 0010:_raw_spin_unlock_irqrestore+0x36/0x80 [ 21.993095][ C0] Code: f5 53 48 8b 74 24 10 48 89 fb 48 83 c7 18 e8 41 80 78 fd 48 89 df e8 49 d6 78 fd f7 c5 00 02 00 00 75 1f 9c 58 f6 c4 02 75 2f 01 00 00 00 e8 d0 9e 6a fd 65 48 83 3d af ab 65 02 00 74 12 5b [ 21.993096][ C0] RSP: 0018:ffa0000000566fb8 EFLAGS: 00000246 [ 21.993097][ C0] RAX: 0000000000000092 RBX: ff11000001041440 RCX: ffffffffb07e1483 [ 21.993097][ C0] RDX: ff1100000f0123c0 RSI: ffffffffb1111011 RDI: ffffffffb0a949e0 [ 21.993098][ C0] RBP: 0000000000000246 R08: 0000000000000000 R09: 0000000000000000 [ 21.993099][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: ff11000001041440 [ 21.993099][ C0] R13: ffd4000000307010 R14: ffd4000000307000 R15: ff1100000c1c1b88 [ 21.993101][ C0] ? _raw_spin_unlock_irqrestore+0x53/0x80 [ 21.993103][ C0] get_from_partial_node+0x21d/0x500 [ 21.993106][ C0] ___slab_alloc+0x71/0x2f0 [ 21.993108][ C0] ? __pcs_replace_empty_main+0x42f/0x6a0 [ 21.993110][ C0] kmem_cache_alloc_noprof+0x2fc/0x5c0 [ 21.993111][ C0] ? pick_link+0xebf/0x1650 [ 21.993112][ C0] ? __alloc_object+0x30/0x260 [ 21.993114][ C0] __alloc_object+0x30/0x260 [ 21.993116][ C0] __create_object+0x30/0x110 [ 21.993117][ C0] __kmalloc_noprof+0x4e5/0x760 [ 21.993119][ C0] ? virtqueue_add_split+0xca9/0x1df0 [ 21.993121][ C0] virtqueue_add_split+0xca9/0x1df0 [ 21.993123][ C0] ? fuse_readlink_folio+0x261/0x480 [ 21.993124][ C0] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 21.993126][ C0] ? entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.993127][ C0] ? write_profile+0xf0/0xf0 [ 21.993129][ C0] ? virtqueue_add_packed+0x16e0/0x16e0 [ 21.993130][ C0] ? __lock_acquire+0x518/0xc20 [ 21.993133][ C0] virtqueue_add_sgs+0x136/0x280 [ 21.993136][ C0] virtio_fs_enqueue_req+0x639/0xfa0 [ 21.993138][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.993140][ C0] ? pick_link+0xebf/0x1650 [ 21.993142][ C0] ? virtio_fs_probe+0x310/0x310 [ 21.993143][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 21.993145][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.993146][ C0] ? __create_object+0x78/0x110 [ 21.993149][ C0] ? __rwlock_init+0x150/0x150 [ 21.993151][ C0] ? do_raw_spin_unlock+0x59/0x250 [ 21.993154][ C0] virtio_fs_send_req+0xf6/0x480 [ 21.993156][ C0] fuse_chan_send+0x45f/0x7a0 [ 21.993158][ C0] fuse_readlink_folio+0x261/0x480 [ 21.993159][ C0] ? fuse_invalidate_attr_mask+0x100/0x100 [ 21.993161][ C0] ? __alloc_pages_slowpath.constprop.0+0x1af0/0x1af0 [ 21.993163][ C0] ? __lock_acquire+0x518/0xc20 [ 21.993166][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 21.993169][ C0] fuse_get_link+0x131/0x350 [ 21.993170][ C0] pick_link+0xebf/0x1650 [ 21.993172][ C0] ? fuse_symlink_read_folio+0xe0/0xe0 [ 21.993174][ C0] step_into_slowpath+0x4c8/0x1240 [ 21.993176][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.993177][ C0] ? pick_link+0x1650/0x1650 [ 21.993180][ C0] ? lookup_fast+0x310/0x630 [ 21.993182][ C0] link_path_walk+0x9a7/0x1830 [ 21.993184][ C0] ? path_init+0x77c/0x1a60 [ 21.993186][ C0] ? vfs_rename+0x1d00/0x1d00 [ 21.993187][ C0] ? is_bpf_text_address+0x68/0x110 [ 21.993189][ C0] ? is_bpf_text_address+0x72/0x110 [ 21.993191][ C0] path_lookupat+0x63/0xbf0 [ 21.993192][ C0] ? arch_stack_walk+0xed/0x130 [ 21.993194][ C0] filename_lookup+0x1e7/0x4c0 [ 21.993196][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 21.993197][ C0] ? validate_chain+0x38b/0xc20 [ 21.993199][ C0] ? may_linkat+0x280/0x280 [ 21.993203][ C0] ? lock_acquire.part.0+0xd4/0x280 [ 21.993204][ C0] ? __might_fault+0x97/0x140 [ 21.993206][ C0] ? find_held_lock+0x2b/0x80 [ 21.993208][ C0] vfs_statx+0xd7/0x3b0 [ 21.993209][ C0] ? inode_sub_bytes+0x100/0x100 [ 21.993211][ C0] vfs_fstatat+0x4d/0x90 [ 21.993212][ C0] __do_sys_newfstatat+0xa0/0xf0 [ 21.993214][ C0] ? vfs_fstatat+0x90/0x90 [ 21.993215][ C0] ? __call_rcu_common.constprop.0+0x3d3/0xa20 [ 21.993218][ C0] ? fpregs_restore_userregs+0x14b/0x300 [ 21.993220][ C0] ? rcu_is_watching+0x16/0xd0 [ 21.993221][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 21.993222][ C0] do_syscall_64+0xff/0x530 [ 21.993224][ C0] ? exc_page_fault+0xee/0x100 [ 21.993226][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 21.993227][ C0] RIP: 0033:0x7fca03d1412e [ 21.993228][ C0] Code: 0f 1f 40 00 48 8b 15 c9 9c 10 00 f7 d8 64 89 02 b8 ff ff ff ff c3 66 0f 1f 44 00 00 f3 0f 1e fa 41 89 ca b8 06 01 00 00 0f 05 <3d> 00 f0 ff ff 77 0b 31 c0 c3 0f 1f 84 00 00 00 00 00 48 8b 15 91 [ 21.993229][ C0] RSP: 002b:00007fffdc2e2828 EFLAGS: 00000246 ORIG_RAX: 0000000000000106 [ 21.993230][ C0] RAX: ffffffffffffffda RBX: 0000565517ff72b0 RCX: 00007fca03d1412e [ 21.993230][ C0] RDX: 00007fffdc2e28e0 RSI: 000056551763fd0f RDI: 00000000ffffff9c [ 21.993231][ C0] RBP: 00007fffdc2e39b0 R08: 0000565517ff7410 R09: 0000565517fff2c0 [ 21.993232][ C0] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000013 [ 21.993232][ C0] R13: 000056551763fd0f R14: 00005655176488e8 R15: 0000565517ff7120 [ 21.993235][ C0]