virtme: waiting for virtiofsd to start virtme: use 'microvm' QEMU architecture [ 1.028980][ T1] IPI shorthand broadcast: enabled [ 1.029011][ T1] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 1.029013][ T1] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 [ 1.029015][ T1] preempt_count: 1, expected: 0 [ 1.029016][ T1] RCU nest depth: 0, expected: 0 [ 1.029017][ T1] locks held by swapper/0/1: 4, last CPU#3: [ 1.029019][ T1] #0: ffffffffaa569cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 1.029031][ T1] #1: ffffffffaa569d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 1.029035][ T1] #2: ffffffffaa489660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 1.029039][ T1] #3: ffffffffaa489560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 1.029043][ T1] irq event stamp: 318326 [ 1.029044][ T1] hardirqs last enabled at (318325): [] __down_trylock_console_sem+0x86/0xa0 [ 1.029046][ T1] hardirqs last disabled at (318326): [] console_emit_next_record+0x3d4/0x4c0 [ 1.029048][ T1] softirqs last enabled at (317086): [] handle_softirqs+0x67c/0x900 [ 1.029051][ T1] softirqs last disabled at (317077): [] __irq_exit_rcu+0x145/0x1c0 [ 1.029054][ T1] Preemption disabled at: [ 1.029054][ T1] [] vprintk_emit+0x31b/0x3e0 [ 1.029060][ T1] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 7.2.0-virtme #1 PREEMPT(full) [ 1.029062][ T1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1.029064][ T1] Call Trace: [ 1.029065][ T1] [ 1.029068][ T1] dump_stack_lvl+0x6f/0xa0 [ 1.029074][ T1] ? vprintk_emit+0x31b/0x3e0 [ 1.029076][ T1] __might_resched.cold+0x1fe/0x2c1 [ 1.029080][ T1] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 1.029084][ T1] ? __kmalloc_noprof+0xdb/0x760 [ 1.029089][ T1] __kmalloc_noprof+0x443/0x760 [ 1.029092][ T1] ? alloc_buf.isra.0+0x4b/0x260 [ 1.029097][ T1] ? do_raw_spin_unlock+0x59/0x250 [ 1.029100][ T1] alloc_buf.isra.0+0x4b/0x260 [ 1.029103][ T1] put_chars+0x1e1/0x2f0 [ 1.029105][ T1] ? __send_to_port+0x420/0x420 [ 1.029108][ T1] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 1.029112][ T1] ? rcu_read_lock_any_held+0x3c/0x90 [ 1.029115][ T1] ? validate_chain+0x38b/0xc20 [ 1.029118][ T1] hvc_console_print+0x292/0x780 [ 1.029120][ T1] ? mark_usage+0x61/0x170 [ 1.029122][ T1] ? __lock_acquire+0x518/0xc20 [ 1.029124][ T1] ? __lock_acquire+0x518/0xc20 [ 1.029128][ T1] ? hvc_write+0x3a0/0x3a0 [ 1.029129][ T1] ? lock_acquire.part.0+0xd4/0x280 [ 1.029133][ T1] ? lock_acquire+0x13c/0x160 [ 1.029137][ T1] console_emit_next_record+0x22f/0x4c0 [ 1.029141][ T1] ? devkmsg_read+0x4b0/0x4b0 [ 1.029143][ T1] ? console_flush_one_record+0x106/0x710 [ 1.029146][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.029148][ T1] ? lock_acquire+0x13c/0x160 [ 1.029152][ T1] console_flush_one_record+0x46f/0x710 [ 1.029156][ T1] ? console_emit_next_record+0x4c0/0x4c0 [ 1.029158][ T1] ? __lock_acquire+0x518/0xc20 [ 1.029163][ T1] console_unlock+0xee/0x1f0 [ 1.029166][ T1] ? console_flush_one_record+0x710/0x710 [ 1.029168][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.029170][ T1] ? lock_acquire+0x60/0x160 [ 1.029174][ T1] ? __down_trylock_console_sem+0x5e/0xa0 [ 1.029176][ T1] ? vprintk_emit+0x320/0x3e0 [ 1.029179][ T1] vprintk_emit+0x37c/0x3e0 [ 1.029182][ T1] ? wake_up_klogd_work_func+0x90/0x90 [ 1.029188][ T1] ? apic_ipi_shorthand+0xa0/0xa0 [ 1.029192][ T1] _printk+0xc7/0x100 [ 1.029195][ T1] ? snapshot_read.cold+0x21/0x21 [ 1.029197][ T1] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 1.029200][ T1] ? add_device_randomness+0xbb/0x100 [ 1.029203][ T1] ? random_write_iter+0x20/0x20 [ 1.029205][ T1] ? insert_resource+0x3c/0x50 [ 1.029209][ T1] ? do_one_initcall+0x113/0x4f0 [ 1.029212][ T1] print_ipi_mode+0x2e/0x40 [ 1.029214][ T1] do_one_initcall+0x124/0x4f0 [ 1.029216][ T1] ? trace_event_raw_event_initcall_level+0x280/0x280 [ 1.029218][ T1] ? parameq+0x110/0x110 [ 1.029223][ T1] ? kernel_init_freeable+0x3f1/0x630 [ 1.029226][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.029229][ T1] kernel_init_freeable+0x596/0x630 [ 1.029232][ T1] ? rest_init+0x280/0x280 [ 1.029237][ T1] kernel_init+0x21/0x150 [ 1.029239][ T1] ? rest_init+0x280/0x280 [ 1.029241][ T1] ret_from_fork+0x474/0x6b0 [ 1.029245][ T1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1.029248][ T1] ? __switch_to+0x5a3/0xe00 [ 1.029252][ T1] ? rest_init+0x280/0x280 [ 1.029254][ T1] ret_from_fork_asm+0x11/0x20 [ 1.029262][ T1] [ 1.153479][ T1] sched_clock: Marking stable (1119002128, 34412237)->(1257465537, -104051172) [ 1.155932][ T1] registered taskstats version 1 [ 1.158733][ T1] Loading compiled-in X.509 certificates [ 1.257758][ T1] Demotion targets for Node 0: null [ 1.258115][ T1] kmemleak: Kernel memory leak detector initialized (mem pool available: 12236) [ 1.258404][ T1] page_owner is disabled [ 1.259094][ T1] PM: Magic number: 6:92:874 [ 1.259536][ T1] netconsole: network logging started [ 1.260903][ T1] ALSA device list: [ 1.261594][ T1] No soundcards found. [ 1.262802][ T1] md: Skipping autodetection of RAID arrays. (raid=autodetect will force) [ 1.265109][ T1] VFS: Mounted root (virtiofs filesystem) readonly on device 0:24. [ 1.265851][ T1] devtmpfs: mounted [ 1.266133][ T1] VFS: Pivoted into new rootfs [ 1.294520][ T1] Freeing unused kernel image (initmem) memory: 2544K [ 1.294742][ T1] Write protecting the kernel read-only data: 55296k [ 1.295208][ T1] Freeing unused kernel image (text/rodata gap) memory: 328K [ 1.295651][ T1] Freeing unused kernel image (rodata/data gap) memory: 556K [ 1.295996][ T1] Run /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init as init process [ 1.296268][ T1] with arguments: [ 1.296439][ T1] /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init [ 1.296669][ T1] with environment: [ 1.296785][ T1] HOME=/ [ 1.296910][ T1] TERM=dumb [ 1.297027][ T1] virtme_hostname=vmksft-forwarding-dbg,debug-threads=on [ 1.297249][ T1] nr_open=2147483584 [ 1.297367][ T1] virtme_link_mods=/srv/vmksft/testing/wt-4/.virtme_mods/lib/modules/0.0.0 [ 1.298074][ T1] virtme_rw_overlay0=/etc [ 1.298224][ T1] virtme_rw_overlay1=/lib [ 1.298380][ T1] virtme_rw_overlay2=/home [ 1.298535][ T1] virtme_rw_overlay3=/opt [ 1.298683][ T1] virtme_rw_overlay4=/srv [ 1.298835][ T1] virtme_rw_overlay5=/usr [ 1.298982][ T1] virtme_rw_overlay6=/var [ 1.299135][ T1] virtme_rw_overlay7=/tmp [ 1.299289][ T1] virtme_console=ttyS0 [ 1.299443][ T1] virtme_chdir=srv/vmksft/testing/wt-4 [ 1.314507][ T1] virtme-ng-init: mount devtmpfs -> /dev: EBUSY: Device or resource busy [ 1.315832][ T1] virtme-ng-init: Setting hostname to vmksft-forwarding-dbg,debug-threads=on... [ 1.325076][ T1] overlayfs: failed to set xattr on upper [ 1.325360][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.325700][ T1] overlayfs: ...falling back to uuid=null. [ 1.328040][ T1] overlayfs: failed to set xattr on upper [ 1.328268][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.328636][ T1] overlayfs: ...falling back to uuid=null. [ 1.330565][ T1] overlayfs: failed to set xattr on upper [ 1.330796][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.331089][ T1] overlayfs: ...falling back to uuid=null. [ 1.333023][ T1] overlayfs: failed to set xattr on upper [ 1.333276][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.333595][ T1] overlayfs: ...falling back to uuid=null. [ 1.335533][ T1] overlayfs: failed to set xattr on upper [ 1.335756][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.336068][ T1] overlayfs: ...falling back to uuid=null. [ 1.338030][ T1] overlayfs: failed to set xattr on upper [ 1.338267][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.338555][ T1] overlayfs: ...falling back to uuid=null. [ 1.341735][ T1] overlayfs: failed to set xattr on upper [ 1.341978][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.342262][ T1] overlayfs: ...falling back to uuid=null. [ 1.344176][ T1] overlayfs: failed to set xattr on upper [ 1.344402][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.344919][ T1] overlayfs: ...falling back to uuid=null. [ 1.355512][ T1] virtme-ng-init: running systemd-tmpfiles [ 1.407445][ T73] kwatchdog (73) used greatest stack depth: 29688 bytes left [ 3.451643][ T1] virtme-ng-init: Failed to read '/usr/lib/tmpfiles.d/audit.conf': Permission denied [ 3.451643][ T1] Failed to create directory or subvolume "/var/spool/at/spool": Permission denied [ 3.451643][ T1] Failed to create file /var/spool/at/.SEQ: Permission denied [ 3.451643][ T1] Failed to opendir() '/proc/self/fd/6': Permission denied [ 3.451659][ T1] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 3.451661][ T1] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: virtme-ng-init [ 3.451662][ T1] preempt_count: 1, expected: 0 [ 3.451663][ T1] RCU nest depth: 0, expected: 0 [ 3.451664][ T1] locks held by virtme-ng-init/1: 4, last CPU#2: [ 3.451667][ T1] #0: ffffffffaa569cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 3.451680][ T1] #1: ffffffffaa569d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 3.451684][ T1] #2: ffffffffaa489660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 3.451688][ T1] #3: ffffffffaa489560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 3.451692][ T1] irq event stamp: 556764 [ 3.451692][ T1] hardirqs last enabled at (556763): [] __down_trylock_console_sem+0x86/0xa0 [ 3.451695][ T1] hardirqs last disabled at (556764): [] console_emit_next_record+0x3d4/0x4c0 [ 3.451697][ T1] softirqs last enabled at (556074): [] fpu_clone+0xd9/0x410 [ 3.451701][ T1] softirqs last disabled at (556072): [] fpu_clone+0x82/0x410 [ 3.451703][ T1] Preemption disabled at: [ 3.451703][ T1] [] vprintk_emit+0x31b/0x3e0 [ 3.451709][ T1] CPU: 2 UID: 0 PID: 1 Comm: virtme-ng-init Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 3.451713][ T1] Tainted: [W]=WARN [ 3.451714][ T1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 3.451715][ T1] Call Trace: [ 3.451717][ T1] [ 3.451719][ T1] dump_stack_lvl+0x6f/0xa0 [ 3.451724][ T1] ? vprintk_emit+0x31b/0x3e0 [ 3.451727][ T1] __might_resched.cold+0x1fe/0x2c1 [ 3.451731][ T1] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 3.451735][ T1] ? __kmalloc_noprof+0xdb/0x760 [ 3.451740][ T1] __kmalloc_noprof+0x443/0x760 [ 3.451742][ T1] ? alloc_buf.isra.0+0x4b/0x260 [ 3.451747][ T1] ? do_raw_spin_unlock+0x59/0x250 [ 3.451750][ T1] alloc_buf.isra.0+0x4b/0x260 [ 3.451753][ T1] put_chars+0x1e1/0x2f0 [ 3.451756][ T1] ? __send_to_port+0x420/0x420 [ 3.451757][ T1] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 3.451762][ T1] ? validate_chain+0x38b/0xc20 [ 3.451766][ T1] hvc_console_print+0x292/0x780 [ 3.451772][ T1] ? hvc_write+0x3a0/0x3a0 [ 3.451774][ T1] ? rcu_is_watching+0x16/0xd0 [ 3.451777][ T1] ? lock_acquire+0x13c/0x160 [ 3.451780][ T1] console_emit_next_record+0x22f/0x4c0 [ 3.451784][ T1] ? devkmsg_read+0x4b0/0x4b0 [ 3.451786][ T1] ? console_flush_one_record+0x106/0x710 [ 3.451789][ T1] ? rcu_is_watching+0x16/0xd0 [ 3.451791][ T1] ? lock_acquire+0x13c/0x160 [ 3.451795][ T1] console_flush_one_record+0x46f/0x710 [ 3.451799][ T1] ? console_emit_next_record+0x4c0/0x4c0 [ 3.451801][ T1] ? __lock_acquire+0x518/0xc20 [ 3.451805][ T1] console_unlock+0xee/0x1f0 [ 3.451808][ T1] ? console_flush_one_record+0x710/0x710 [ 3.451810][ T1] ? rcu_is_watching+0x16/0xd0 [ 3.451812][ T1] ? lock_acquire+0x60/0x160 [ 3.451815][ T1] ? __down_trylock_console_sem+0x5e/0xa0 [ 3.451817][ T1] ? vprintk_emit+0x320/0x3e0 [ 3.451820][ T1] vprintk_emit+0x37c/0x3e0 [ 3.451824][ T1] ? wake_up_klogd_work_func+0x90/0x90 [ 3.451827][ T1] ? _copy_from_iter+0x1bb/0x1810 [ 3.451832][ T1] devkmsg_emit.constprop.0+0xbc/0xf1 [ 3.451837][ T1] ? vprintk_emit.cold+0x107/0x107 [ 3.451838][ T1] ? simple_strntoull+0x10f/0x140 [ 3.451842][ T1] ? date_str+0x1e0/0x1e0 [ 3.451845][ T1] ? devkmsg_write+0xd1/0x2c0 [ 3.451850][ T1] devkmsg_write.cold+0x5a/0x8b [ 3.451852][ T1] ? vprintk_default+0x20/0x20 [ 3.451856][ T1] ? vprintk_default+0x20/0x20 [ 3.451859][ T1] new_sync_write+0x33e/0x760 [ 3.451862][ T1] ? lockdep_hardirqs_on+0x91/0x130 [ 3.451865][ T1] ? kasan_quarantine_put+0x13e/0x2b0 [ 3.451868][ T1] ? new_sync_read+0x750/0x750 [ 3.451875][ T1] ? rcu_is_watching+0x16/0xd0 [ 3.451878][ T1] vfs_write+0x6a2/0xbd0 [ 3.451882][ T1] ksys_write+0x116/0x250 [ 3.451885][ T1] ? __ia32_sys_read+0xc0/0xc0 [ 3.451888][ T1] ? rcu_is_watching+0x16/0xd0 [ 3.451892][ T1] do_syscall_64+0xff/0x530 [ 3.451894][ T1] ? exc_page_fault+0xee/0x100 [ 3.451896][ T1] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3.451899][ T1] RIP: 0033:0x7f7d12742bee [ 3.451903][ T1] Code: 4d 89 d8 e8 d4 12 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 3.451905][ T1] RSP: 002b:00007ffe6ec71520 EFLAGS: 00000202 ORIG_RAX: 0000000000000001 [ 3.451907][ T1] RAX: ffffffffffffffda RBX: 000000000000011c RCX: 00007f7d12742bee [ 3.451909][ T1] RDX: 000000000000011c RSI: 0000555562549680 RDI: 0000000000000003 [ 3.451909][ T1] RBP: 00007ffe6ec71530 R08: 0000000000000000 R09: 0000000000000000 [ 3.451910][ T1] R10: 0000000000000000 R11: 0000000000000202 R12: 00007f7d127ce0a0 [ 3.451911][ T1] R13: 00007f7d126cc3e0 R14: 0000555562549680 R15: 00007ffe6ec71648 [ 3.451917][ T1] [ 3.451940][ T72] systemd-tmpfile (72) used greatest stack depth: 24992 bytes left [ 3.453132][ T1] virtme-ng-init: basic initialization done [ 3.517939][ T74] virtme-ng-init: Starting systemd-udevd version 259.8-1.fc44 [ 3.518231][ T75] systemd-udevd (75) used greatest stack depth: 24752 bytes left [ 3.518322][ T74] virtme-ng-init: triggering udev coldplug [ 3.521975][ T78] ip (78) used greatest stack depth: 24120 bytes left [ 5.648614][ T74] virtme-ng-init: waiting for udev to settle [ 5.648628][ T74] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 5.648631][ T74] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 74, name: virtme-ng-init [ 5.648633][ T74] preempt_count: 1, expected: 0 [ 5.648634][ T74] RCU nest depth: 0, expected: 0 [ 5.648635][ T74] locks held by virtme-ng-init/74: 4, last CPU#0: [ 5.648637][ T74] #0: ffffffffaa569cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 5.648650][ T74] #1: ffffffffaa569d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 5.648654][ T74] #2: ffffffffaa489660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 5.648658][ T74] #3: ffffffffaa489560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 5.648662][ T74] irq event stamp: 4118 [ 5.648663][ T74] hardirqs last enabled at (4117): [] __down_trylock_console_sem+0x86/0xa0 [ 5.648666][ T74] hardirqs last disabled at (4118): [] console_emit_next_record+0x3d4/0x4c0 [ 5.648668][ T74] softirqs last enabled at (3620): [] fpu_clone+0xd9/0x410 [ 5.648672][ T74] softirqs last disabled at (3618): [] fpu_clone+0x82/0x410 [ 5.648675][ T74] Preemption disabled at: [ 5.648675][ T74] [] vprintk_emit+0x31b/0x3e0 [ 5.648681][ T74] CPU: 0 UID: 0 PID: 74 Comm: virtme-ng-init Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 5.648685][ T74] Tainted: [W]=WARN [ 5.648686][ T74] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 5.648687][ T74] Call Trace: [ 5.648689][ T74] [ 5.648691][ T74] dump_stack_lvl+0x6f/0xa0 [ 5.648696][ T74] ? vprintk_emit+0x31b/0x3e0 [ 5.648699][ T74] __might_resched.cold+0x1fe/0x2c1 [ 5.648703][ T74] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 5.648707][ T74] ? __kmalloc_noprof+0xdb/0x760 [ 5.648713][ T74] __kmalloc_noprof+0x443/0x760 [ 5.648715][ T74] ? alloc_buf.isra.0+0x4b/0x260 [ 5.648721][ T74] ? do_raw_spin_unlock+0x59/0x250 [ 5.648724][ T74] alloc_buf.isra.0+0x4b/0x260 [ 5.648727][ T74] put_chars+0x1e1/0x2f0 [ 5.648730][ T74] ? __send_to_port+0x420/0x420 [ 5.648732][ T74] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 5.648736][ T74] ? validate_chain+0x38b/0xc20 [ 5.648742][ T74] hvc_console_print+0x292/0x780 [ 5.648748][ T74] ? hvc_write+0x3a0/0x3a0 [ 5.648750][ T74] ? rcu_is_watching+0x16/0xd0 [ 5.648753][ T74] ? lock_acquire+0x13c/0x160 [ 5.648757][ T74] console_emit_next_record+0x22f/0x4c0 [ 5.648761][ T74] ? devkmsg_read+0x4b0/0x4b0 [ 5.648763][ T74] ? console_flush_one_record+0x106/0x710 [ 5.648766][ T74] ? rcu_is_watching+0x16/0xd0 [ 5.648768][ T74] ? lock_acquire+0x13c/0x160 [ 5.648772][ T74] console_flush_one_record+0x46f/0x710 [ 5.648777][ T74] ? console_emit_next_record+0x4c0/0x4c0 [ 5.648779][ T74] ? __lock_acquire+0x518/0xc20 [ 5.648784][ T74] console_unlock+0xee/0x1f0 [ 5.648787][ T74] ? console_flush_one_record+0x710/0x710 [ 5.648789][ T74] ? rcu_is_watching+0x16/0xd0 [ 5.648791][ T74] ? lock_acquire+0x60/0x160 [ 5.648795][ T74] ? __down_trylock_console_sem+0x5e/0xa0 [ 5.648797][ T74] ? vprintk_emit+0x320/0x3e0 [ 5.648800][ T74] vprintk_emit+0x37c/0x3e0 [ 5.648804][ T74] ? wake_up_klogd_work_func+0x90/0x90 [ 5.648807][ T74] ? _copy_from_iter+0x1bb/0x1810 [ 5.648813][ T74] devkmsg_emit.constprop.0+0xbc/0xf1 [ 5.648818][ T74] ? vprintk_emit.cold+0x107/0x107 [ 5.648820][ T74] ? simple_strntoull+0x10f/0x140 [ 5.648824][ T74] ? date_str+0x1e0/0x1e0 [ 5.648827][ T74] ? devkmsg_write+0xd1/0x2c0 [ 5.648834][ T74] devkmsg_write.cold+0x5a/0x8b [ 5.648837][ T74] ? vprintk_default+0x20/0x20 [ 5.648841][ T74] ? vprintk_default+0x20/0x20 [ 5.648844][ T74] new_sync_write+0x33e/0x760 [ 5.648848][ T74] ? kasan_quarantine_put+0x42/0x2b0 [ 5.648851][ T74] ? new_sync_read+0x750/0x750 [ 5.648855][ T74] ? __lock_release.isra.0+0x69/0x1a0 [ 5.648860][ T74] ? __fget_files+0x1e3/0x460 [ 5.648865][ T74] vfs_write+0x6a2/0xbd0 [ 5.648870][ T74] ksys_write+0x116/0x250 [ 5.648873][ T74] ? __ia32_sys_read+0xc0/0xc0 [ 5.648876][ T74] ? rcu_is_watching+0x16/0xd0 [ 5.648880][ T74] do_syscall_64+0xff/0x530 [ 5.648882][ T74] ? exc_page_fault+0xee/0x100 [ 5.648885][ T74] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5.648887][ T74] RIP: 0033:0x7f7d12743ed2 [ 5.648891][ T74] Code: 08 0f 85 51 ec ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 f3 0f 1e fa 55 48 89 e5 [ 5.648893][ T74] RSP: 002b:00007f7d1268ac68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 [ 5.648896][ T74] RAX: ffffffffffffffda RBX: 000000000000002e RCX: 00007f7d12743ed2 [ 5.648897][ T74] RDX: 000000000000002e RSI: 00007f7d0c0012c0 RDI: 0000000000000003 [ 5.648898][ T74] RBP: 00007f7d1268ac90 R08: 0000000000000000 R09: 0000000000000000 [ 5.648899][ T74] R10: 0000000000000000 R11: 0000000000000246 R12: 00007f7d127ce0a0 [ 5.648900][ T74] R13: 00007f7d126cc3e0 R14: 00007f7d0c0012c0 R15: 00007f7d1268ada8 [ 5.648907][ T74] [ 6.217709][ T74] virtme-ng-init: udev is done [ 6.225977][ T1] virtme-ng-init: initialization done [ 6.406551][ C0] clocksource: Watchdog remote CPU 3 read timed out [ 6.406581][ C0] [ 6.406582][ C0] ======================================================== [ 6.406584][ C0] WARNING: possible irq lock inversion dependency detected [ 6.406585][ C0] 7.2.0-virtme #1 Tainted: G W [ 6.406587][ C0] -------------------------------------------------------- [ 6.406588][ C0] swapper/0/0 just changed the state of lock: [ 6.406589][ C0] ffffffffaa489660 (console_owner){..-.}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 6.406601][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 6.406603][ C0] (fs_reclaim){+.+.}-{0:0} [ 6.406604][ C0] [ 6.406604][ C0] [ 6.406604][ C0] and interrupts could create inverse lock ordering between them. [ 6.406604][ C0] [ 6.406605][ C0] [ 6.406605][ C0] other info that might help us debug this: [ 6.406605][ C0] Possible interrupt unsafe locking scenario: [ 6.406605][ C0] [ 6.406606][ C0] CPU0 CPU1 [ 6.406607][ C0] ---- ---- [ 6.406607][ C0] lock(fs_reclaim); [ 6.406608][ C0] local_irq_disable(); [ 6.406608][ C0] lock(console_owner); [ 6.406609][ C0] lock(fs_reclaim); [ 6.406610][ C0] [ 6.406611][ C0] lock(console_owner); [ 6.406611][ C0] [ 6.406611][ C0] *** DEADLOCK *** [ 6.406611][ C0] [ 6.406612][ C0] locks held by swapper/0/0: 4, last CPU#0: [ 6.406613][ C0] #0: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 6.406619][ C0] #1: ffffffffaa5ce8b8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 6.406623][ C0] #2: ffffffffaa569cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 6.406626][ C0] #3: ffffffffaa569d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 6.406630][ C0] [ 6.406630][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 6.406634][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 6.406636][ C0] HARDIRQ-ON-W at: [ 6.406638][ C0] __lock_acquire+0x388/0xc20 [ 6.406641][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.406643][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.406645][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.406648][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.406651][ C0] workqueue_init+0x2a/0x680 [ 6.406654][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.406656][ C0] kernel_init+0x21/0x150 [ 6.406660][ C0] ret_from_fork+0x474/0x6b0 [ 6.406663][ C0] ret_from_fork_asm+0x11/0x20 [ 6.406667][ C0] SOFTIRQ-ON-W at: [ 6.406668][ C0] __lock_acquire+0x388/0xc20 [ 6.406669][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.406671][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.406672][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.406673][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.406674][ C0] workqueue_init+0x2a/0x680 [ 6.406676][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.406677][ C0] kernel_init+0x21/0x150 [ 6.406678][ C0] ret_from_fork+0x474/0x6b0 [ 6.406679][ C0] ret_from_fork_asm+0x11/0x20 [ 6.406681][ C0] INITIAL USE at: [ 6.406681][ C0] __lock_acquire+0x388/0xc20 [ 6.406683][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.406684][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.406685][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.406686][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.406688][ C0] workqueue_init+0x2a/0x680 [ 6.406689][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.406690][ C0] kernel_init+0x21/0x150 [ 6.406692][ C0] ret_from_fork+0x474/0x6b0 [ 6.406693][ C0] ret_from_fork_asm+0x11/0x20 [ 6.406694][ C0] } [ 6.406694][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 6.406699][ C0] ... acquired at: [ 6.406699][ C0] __lock_acquire+0x518/0xc20 [ 6.406701][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.406702][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.406703][ C0] __kmalloc_noprof+0xd3/0x760 [ 6.406704][ C0] alloc_buf.isra.0+0x4b/0x260 [ 6.406707][ C0] put_chars+0x1e1/0x2f0 [ 6.406709][ C0] hvc_console_print+0x292/0x780 [ 6.406711][ C0] console_emit_next_record+0x22f/0x4c0 [ 6.406712][ C0] console_flush_one_record+0x46f/0x710 [ 6.406714][ C0] console_unlock+0xee/0x1f0 [ 6.406716][ C0] vprintk_emit+0x37c/0x3e0 [ 6.406717][ C0] _printk+0xc7/0x100 [ 6.406720][ C0] print_ipi_mode+0x2e/0x40 [ 6.406722][ C0] do_one_initcall+0x124/0x4f0 [ 6.406724][ C0] kernel_init_freeable+0x596/0x630 [ 6.406725][ C0] kernel_init+0x21/0x150 [ 6.406726][ C0] ret_from_fork+0x474/0x6b0 [ 6.406727][ C0] ret_from_fork_asm+0x11/0x20 [ 6.406728][ C0] [ 6.406729][ C0] -> (console_owner){..-.}-{0:0} { [ 6.406730][ C0] IN-SOFTIRQ-W at: [ 6.406731][ C0] __lock_acquire+0x388/0xc20 [ 6.406733][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.406734][ C0] console_lock_spinning_enable+0x5c/0x60 [ 6.406736][ C0] console_emit_next_record+0x1d1/0x4c0 [ 6.406737][ C0] console_flush_one_record+0x46f/0x710 [ 6.406739][ C0] console_unlock+0xee/0x1f0 [ 6.406740][ C0] vprintk_emit+0x37c/0x3e0 [ 6.406742][ C0] _printk+0xc7/0x100 [ 6.406743][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.406746][ C0] call_timer_fn+0x160/0x4d0 [ 6.406747][ C0] __run_timers+0x68f/0xaa0 [ 6.406749][ C0] run_timer_softirq+0xf0/0x160 [ 6.406750][ C0] handle_softirqs+0x1d3/0x900 [ 6.406753][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.406754][ C0] irq_exit_rcu+0xe/0x30 [ 6.406756][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.406758][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.406760][ C0] pv_native_safe_halt+0xf/0x10 [ 6.406761][ C0] default_idle+0x9/0x10 [ 6.406763][ C0] default_idle_call+0x6e/0xb0 [ 6.406764][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.406766][ C0] do_idle+0xd8/0x190 [ 6.406768][ C0] cpu_startup_entry+0x53/0x70 [ 6.406769][ C0] rest_init+0x279/0x280 [ 6.406770][ C0] start_kernel+0x3af/0x3b0 [ 6.406771][ C0] x86_64_start_reservations+0x24/0x30 [ 6.406774][ C0] x86_64_start_kernel+0x12b/0x130 [ 6.406775][ C0] common_startup_64+0x13e/0x148 [ 6.406778][ C0] INITIAL USE at: [ 6.406778][ C0] } [ 6.406779][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 6.406782][ C0] ... acquired at: [ 6.406782][ C0] mark_lock+0x1d7/0xa00 [ 6.406783][ C0] mark_usage+0x42/0x170 [ 6.406785][ C0] __lock_acquire+0x388/0xc20 [ 6.406786][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.406787][ C0] console_lock_spinning_enable+0x5c/0x60 [ 6.406789][ C0] console_emit_next_record+0x1d1/0x4c0 [ 6.406791][ C0] console_flush_one_record+0x46f/0x710 [ 6.406792][ C0] console_unlock+0xee/0x1f0 [ 6.406794][ C0] vprintk_emit+0x37c/0x3e0 [ 6.406795][ C0] _printk+0xc7/0x100 [ 6.406797][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.406798][ C0] call_timer_fn+0x160/0x4d0 [ 6.406799][ C0] __run_timers+0x68f/0xaa0 [ 6.406801][ C0] run_timer_softirq+0xf0/0x160 [ 6.406802][ C0] handle_softirqs+0x1d3/0x900 [ 6.406803][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.406804][ C0] irq_exit_rcu+0xe/0x30 [ 6.406806][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.406807][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.406808][ C0] pv_native_safe_halt+0xf/0x10 [ 6.406810][ C0] default_idle+0x9/0x10 [ 6.406811][ C0] default_idle_call+0x6e/0xb0 [ 6.406813][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.406814][ C0] do_idle+0xd8/0x190 [ 6.406815][ C0] cpu_startup_entry+0x53/0x70 [ 6.406816][ C0] rest_init+0x279/0x280 [ 6.406818][ C0] start_kernel+0x3af/0x3b0 [ 6.406819][ C0] x86_64_start_reservations+0x24/0x30 [ 6.406820][ C0] x86_64_start_kernel+0x12b/0x130 [ 6.406822][ C0] common_startup_64+0x13e/0x148 [ 6.406823][ C0] [ 6.406823][ C0] [ 6.406823][ C0] stack backtrace: [ 6.406826][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 6.406829][ C0] Tainted: [W]=WARN [ 6.406830][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 6.406832][ C0] Call Trace: [ 6.406833][ C0] [ 6.406834][ C0] dump_stack_lvl+0x6f/0xa0 [ 6.406838][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 6.406841][ C0] mark_lock_irq+0x989/0x9c0 [ 6.406842][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 6.406845][ C0] mark_lock+0x1d7/0xa00 [ 6.406847][ C0] mark_usage+0x42/0x170 [ 6.406849][ C0] __lock_acquire+0x388/0xc20 [ 6.406851][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.406853][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 6.406855][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.406858][ C0] ? lock_acquire+0x13c/0x160 [ 6.406860][ C0] console_lock_spinning_enable+0x5c/0x60 [ 6.406862][ C0] ? console_lock_spinning_enable+0x40/0x60 [ 6.406864][ C0] console_emit_next_record+0x1d1/0x4c0 [ 6.406866][ C0] ? devkmsg_read+0x4b0/0x4b0 [ 6.406867][ C0] ? console_flush_one_record+0x106/0x710 [ 6.406869][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.406871][ C0] ? lock_acquire+0x13c/0x160 [ 6.406873][ C0] console_flush_one_record+0x46f/0x710 [ 6.406876][ C0] ? console_emit_next_record+0x4c0/0x4c0 [ 6.406877][ C0] ? __lock_acquire+0x518/0xc20 [ 6.406880][ C0] console_unlock+0xee/0x1f0 [ 6.406881][ C0] ? console_flush_one_record+0x710/0x710 [ 6.406883][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.406885][ C0] ? lock_acquire+0x60/0x160 [ 6.406887][ C0] ? __down_trylock_console_sem+0x5e/0xa0 [ 6.406889][ C0] ? vprintk_emit+0x320/0x3e0 [ 6.406891][ C0] vprintk_emit+0x37c/0x3e0 [ 6.406893][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 6.406895][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 6.406897][ C0] _printk+0xc7/0x100 [ 6.406899][ C0] ? snapshot_read.cold+0x21/0x21 [ 6.406901][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 6.406902][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.406905][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.406906][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.406908][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.406910][ C0] call_timer_fn+0x160/0x4d0 [ 6.406912][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 6.406913][ C0] ? debug_object_active_state+0x430/0x430 [ 6.406917][ C0] ? find_held_lock+0x2b/0x80 [ 6.406919][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.406920][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.406923][ C0] __run_timers+0x68f/0xaa0 [ 6.406925][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.406927][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 6.406929][ C0] ? __lock_acquire+0x518/0xc20 [ 6.406931][ C0] ? __rwlock_init+0x150/0x150 [ 6.406934][ C0] run_timer_softirq+0xf0/0x160 [ 6.406936][ C0] ? __run_timers+0xaa0/0xaa0 [ 6.406937][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 6.406940][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.406942][ C0] handle_softirqs+0x1d3/0x900 [ 6.406944][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.406945][ C0] ? _local_bh_enable+0xc0/0xc0 [ 6.406947][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.406949][ C0] irq_exit_rcu+0xe/0x30 [ 6.406950][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.406952][ C0] [ 6.406953][ C0] [ 6.406953][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 6.406955][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.406956][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 6.406959][ C0] Code: 48 8b 3d 94 e2 f5 01 e8 1f 00 00 00 48 2b 05 58 a3 95 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 96 11 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 6.406961][ C0] RSP: 0018:ffffffffaa207cf8 EFLAGS: 00000296 [ 6.406963][ C0] RAX: 000000000003abb1 RBX: ffffffffaa21c600 RCX: ffffffffa72f0307 [ 6.406964][ C0] RDX: ffffffffaa21c600 RSI: ffffffffaa038b01 RDI: ffffffffa9a8d8e0 [ 6.406965][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6.406966][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff5440fa2 [ 6.406967][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 6.406968][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.406971][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 6.406972][ C0] default_idle+0x9/0x10 [ 6.406974][ C0] default_idle_call+0x6e/0xb0 [ 6.406976][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.406977][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 6.406979][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 6.406981][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.406983][ C0] do_idle+0xd8/0x190 [ 6.406985][ C0] cpu_startup_entry+0x53/0x70 [ 6.406986][ C0] rest_init+0x279/0x280 [ 6.406988][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 6.406991][ C0] ? rest_init+0x280/0x280 [ 6.406993][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 6.406997][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 6.407004][ C0] ? acpi_enable+0x1e4/0x330 [ 6.407006][ C0] start_kernel+0x3af/0x3b0 [ 6.407008][ C0] x86_64_start_reservations+0x24/0x30 [ 6.407009][ C0] x86_64_start_kernel+0x12b/0x130 [ 6.407011][ C0] common_startup_64+0x13e/0x148 [ 6.407014][ C0]