virtme: waiting for virtiofsd to start virtme: use 'microvm' QEMU architecture [ 1.241769][ T1] loop: module loaded [ 1.241822][ T1] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 1.241824][ T1] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 [ 1.241826][ T1] preempt_count: 1, expected: 0 [ 1.241828][ T1] RCU nest depth: 0, expected: 0 [ 1.241829][ T1] locks held by swapper/0/1: 4, last CPU#3: [ 1.241832][ T1] #0: ffffffff9cd69cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 1.241847][ T1] #1: ffffffff9cd69d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 1.241853][ T1] #2: ffffffff9cc89660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 1.241860][ T1] #3: ffffffff9cc89560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 1.241865][ T1] irq event stamp: 300620 [ 1.241867][ T1] hardirqs last enabled at (300619): [] __down_trylock_console_sem+0x86/0xa0 [ 1.241870][ T1] hardirqs last disabled at (300620): [] console_emit_next_record+0x3d4/0x4c0 [ 1.241873][ T1] softirqs last enabled at (300564): [] bdi_register_va+0x491/0x780 [ 1.241877][ T1] softirqs last disabled at (300562): [] bdi_register_va+0x2ef/0x780 [ 1.241881][ T1] Preemption disabled at: [ 1.241881][ T1] [] vprintk_emit+0x31b/0x3e0 [ 1.241888][ T1] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 7.2.0-virtme #1 PREEMPT(full) [ 1.241892][ T1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1.241895][ T1] Call Trace: [ 1.241897][ T1] [ 1.241901][ T1] dump_stack_lvl+0x6f/0xa0 [ 1.241909][ T1] ? vprintk_emit+0x31b/0x3e0 [ 1.241912][ T1] __might_resched.cold+0x1fe/0x2c1 [ 1.241917][ T1] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 1.241923][ T1] ? __kmalloc_noprof+0xdb/0x760 [ 1.241930][ T1] __kmalloc_noprof+0x443/0x760 [ 1.241933][ T1] ? alloc_buf.isra.0+0x4b/0x260 [ 1.241941][ T1] ? do_raw_spin_unlock+0x59/0x250 [ 1.241945][ T1] alloc_buf.isra.0+0x4b/0x260 [ 1.241949][ T1] put_chars+0x1e1/0x2f0 [ 1.241951][ T1] ? desc_read_finalized_seq+0x79/0x120 [ 1.241955][ T1] ? __send_to_port+0x420/0x420 [ 1.241960][ T1] ? rcu_read_lock_any_held+0x3c/0x90 [ 1.241964][ T1] ? validate_chain+0x38b/0xc20 [ 1.241971][ T1] hvc_console_print+0x292/0x780 [ 1.241974][ T1] ? __lock_acquire+0x518/0xc20 [ 1.241976][ T1] ? __lock_acquire+0x518/0xc20 [ 1.241983][ T1] ? hvc_write+0x3a0/0x3a0 [ 1.241985][ T1] ? console_emit_next_record+0x1df/0x4c0 [ 1.241990][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.241994][ T1] ? lock_acquire+0x13c/0x160 [ 1.242001][ T1] console_emit_next_record+0x22f/0x4c0 [ 1.242006][ T1] ? devkmsg_read+0x4b0/0x4b0 [ 1.242009][ T1] ? console_flush_one_record+0x106/0x710 [ 1.242014][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.242017][ T1] ? lock_acquire+0x13c/0x160 [ 1.242024][ T1] console_flush_one_record+0x46f/0x710 [ 1.242030][ T1] ? console_emit_next_record+0x4c0/0x4c0 [ 1.242033][ T1] ? __lock_acquire+0x518/0xc20 [ 1.242041][ T1] console_unlock+0xee/0x1f0 [ 1.242045][ T1] ? console_flush_one_record+0x710/0x710 [ 1.242048][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.242051][ T1] ? lock_acquire+0x60/0x160 [ 1.242057][ T1] ? __down_trylock_console_sem+0x5e/0xa0 [ 1.242060][ T1] ? vprintk_emit+0x320/0x3e0 [ 1.242065][ T1] vprintk_emit+0x37c/0x3e0 [ 1.242071][ T1] ? wake_up_klogd_work_func+0x90/0x90 [ 1.242080][ T1] ? max_loop_setup+0x30/0x30 [ 1.242086][ T1] _printk+0xc7/0x100 [ 1.242090][ T1] ? snapshot_read.cold+0x21/0x21 [ 1.242101][ T1] ? __mutex_unlock_slowpath+0x14d/0x740 [ 1.242107][ T1] loop_init+0x12a/0x130 [ 1.242111][ T1] do_one_initcall+0x124/0x4f0 [ 1.242116][ T1] ? trace_event_raw_event_initcall_level+0x280/0x280 [ 1.242118][ T1] ? parameq+0x110/0x110 [ 1.242126][ T1] ? kernel_init_freeable+0x3f1/0x630 [ 1.242131][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.242137][ T1] kernel_init_freeable+0x596/0x630 [ 1.242142][ T1] ? rest_init+0x280/0x280 [ 1.242147][ T1] kernel_init+0x21/0x150 [ 1.242150][ T1] ? rest_init+0x280/0x280 [ 1.242153][ T1] ret_from_fork+0x474/0x6b0 [ 1.242158][ T1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1.242164][ T1] ? __switch_to+0x5a3/0xe00 [ 1.242168][ T1] ? rest_init+0x280/0x280 [ 1.242173][ T1] ret_from_fork_asm+0x11/0x20 [ 1.242187][ T1] [ 1.282635][ T1] i8042: PNP: No PS/2 controller found. [ 1.299244][ T1] rtc_cmos PNP0B00:00: registered as rtc0 [ 1.299899][ T1] rtc_cmos PNP0B00:00: setting system clock to 2026-08-28T03:24:29 UTC (1787887469) [ 1.301382][ T1] rtc_cmos PNP0B00:00: alarms up to one day, 242 bytes nvram [ 1.306281][ T1] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev [ 1.318178][ T1] NET: Registered PF_INET6 protocol family [ 1.326405][ T1] Segment Routing with IPv6 [ 1.327130][ T1] In-situ OAM (IOAM) with IPv6 [ 1.327822][ T1] NET: Registered PF_PACKET protocol family [ 1.328245][ T1] 9pnet: Installing 9P2000 support [ 1.328866][ T1] Key type dns_resolver registered [ 1.329949][ T1] NET: Registered PF_VSOCK protocol family [ 1.337233][ T1] IPI shorthand broadcast: enabled [ 1.436614][ T71] kwatchdog (71) used greatest stack depth: 29688 bytes left [ 1.484022][ T1] sched_clock: Marking stable (1443001969, 40683661)->(1586082760, -102397130) [ 1.487919][ T1] registered taskstats version 1 [ 1.489798][ T1] Loading compiled-in X.509 certificates [ 1.595056][ T1] Demotion targets for Node 0: null [ 1.595383][ T1] kmemleak: Kernel memory leak detector initialized (mem pool available: 11726) [ 1.595711][ T1] page_owner is disabled [ 1.596931][ T1] PM: Magic number: 6:806:412 [ 1.597387][ T1] netconsole: network logging started [ 1.598946][ T1] ALSA device list: [ 1.599718][ T1] No soundcards found. [ 1.601350][ T1] md: Skipping autodetection of RAID arrays. (raid=autodetect will force) [ 1.604061][ T1] VFS: Mounted root (virtiofs filesystem) readonly on device 0:24. [ 1.604968][ T1] devtmpfs: mounted [ 1.605258][ T1] VFS: Pivoted into new rootfs [ 1.635023][ T1] Freeing unused kernel image (initmem) memory: 2544K [ 1.635268][ T1] Write protecting the kernel read-only data: 55296k [ 1.635818][ T1] Freeing unused kernel image (text/rodata gap) memory: 328K [ 1.636239][ T1] Freeing unused kernel image (rodata/data gap) memory: 556K [ 1.636628][ T1] Run /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init as init process [ 1.636938][ T1] with arguments: [ 1.637071][ T1] /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init [ 1.637365][ T1] with environment: [ 1.637497][ T1] HOME=/ [ 1.637623][ T1] TERM=dumb [ 1.637749][ T1] virtme_hostname=vmksft-forwarding-dbg,debug-threads=on [ 1.637991][ T1] nr_open=2147483584 [ 1.638116][ T1] virtme_link_mods=/srv/vmksft/testing/wt-4/.virtme_mods/lib/modules/0.0.0 [ 1.638403][ T1] virtme_rw_overlay0=/etc [ 1.638576][ T1] virtme_rw_overlay1=/lib [ 1.638750][ T1] virtme_rw_overlay2=/home [ 1.638915][ T1] virtme_rw_overlay3=/opt [ 1.639075][ T1] virtme_rw_overlay4=/srv [ 1.639234][ T1] virtme_rw_overlay5=/usr [ 1.639402][ T1] virtme_rw_overlay6=/var [ 1.639574][ T1] virtme_rw_overlay7=/tmp [ 1.639748][ T1] virtme_console=ttyS0 [ 1.639917][ T1] virtme_chdir=srv/vmksft/testing/wt-4 [ 1.660760][ T1] virtme-ng-init: mount devtmpfs -> /dev: EBUSY: Device or resource busy [ 1.662138][ T1] virtme-ng-init: Setting hostname to vmksft-forwarding-dbg,debug-threads=on... [ 1.679727][ T1] overlayfs: failed to set xattr on upper [ 1.680112][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.680440][ T1] overlayfs: ...falling back to uuid=null. [ 1.683334][ T1] overlayfs: failed to set xattr on upper [ 1.683895][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.684242][ T1] overlayfs: ...falling back to uuid=null. [ 1.686938][ T1] overlayfs: failed to set xattr on upper [ 1.687180][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.687500][ T1] overlayfs: ...falling back to uuid=null. [ 1.689543][ T1] overlayfs: failed to set xattr on upper [ 1.689806][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.690111][ T1] overlayfs: ...falling back to uuid=null. [ 1.692478][ T1] overlayfs: failed to set xattr on upper [ 1.692727][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.693026][ T1] overlayfs: ...falling back to uuid=null. [ 1.694932][ T1] overlayfs: failed to set xattr on upper [ 1.695191][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.695569][ T1] overlayfs: ...falling back to uuid=null. [ 1.697610][ T1] overlayfs: failed to set xattr on upper [ 1.697925][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.698233][ T1] overlayfs: ...falling back to uuid=null. [ 1.701110][ T1] overlayfs: failed to set xattr on upper [ 1.701369][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.701727][ T1] overlayfs: ...falling back to uuid=null. [ 1.713471][ T1] virtme-ng-init: running systemd-tmpfiles [ 4.056000][ T74] systemd-tmpfile (74) used greatest stack depth: 25088 bytes left [ 4.056018][ T74] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 4.056021][ T74] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 74, name: systemd-tmpfile [ 4.056022][ T74] preempt_count: 2, expected: 0 [ 4.056023][ T74] RCU nest depth: 0, expected: 0 [ 4.056025][ T74] locks held by systemd-tmpfile/74: 5, last CPU#0: [ 4.056027][ T74] #0: ffffffff9cc027b8 (low_water_lock){+.+.}-{3:3}, at: do_exit+0x887/0xdc0 [ 4.056041][ T74] #1: ffffffff9cd69cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 4.056046][ T74] #2: ffffffff9cd69d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 4.056050][ T74] #3: ffffffff9cc89660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 4.056055][ T74] #4: ffffffff9cc89560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 4.056059][ T74] irq event stamp: 2361742 [ 4.056060][ T74] hardirqs last enabled at (2361741): [] __down_trylock_console_sem+0x86/0xa0 [ 4.056062][ T74] hardirqs last disabled at (2361742): [] console_emit_next_record+0x3d4/0x4c0 [ 4.056065][ T74] softirqs last enabled at (2361524): [] handle_softirqs+0x67c/0x900 [ 4.056067][ T74] softirqs last disabled at (2361517): [] __irq_exit_rcu+0x145/0x1c0 [ 4.056069][ T74] Preemption disabled at: [ 4.056070][ T74] [<0000000000000000>] 0x0 [ 4.056076][ T74] CPU: 0 UID: 0 PID: 74 Comm: systemd-tmpfile Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 4.056080][ T74] Tainted: [W]=WARN [ 4.056081][ T74] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 4.056083][ T74] Call Trace: [ 4.056084][ T74] [ 4.056086][ T74] dump_stack_lvl+0x6f/0xa0 [ 4.056092][ T74] __might_resched.cold+0x1fe/0x2c1 [ 4.056097][ T74] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 4.056101][ T74] ? __kmalloc_noprof+0xdb/0x760 [ 4.056106][ T74] __kmalloc_noprof+0x443/0x760 [ 4.056109][ T74] ? alloc_buf.isra.0+0x4b/0x260 [ 4.056115][ T74] ? do_raw_spin_unlock+0x59/0x250 [ 4.056118][ T74] alloc_buf.isra.0+0x4b/0x260 [ 4.056121][ T74] put_chars+0x1e1/0x2f0 [ 4.056124][ T74] ? __send_to_port+0x420/0x420 [ 4.056125][ T74] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 4.056130][ T74] ? validate_chain+0x38b/0xc20 [ 4.056135][ T74] hvc_console_print+0x292/0x780 [ 4.056142][ T74] ? hvc_write+0x3a0/0x3a0 [ 4.056144][ T74] ? rcu_is_watching+0x16/0xd0 [ 4.056147][ T74] ? lock_acquire+0x13c/0x160 [ 4.056151][ T74] console_emit_next_record+0x22f/0x4c0 [ 4.056155][ T74] ? devkmsg_read+0x4b0/0x4b0 [ 4.056157][ T74] ? console_flush_one_record+0x106/0x710 [ 4.056160][ T74] ? rcu_is_watching+0x16/0xd0 [ 4.056163][ T74] ? lock_acquire+0x13c/0x160 [ 4.056167][ T74] console_flush_one_record+0x46f/0x710 [ 4.056171][ T74] ? console_emit_next_record+0x4c0/0x4c0 [ 4.056173][ T74] ? __lock_acquire+0x518/0xc20 [ 4.056179][ T74] console_unlock+0xee/0x1f0 [ 4.056182][ T74] ? console_flush_one_record+0x710/0x710 [ 4.056183][ T74] ? rcu_is_watching+0x16/0xd0 [ 4.056186][ T74] ? lock_acquire+0x60/0x160 [ 4.056190][ T74] ? __down_trylock_console_sem+0x5e/0xa0 [ 4.056192][ T74] ? vprintk_emit+0x320/0x3e0 [ 4.056195][ T74] vprintk_emit+0x37c/0x3e0 [ 4.056199][ T74] ? wake_up_klogd_work_func+0x90/0x90 [ 4.056203][ T74] ? __lock_acquire+0x518/0xc20 [ 4.056206][ T74] _printk+0xc7/0x100 [ 4.056210][ T74] ? snapshot_read.cold+0x21/0x21 [ 4.056213][ T74] ? do_raw_spin_lock+0x131/0x280 [ 4.056213][ T1] virtme-ng-init: Failed to read '/usr/lib/tmpfiles.d/audit.conf': Permission denied [ 4.056213][ T1] Failed to create directory or subvolume "/var/spool/at/spool": Permission denied [ 4.056213][ T1] Failed to create file /var/spool/at/.SEQ: Permission denied [ 4.056213][ T1] Failed to opendir() '/proc/self/fd/6': Permission denied [ 4.056216][ T74] ? __rwlock_init+0x150/0x150 [ 4.056220][ T74] ? do_raw_spin_lock+0x131/0x280 [ 4.056223][ T74] do_exit.cold+0x82/0x9c [ 4.056227][ T74] ? exit_notify+0x890/0x890 [ 4.056229][ T74] ? __lock_release.isra.0+0x69/0x1a0 [ 4.056232][ T74] ? rcu_is_watching+0x16/0xd0 [ 4.056236][ T74] do_group_exit+0xb8/0x370 [ 4.056239][ T74] __x64_sys_exit_group+0x3c/0x50 [ 4.056241][ T74] x64_sys_call+0x1567/0x1570 [ 4.056243][ T74] do_syscall_64+0xff/0x530 [ 4.056246][ T74] ? exc_page_fault+0xee/0x100 [ 4.056249][ T74] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4.056252][ T74] RIP: 0033:0x7f7ccfbec1b8 [ 4.056254][ T74] Code: Unable to access opcode bytes at 0x7f7ccfbec18e. [ 4.056255][ T74] RSP: 002b:00007ffc2f53cec8 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7 [ 4.056257][ T74] RAX: ffffffffffffffda RBX: 00007f7ccfd1cf88 RCX: 00007f7ccfbec1b8 [ 4.056259][ T74] RDX: 00007f7ccf44a4c8 RSI: fffffffffffffe90 RDI: 0000000000000049 [ 4.056260][ T74] RBP: 00007ffc2f53cf20 R08: 0000000000000000 R09: 0000000000001000 [ 4.056261][ T74] R10: 00007ffc2f53cce0 R11: 0000000000000246 R12: 0000000000000001 [ 4.056261][ T74] R13: 0000000000000049 R14: 00007f7ccfd1b680 R15: 00007f7ccfd1cfa0 [ 4.056268][ T74] [ 4.079359][ T1] virtme-ng-init: basic initialization done [ 4.092076][ T76] virtme-ng-init (76) used greatest stack depth: 24848 bytes left [ 4.122419][ T79] ip (79) used greatest stack depth: 23664 bytes left [ 4.147291][ T75] virtme-ng-init: Starting systemd-udevd version 259.8-1.fc44 [ 4.147706][ T75] virtme-ng-init: triggering udev coldplug [ 6.431595][ T75] virtme-ng-init: waiting for udev to settle [ 6.431609][ T75] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 6.431612][ T75] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 75, name: virtme-ng-init [ 6.431613][ T75] preempt_count: 1, expected: 0 [ 6.431614][ T75] RCU nest depth: 0, expected: 0 [ 6.431615][ T75] locks held by virtme-ng-init/75: 4, last CPU#3: [ 6.431618][ T75] #0: ffffffff9cd69cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 6.431631][ T75] #1: ffffffff9cd69d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 6.431636][ T75] #2: ffffffff9cc89660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 6.431640][ T75] #3: ffffffff9cc89560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 6.431644][ T75] irq event stamp: 3004 [ 6.431645][ T75] hardirqs last enabled at (3003): [] __down_trylock_console_sem+0x86/0xa0 [ 6.431647][ T75] hardirqs last disabled at (3004): [] console_emit_next_record+0x3d4/0x4c0 [ 6.431649][ T75] softirqs last enabled at (2510): [] fpu_clone+0xd9/0x410 [ 6.431653][ T75] softirqs last disabled at (2508): [] fpu_clone+0x82/0x410 [ 6.431655][ T75] Preemption disabled at: [ 6.431656][ T75] [] vprintk_emit+0x31b/0x3e0 [ 6.431662][ T75] CPU: 3 UID: 0 PID: 75 Comm: virtme-ng-init Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 6.431665][ T75] Tainted: [W]=WARN [ 6.431666][ T75] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 6.431668][ T75] Call Trace: [ 6.431669][ T75] [ 6.431671][ T75] dump_stack_lvl+0x6f/0xa0 [ 6.431677][ T75] ? vprintk_emit+0x31b/0x3e0 [ 6.431679][ T75] __might_resched.cold+0x1fe/0x2c1 [ 6.431687][ T75] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 6.431691][ T75] ? __kmalloc_noprof+0xdb/0x760 [ 6.431696][ T75] __kmalloc_noprof+0x443/0x760 [ 6.431698][ T75] ? alloc_buf.isra.0+0x4b/0x260 [ 6.431704][ T75] ? do_raw_spin_unlock+0x59/0x250 [ 6.431707][ T75] alloc_buf.isra.0+0x4b/0x260 [ 6.431710][ T75] put_chars+0x1e1/0x2f0 [ 6.431713][ T75] ? __send_to_port+0x420/0x420 [ 6.431714][ T75] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 6.431719][ T75] ? validate_chain+0x38b/0xc20 [ 6.431724][ T75] hvc_console_print+0x292/0x780 [ 6.431730][ T75] ? hvc_write+0x3a0/0x3a0 [ 6.431733][ T75] ? rcu_is_watching+0x16/0xd0 [ 6.431735][ T75] ? lock_acquire+0x13c/0x160 [ 6.431739][ T75] console_emit_next_record+0x22f/0x4c0 [ 6.431743][ T75] ? devkmsg_read+0x4b0/0x4b0 [ 6.431745][ T75] ? console_flush_one_record+0x106/0x710 [ 6.431748][ T75] ? rcu_is_watching+0x16/0xd0 [ 6.431750][ T75] ? lock_acquire+0x13c/0x160 [ 6.431754][ T75] console_flush_one_record+0x46f/0x710 [ 6.431758][ T75] ? console_emit_next_record+0x4c0/0x4c0 [ 6.431760][ T75] ? __lock_acquire+0x518/0xc20 [ 6.431765][ T75] console_unlock+0xee/0x1f0 [ 6.431768][ T75] ? console_flush_one_record+0x710/0x710 [ 6.431770][ T75] ? rcu_is_watching+0x16/0xd0 [ 6.431772][ T75] ? lock_acquire+0x60/0x160 [ 6.431776][ T75] ? __down_trylock_console_sem+0x5e/0xa0 [ 6.431778][ T75] ? vprintk_emit+0x320/0x3e0 [ 6.431781][ T75] vprintk_emit+0x37c/0x3e0 [ 6.431785][ T75] ? wake_up_klogd_work_func+0x90/0x90 [ 6.431788][ T75] ? _copy_from_iter+0x1bb/0x1810 [ 6.431794][ T75] devkmsg_emit.constprop.0+0xbc/0xf1 [ 6.431798][ T75] ? vprintk_emit.cold+0x107/0x107 [ 6.431800][ T75] ? simple_strntoull+0x10f/0x140 [ 6.431804][ T75] ? date_str+0x1e0/0x1e0 [ 6.431807][ T75] ? devkmsg_write+0xd1/0x2c0 [ 6.431812][ T75] devkmsg_write.cold+0x5a/0x8b [ 6.431814][ T75] ? vprintk_default+0x20/0x20 [ 6.431819][ T75] ? vprintk_default+0x20/0x20 [ 6.431822][ T75] new_sync_write+0x33e/0x760 [ 6.431825][ T75] ? kasan_quarantine_put+0x42/0x2b0 [ 6.431829][ T75] ? new_sync_read+0x750/0x750 [ 6.431833][ T75] ? __lock_release.isra.0+0x69/0x1a0 [ 6.431838][ T75] ? __fget_files+0x1e3/0x460 [ 6.431842][ T75] vfs_write+0x6a2/0xbd0 [ 6.431847][ T75] ksys_write+0x116/0x250 [ 6.431850][ T75] ? __ia32_sys_read+0xc0/0xc0 [ 6.431853][ T75] ? rcu_is_watching+0x16/0xd0 [ 6.431857][ T75] do_syscall_64+0xff/0x530 [ 6.431859][ T75] ? exc_page_fault+0xee/0x100 [ 6.431862][ T75] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 6.431864][ T75] RIP: 0033:0x7f4769647ed2 [ 6.431868][ T75] Code: 08 0f 85 51 ec ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 f3 0f 1e fa 55 48 89 e5 [ 6.431870][ T75] RSP: 002b:00007f476958ec68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 [ 6.431873][ T75] RAX: ffffffffffffffda RBX: 000000000000002e RCX: 00007f4769647ed2 [ 6.431874][ T75] RDX: 000000000000002e RSI: 00007f47640012c0 RDI: 0000000000000003 [ 6.431875][ T75] RBP: 00007f476958ec90 R08: 0000000000000000 R09: 0000000000000000 [ 6.431876][ T75] R10: 0000000000000000 R11: 0000000000000246 R12: 00007f47696d20a0 [ 6.431877][ T75] R13: 00007f47695d03e0 R14: 00007f47640012c0 R15: 00007f476958eda8 [ 6.431884][ T75] [ 6.435822][ C0] clocksource: Watchdog remote CPU 3 read timed out [ 6.435859][ C0] [ 6.435860][ C0] ======================================================== [ 6.435861][ C0] WARNING: possible irq lock inversion dependency detected [ 6.435862][ C0] 7.2.0-virtme #1 Tainted: G W [ 6.435864][ C0] -------------------------------------------------------- [ 6.435864][ C0] swapper/0/0 just changed the state of lock: [ 6.435866][ C0] ffffffff9cc89660 (console_owner){..-.}-{0:0}, at: console_trylock_spinning+0xa4/0x1e0 [ 6.435874][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 6.435875][ C0] (fs_reclaim){+.+.}-{0:0} [ 6.435876][ C0] [ 6.435876][ C0] [ 6.435876][ C0] and interrupts could create inverse lock ordering between them. [ 6.435876][ C0] [ 6.435877][ C0] [ 6.435877][ C0] other info that might help us debug this: [ 6.435878][ C0] Possible interrupt unsafe locking scenario: [ 6.435878][ C0] [ 6.435878][ C0] CPU0 CPU1 [ 6.435879][ C0] ---- ---- [ 6.435879][ C0] lock(fs_reclaim); [ 6.435880][ C0] local_irq_disable(); [ 6.435881][ C0] lock(console_owner); [ 6.435882][ C0] lock(fs_reclaim); [ 6.435883][ C0] [ 6.435883][ C0] lock(console_owner); [ 6.435884][ C0] [ 6.435884][ C0] *** DEADLOCK *** [ 6.435884][ C0] [ 6.435884][ C0] locks held by swapper/0/0: 2, last CPU#0: [ 6.435886][ C0] #0: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 6.435891][ C0] #1: ffffffff9cdce8b8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 6.435896][ C0] [ 6.435896][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 6.435902][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 6.435905][ C0] HARDIRQ-ON-W at: [ 6.435906][ C0] __lock_acquire+0x388/0xc20 [ 6.435909][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.435910][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.435913][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.435915][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.435918][ C0] workqueue_init+0x2a/0x680 [ 6.435921][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.435923][ C0] kernel_init+0x21/0x150 [ 6.435926][ C0] ret_from_fork+0x474/0x6b0 [ 6.435928][ C0] ret_from_fork_asm+0x11/0x20 [ 6.435930][ C0] SOFTIRQ-ON-W at: [ 6.435930][ C0] __lock_acquire+0x388/0xc20 [ 6.435932][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.435933][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.435934][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.435936][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.435938][ C0] workqueue_init+0x2a/0x680 [ 6.435939][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.435940][ C0] kernel_init+0x21/0x150 [ 6.435941][ C0] ret_from_fork+0x474/0x6b0 [ 6.435942][ C0] ret_from_fork_asm+0x11/0x20 [ 6.435944][ C0] INITIAL USE at: [ 6.435945][ C0] __lock_acquire+0x388/0xc20 [ 6.435946][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.435947][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.435949][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.435950][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.435951][ C0] workqueue_init+0x2a/0x680 [ 6.435952][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.435953][ C0] kernel_init+0x21/0x150 [ 6.435955][ C0] ret_from_fork+0x474/0x6b0 [ 6.435956][ C0] ret_from_fork_asm+0x11/0x20 [ 6.435957][ C0] } [ 6.435958][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 6.435962][ C0] ... acquired at: [ 6.435963][ C0] __lock_acquire+0x518/0xc20 [ 6.435965][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.435967][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.435969][ C0] __kmalloc_noprof+0xd3/0x760 [ 6.435971][ C0] alloc_buf.isra.0+0x4b/0x260 [ 6.435974][ C0] put_chars+0x1e1/0x2f0 [ 6.435975][ C0] hvc_console_print+0x292/0x780 [ 6.435976][ C0] console_emit_next_record+0x22f/0x4c0 [ 6.435978][ C0] console_flush_one_record+0x46f/0x710 [ 6.435980][ C0] console_unlock+0xee/0x1f0 [ 6.435981][ C0] vprintk_emit+0x37c/0x3e0 [ 6.435983][ C0] _printk+0xc7/0x100 [ 6.435985][ C0] loop_init+0x12a/0x130 [ 6.435988][ C0] do_one_initcall+0x124/0x4f0 [ 6.435989][ C0] kernel_init_freeable+0x596/0x630 [ 6.435991][ C0] kernel_init+0x21/0x150 [ 6.435992][ C0] ret_from_fork+0x474/0x6b0 [ 6.435993][ C0] ret_from_fork_asm+0x11/0x20 [ 6.435994][ C0] [ 6.435995][ C0] -> (console_owner){..-.}-{0:0} { [ 6.435997][ C0] IN-SOFTIRQ-W at: [ 6.435998][ C0] __lock_acquire+0x388/0xc20 [ 6.435999][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.436000][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.436002][ C0] vprintk_emit+0x320/0x3e0 [ 6.436004][ C0] _printk+0xc7/0x100 [ 6.436005][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.436007][ C0] call_timer_fn+0x160/0x4d0 [ 6.436009][ C0] __run_timers+0x68f/0xaa0 [ 6.436011][ C0] run_timer_softirq+0xf0/0x160 [ 6.436012][ C0] handle_softirqs+0x1d3/0x900 [ 6.436015][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.436016][ C0] irq_exit_rcu+0xe/0x30 [ 6.436018][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.436019][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.436021][ C0] pv_native_safe_halt+0xf/0x10 [ 6.436023][ C0] default_idle+0x9/0x10 [ 6.436024][ C0] default_idle_call+0x6e/0xb0 [ 6.436026][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.436028][ C0] do_idle+0xd8/0x190 [ 6.436029][ C0] cpu_startup_entry+0x53/0x70 [ 6.436031][ C0] rest_init+0x279/0x280 [ 6.436033][ C0] start_kernel+0x3af/0x3b0 [ 6.436035][ C0] x86_64_start_reservations+0x24/0x30 [ 6.436038][ C0] x86_64_start_kernel+0x12b/0x130 [ 6.436040][ C0] common_startup_64+0x13e/0x148 [ 6.436043][ C0] INITIAL USE at: [ 6.436044][ C0] } [ 6.436045][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 6.436048][ C0] ... acquired at: [ 6.436048][ C0] mark_lock+0x1d7/0xa00 [ 6.436050][ C0] mark_usage+0x42/0x170 [ 6.436051][ C0] __lock_acquire+0x388/0xc20 [ 6.436052][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.436054][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.436055][ C0] vprintk_emit+0x320/0x3e0 [ 6.436058][ C0] _printk+0xc7/0x100 [ 6.436059][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.436061][ C0] call_timer_fn+0x160/0x4d0 [ 6.436063][ C0] __run_timers+0x68f/0xaa0 [ 6.436064][ C0] run_timer_softirq+0xf0/0x160 [ 6.436066][ C0] handle_softirqs+0x1d3/0x900 [ 6.436067][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.436068][ C0] irq_exit_rcu+0xe/0x30 [ 6.436070][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.436071][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.436072][ C0] pv_native_safe_halt+0xf/0x10 [ 6.436074][ C0] default_idle+0x9/0x10 [ 6.436075][ C0] default_idle_call+0x6e/0xb0 [ 6.436077][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.436078][ C0] do_idle+0xd8/0x190 [ 6.436079][ C0] cpu_startup_entry+0x53/0x70 [ 6.436080][ C0] rest_init+0x279/0x280 [ 6.436082][ C0] start_kernel+0x3af/0x3b0 [ 6.436083][ C0] x86_64_start_reservations+0x24/0x30 [ 6.436085][ C0] x86_64_start_kernel+0x12b/0x130 [ 6.436086][ C0] common_startup_64+0x13e/0x148 [ 6.436087][ C0] [ 6.436088][ C0] [ 6.436088][ C0] stack backtrace: [ 6.436090][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 6.436094][ C0] Tainted: [W]=WARN [ 6.436095][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 6.436096][ C0] Call Trace: [ 6.436098][ C0] [ 6.436099][ C0] dump_stack_lvl+0x6f/0xa0 [ 6.436102][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 6.436104][ C0] mark_lock_irq+0x989/0x9c0 [ 6.436106][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 6.436109][ C0] mark_lock+0x1d7/0xa00 [ 6.436111][ C0] mark_usage+0x42/0x170 [ 6.436113][ C0] __lock_acquire+0x388/0xc20 [ 6.436115][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.436117][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 6.436119][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.436121][ C0] ? lock_acquire+0x13c/0x160 [ 6.436124][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.436125][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 6.436127][ C0] vprintk_emit+0x320/0x3e0 [ 6.436130][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 6.436132][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 6.436134][ C0] _printk+0xc7/0x100 [ 6.436136][ C0] ? snapshot_read.cold+0x21/0x21 [ 6.436138][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 6.436139][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.436142][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.436144][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.436147][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.436149][ C0] call_timer_fn+0x160/0x4d0 [ 6.436152][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 6.436154][ C0] ? debug_object_active_state+0x430/0x430 [ 6.436157][ C0] ? find_held_lock+0x2b/0x80 [ 6.436159][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.436160][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.436163][ C0] __run_timers+0x68f/0xaa0 [ 6.436164][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.436167][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 6.436169][ C0] ? __lock_acquire+0x518/0xc20 [ 6.436171][ C0] ? __rwlock_init+0x150/0x150 [ 6.436174][ C0] run_timer_softirq+0xf0/0x160 [ 6.436176][ C0] ? __run_timers+0xaa0/0xaa0 [ 6.436178][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 6.436180][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.436182][ C0] handle_softirqs+0x1d3/0x900 [ 6.436184][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.436185][ C0] ? _local_bh_enable+0xc0/0xc0 [ 6.436187][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.436189][ C0] irq_exit_rcu+0xe/0x30 [ 6.436190][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.436192][ C0] [ 6.436193][ C0] [ 6.436193][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 6.436195][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.436197][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 6.436200][ C0] Code: 48 8b 3d 94 e2 f5 01 e8 1f 00 00 00 48 2b 05 58 a3 95 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 96 11 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 6.436202][ C0] RSP: 0018:ffffffff9ca07cf8 EFLAGS: 00000296 [ 6.436205][ C0] RAX: 000000000002c72d RBX: ffffffff9ca1c600 RCX: ffffffff99af0307 [ 6.436207][ C0] RDX: ffffffff9ca1c600 RSI: ffffffff9c838b01 RDI: ffffffff9c28d8e0 [ 6.436208][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6.436208][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff3940fa2 [ 6.436209][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 6.436211][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.436213][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 6.436215][ C0] default_idle+0x9/0x10 [ 6.436217][ C0] default_idle_call+0x6e/0xb0 [ 6.436218][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.436220][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 6.436222][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 6.436224][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 6.436225][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.436228][ C0] do_idle+0xd8/0x190 [ 6.436229][ C0] cpu_startup_entry+0x53/0x70 [ 6.436231][ C0] rest_init+0x279/0x280 [ 6.436232][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 6.436235][ C0] ? rest_init+0x280/0x280 [ 6.436237][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 6.436241][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 6.436244][ C0] ? acpi_enable+0x1e4/0x330 [ 6.436247][ C0] start_kernel+0x3af/0x3b0 [ 6.436248][ C0] x86_64_start_reservations+0x24/0x30 [ 6.436250][ C0] x86_64_start_kernel+0x12b/0x130 [ 6.436252][ C0] common_startup_64+0x13e/0x148 [ 6.436255][ C0] [ 6.775239][ T75] virtme-ng-init: udev is done [ 6.777826][ T1] virtme-ng-init: initialization done