virtme: waiting for virtiofsd to start virtme: use 'microvm' QEMU architecture [ 1.259438][ T1] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev [ 1.259473][ T1] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 1.259475][ T1] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 [ 1.259476][ T1] preempt_count: 1, expected: 0 [ 1.259477][ T1] RCU nest depth: 0, expected: 0 [ 1.259478][ T1] locks held by swapper/0/1: 4, last CPU#1: [ 1.259480][ T1] #0: ffffffff8dd69cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 1.259493][ T1] #1: ffffffff8dd69d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 1.259497][ T1] #2: ffffffff8dc89660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 1.259501][ T1] #3: ffffffff8dc89560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 1.259504][ T1] irq event stamp: 313084 [ 1.259505][ T1] hardirqs last enabled at (313083): [] __down_trylock_console_sem+0x86/0xa0 [ 1.259508][ T1] hardirqs last disabled at (313084): [] console_emit_next_record+0x3d4/0x4c0 [ 1.259510][ T1] softirqs last enabled at (312198): [] handle_softirqs+0x67c/0x900 [ 1.259513][ T1] softirqs last disabled at (312193): [] __irq_exit_rcu+0x145/0x1c0 [ 1.259515][ T1] Preemption disabled at: [ 1.259516][ T1] [] vprintk_emit+0x31b/0x3e0 [ 1.259521][ T1] CPU: 1 UID: 0 PID: 1 Comm: swapper/0 Not tainted 7.2.0-virtme #1 PREEMPT(full) [ 1.259524][ T1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1.259526][ T1] Call Trace: [ 1.259528][ T1] [ 1.259531][ T1] dump_stack_lvl+0x6f/0xa0 [ 1.259537][ T1] ? vprintk_emit+0x31b/0x3e0 [ 1.259540][ T1] __might_resched.cold+0x1fe/0x2c1 [ 1.259544][ T1] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 1.259548][ T1] ? __kmalloc_noprof+0xdb/0x760 [ 1.259554][ T1] __kmalloc_noprof+0x443/0x760 [ 1.259556][ T1] ? alloc_buf.isra.0+0x4b/0x260 [ 1.259562][ T1] ? do_raw_spin_unlock+0x59/0x250 [ 1.259565][ T1] alloc_buf.isra.0+0x4b/0x260 [ 1.259567][ T1] put_chars+0x1e1/0x2f0 [ 1.259569][ T1] ? prb_final_commit+0x50/0x50 [ 1.259571][ T1] ? __send_to_port+0x420/0x420 [ 1.259574][ T1] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 1.259578][ T1] ? rcu_read_lock_any_held+0x3c/0x90 [ 1.259581][ T1] ? validate_chain+0x38b/0xc20 [ 1.259584][ T1] hvc_console_print+0x292/0x780 [ 1.259587][ T1] ? mark_usage+0x61/0x170 [ 1.259589][ T1] ? __lock_acquire+0x518/0xc20 [ 1.259590][ T1] ? __lock_acquire+0x518/0xc20 [ 1.259594][ T1] ? hvc_write+0x3a0/0x3a0 [ 1.259596][ T1] ? console_emit_next_record+0x1df/0x4c0 [ 1.259599][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.259602][ T1] ? lock_acquire+0x13c/0x160 [ 1.259606][ T1] console_emit_next_record+0x22f/0x4c0 [ 1.259609][ T1] ? devkmsg_read+0x4b0/0x4b0 [ 1.259611][ T1] ? console_flush_one_record+0x106/0x710 [ 1.259614][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.259617][ T1] ? lock_acquire+0x13c/0x160 [ 1.259621][ T1] console_flush_one_record+0x46f/0x710 [ 1.259625][ T1] ? console_emit_next_record+0x4c0/0x4c0 [ 1.259627][ T1] ? __lock_acquire+0x518/0xc20 [ 1.259632][ T1] console_unlock+0xee/0x1f0 [ 1.259635][ T1] ? console_flush_one_record+0x710/0x710 [ 1.259636][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.259639][ T1] ? lock_acquire+0x60/0x160 [ 1.259642][ T1] ? __down_trylock_console_sem+0x5e/0xa0 [ 1.259644][ T1] ? vprintk_emit+0x320/0x3e0 [ 1.259647][ T1] vprintk_emit+0x37c/0x3e0 [ 1.259651][ T1] ? wake_up_klogd_work_func+0x90/0x90 [ 1.259654][ T1] ? misc_register+0x151/0x670 [ 1.259657][ T1] ? md_run_setup+0x90/0x90 [ 1.259662][ T1] _printk+0xc7/0x100 [ 1.259666][ T1] ? snapshot_read.cold+0x21/0x21 [ 1.259668][ T1] ? md_run_setup+0x90/0x90 [ 1.259673][ T1] ? md_run_setup+0x90/0x90 [ 1.259677][ T1] dm_interface_init+0x50/0x60 [ 1.259678][ T1] dm_init+0x51/0xd0 [ 1.259685][ T1] ? md_run_setup+0x90/0x90 [ 1.259687][ T1] do_one_initcall+0x124/0x4f0 [ 1.259690][ T1] ? trace_event_raw_event_initcall_level+0x280/0x280 [ 1.259692][ T1] ? parameq+0x110/0x110 [ 1.259697][ T1] ? kernel_init_freeable+0x3f1/0x630 [ 1.259700][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.259703][ T1] kernel_init_freeable+0x596/0x630 [ 1.259706][ T1] ? rest_init+0x280/0x280 [ 1.259711][ T1] kernel_init+0x21/0x150 [ 1.259713][ T1] ? rest_init+0x280/0x280 [ 1.259715][ T1] ret_from_fork+0x474/0x6b0 [ 1.259719][ T1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1.259722][ T1] ? __switch_to+0x5a3/0xe00 [ 1.259725][ T1] ? rest_init+0x280/0x280 [ 1.259728][ T1] ret_from_fork_asm+0x11/0x20 [ 1.259736][ T1] [ 1.284927][ T1] NET: Registered PF_INET6 protocol family [ 1.289674][ T1] Segment Routing with IPv6 [ 1.291996][ T1] In-situ OAM (IOAM) with IPv6 [ 1.292385][ T1] NET: Registered PF_PACKET protocol family [ 1.292638][ T1] 9pnet: Installing 9P2000 support [ 1.293016][ T1] Key type dns_resolver registered [ 1.293685][ T1] NET: Registered PF_VSOCK protocol family [ 1.298499][ T1] IPI shorthand broadcast: enabled [ 1.405624][ T1] sched_clock: Marking stable (1365001765, 40138281)->(1512118973, -106978927) [ 1.407940][ T1] registered taskstats version 1 [ 1.409822][ T1] Loading compiled-in X.509 certificates [ 1.515238][ T1] Demotion targets for Node 0: null [ 1.515587][ T1] kmemleak: Kernel memory leak detector initialized (mem pool available: 11726) [ 1.515894][ T1] page_owner is disabled [ 1.517291][ T1] PM: Magic number: 6:780:570 [ 1.517776][ T1] netconsole: network logging started [ 1.519260][ T1] ALSA device list: [ 1.519430][ T1] No soundcards found. [ 1.522270][ T1] md: Skipping autodetection of RAID arrays. (raid=autodetect will force) [ 1.524788][ T1] VFS: Mounted root (virtiofs filesystem) readonly on device 0:24. [ 1.525563][ T1] devtmpfs: mounted [ 1.525858][ T1] VFS: Pivoted into new rootfs [ 1.556052][ T1] Freeing unused kernel image (initmem) memory: 2544K [ 1.558908][ T1] Write protecting the kernel read-only data: 55296k [ 1.559702][ T1] Freeing unused kernel image (text/rodata gap) memory: 328K [ 1.560181][ T1] Freeing unused kernel image (rodata/data gap) memory: 556K [ 1.560452][ T1] Run /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init as init process [ 1.560747][ T1] with arguments: [ 1.560869][ T1] /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init [ 1.561113][ T1] with environment: [ 1.562151][ T1] HOME=/ [ 1.562303][ T1] TERM=dumb [ 1.562446][ T1] virtme_hostname=vmksft-forwarding-dbg,debug-threads=on [ 1.562704][ T1] nr_open=2147483584 [ 1.562822][ T1] virtme_link_mods=/srv/vmksft/testing/wt-4/.virtme_mods/lib/modules/0.0.0 [ 1.563106][ T1] virtme_rw_overlay0=/etc [ 1.563280][ T1] virtme_rw_overlay1=/lib [ 1.563437][ T1] virtme_rw_overlay2=/home [ 1.563600][ T1] virtme_rw_overlay3=/opt [ 1.563768][ T1] virtme_rw_overlay4=/srv [ 1.563927][ T1] virtme_rw_overlay5=/usr [ 1.564089][ T1] virtme_rw_overlay6=/var [ 1.564256][ T1] virtme_rw_overlay7=/tmp [ 1.564417][ T1] virtme_console=ttyS0 [ 1.564579][ T1] virtme_chdir=srv/vmksft/testing/wt-4 [ 1.582579][ T1] virtme-ng-init: mount devtmpfs -> /dev: EBUSY: Device or resource busy [ 1.584119][ T1] virtme-ng-init: Setting hostname to vmksft-forwarding-dbg,debug-threads=on... [ 1.593518][ T1] overlayfs: failed to set xattr on upper [ 1.593835][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.594220][ T1] overlayfs: ...falling back to uuid=null. [ 1.596980][ T1] overlayfs: failed to set xattr on upper [ 1.597281][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.597589][ T1] overlayfs: ...falling back to uuid=null. [ 1.599825][ T1] overlayfs: failed to set xattr on upper [ 1.600070][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.600409][ T1] overlayfs: ...falling back to uuid=null. [ 1.602577][ T1] overlayfs: failed to set xattr on upper [ 1.602835][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.603165][ T1] overlayfs: ...falling back to uuid=null. [ 1.605912][ T1] overlayfs: failed to set xattr on upper [ 1.606176][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.606500][ T1] overlayfs: ...falling back to uuid=null. [ 1.608858][ T1] overlayfs: failed to set xattr on upper [ 1.609104][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.609439][ T1] overlayfs: ...falling back to uuid=null. [ 1.611602][ T1] overlayfs: failed to set xattr on upper [ 1.611862][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.612660][ T1] overlayfs: ...falling back to uuid=null. [ 1.614889][ T1] overlayfs: failed to set xattr on upper [ 1.615156][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.615455][ T1] overlayfs: ...falling back to uuid=null. [ 1.628935][ T1] virtme-ng-init: running systemd-tmpfiles [ 2.050104][ T74] kwatchdog (74) used greatest stack depth: 29688 bytes left [ 4.042001][ T73] systemd-tmpfile (73) used greatest stack depth: 24992 bytes left [ 4.042022][ T73] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 4.042024][ T73] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 73, name: systemd-tmpfile [ 4.042027][ T73] preempt_count: 2, expected: 0 [ 4.042028][ T73] RCU nest depth: 0, expected: 0 [ 4.042029][ T73] locks held by systemd-tmpfile/73: 5, last CPU#1: [ 4.042032][ T73] #0: ffffffff8dc027b8 (low_water_lock){+.+.}-{3:3}, at: do_exit+0x887/0xdc0 [ 4.042049][ T73] #1: ffffffff8dd69cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 4.042056][ T73] #2: ffffffff8dd69d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 4.042063][ T73] #3: ffffffff8dc89660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 4.042069][ T73] #4: ffffffff8dc89560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 4.042075][ T73] irq event stamp: 2357206 [ 4.042076][ T73] hardirqs last enabled at (2357205): [] __down_trylock_console_sem+0x86/0xa0 [ 4.042080][ T73] hardirqs last disabled at (2357206): [] console_emit_next_record+0x3d4/0x4c0 [ 4.042083][ T73] softirqs last enabled at (2356586): [] handle_softirqs+0x67c/0x900 [ 4.042086][ T73] softirqs last disabled at (2355279): [] __irq_exit_rcu+0x145/0x1c0 [ 4.042089][ T73] Preemption disabled at: [ 4.042090][ T73] [<0000000000000000>] 0x0 [ 4.042099][ T73] CPU: 1 UID: 0 PID: 73 Comm: systemd-tmpfile Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 4.042103][ T73] Tainted: [W]=WARN [ 4.042104][ T73] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 4.042107][ T73] Call Trace: [ 4.042109][ T73] [ 4.042111][ T73] dump_stack_lvl+0x6f/0xa0 [ 4.042120][ T73] __might_resched.cold+0x1fe/0x2c1 [ 4.042126][ T73] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 4.042132][ T73] ? __kmalloc_noprof+0xdb/0x760 [ 4.042143][ T73] __kmalloc_noprof+0x443/0x760 [ 4.042147][ T73] ? alloc_buf.isra.0+0x4b/0x260 [ 4.042156][ T73] ? do_raw_spin_unlock+0x59/0x250 [ 4.042160][ T73] alloc_buf.isra.0+0x4b/0x260 [ 4.042165][ T73] put_chars+0x1e1/0x2f0 [ 4.042169][ T73] ? __send_to_port+0x420/0x420 [ 4.042171][ T73] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 4.042178][ T73] ? validate_chain+0x38b/0xc20 [ 4.042189][ T73] hvc_console_print+0x292/0x780 [ 4.042200][ T73] ? hvc_write+0x3a0/0x3a0 [ 4.042203][ T73] ? rcu_is_watching+0x16/0xd0 [ 4.042207][ T73] ? lock_acquire+0x13c/0x160 [ 4.042214][ T73] console_emit_next_record+0x22f/0x4c0 [ 4.042220][ T1] virtme-ng-init: Failed to read '/usr/lib/tmpfiles.d/audit.conf': Permission denied [ 4.042220][ T1] Failed to create directory or subvolume "/var/spool/at/spool": Permission denied [ 4.042220][ T1] Failed to create file /var/spool/at/.SEQ: Permission denied [ 4.042220][ T1] Failed to opendir() '/proc/self/fd/6': Permission denied [ 4.042221][ T73] ? devkmsg_read+0x4b0/0x4b0 [ 4.042223][ T73] ? console_flush_one_record+0x106/0x710 [ 4.042229][ T73] ? rcu_is_watching+0x16/0xd0 [ 4.042232][ T73] ? lock_acquire+0x13c/0x160 [ 4.042239][ T73] console_flush_one_record+0x46f/0x710 [ 4.042247][ T73] ? console_emit_next_record+0x4c0/0x4c0 [ 4.042249][ T73] ? __lock_acquire+0x518/0xc20 [ 4.042259][ T73] console_unlock+0xee/0x1f0 [ 4.042263][ T73] ? console_flush_one_record+0x710/0x710 [ 4.042266][ T73] ? rcu_is_watching+0x16/0xd0 [ 4.042270][ T73] ? lock_acquire+0x60/0x160 [ 4.042276][ T73] ? __down_trylock_console_sem+0x5e/0xa0 [ 4.042278][ T73] ? vprintk_emit+0x320/0x3e0 [ 4.042284][ T73] vprintk_emit+0x37c/0x3e0 [ 4.042290][ T73] ? wake_up_klogd_work_func+0x90/0x90 [ 4.042295][ T73] ? __lock_acquire+0x518/0xc20 [ 4.042302][ T73] _printk+0xc7/0x100 [ 4.042307][ T73] ? snapshot_read.cold+0x21/0x21 [ 4.042311][ T73] ? do_raw_spin_lock+0x131/0x280 [ 4.042315][ T73] ? __rwlock_init+0x150/0x150 [ 4.042322][ T73] ? do_raw_spin_lock+0x131/0x280 [ 4.042326][ T73] do_exit.cold+0x82/0x9c [ 4.042332][ T73] ? exit_notify+0x890/0x890 [ 4.042334][ T73] ? __lock_release.isra.0+0x69/0x1a0 [ 4.042338][ T73] ? rcu_is_watching+0x16/0xd0 [ 4.042346][ T73] do_group_exit+0xb8/0x370 [ 4.042350][ T73] __x64_sys_exit_group+0x3c/0x50 [ 4.042353][ T73] x64_sys_call+0x1567/0x1570 [ 4.042357][ T73] do_syscall_64+0xff/0x530 [ 4.042361][ T73] ? exc_page_fault+0xee/0x100 [ 4.042366][ T73] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4.042369][ T73] RIP: 0033:0x7f71bb5351b8 [ 4.042372][ T73] Code: Unable to access opcode bytes at 0x7f71bb53518e. [ 4.042373][ T73] RSP: 002b:00007ffe03556d68 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7 [ 4.042377][ T73] RAX: ffffffffffffffda RBX: 00007f71bb665f88 RCX: 00007f71bb5351b8 [ 4.042379][ T73] RDX: 00007f71bad934c8 RSI: fffffffffffffe90 RDI: 0000000000000049 [ 4.042380][ T73] RBP: 00007ffe03556dc0 R08: 0000000000000000 R09: 0000000000001000 [ 4.042382][ T73] R10: 00007ffe03556b80 R11: 0000000000000246 R12: 0000000000000001 [ 4.042383][ T73] R13: 0000000000000049 R14: 00007f71bb664680 R15: 00007f71bb665fa0 [ 4.042396][ T73] [ 4.069396][ T1] virtme-ng-init: basic initialization done [ 4.085660][ T76] virtme-ng-init (76) used greatest stack depth: 24848 bytes left [ 4.112944][ T79] ip (79) used greatest stack depth: 24000 bytes left [ 4.143261][ T75] virtme-ng-init: Starting systemd-udevd version 259.8-1.fc44 [ 4.143964][ T75] virtme-ng-init: triggering udev coldplug [ 6.547455][ T75] virtme-ng-init: waiting for udev to settle [ 6.547473][ T75] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 6.547476][ T75] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 75, name: virtme-ng-init [ 6.547479][ T75] preempt_count: 1, expected: 0 [ 6.547481][ T75] RCU nest depth: 0, expected: 0 [ 6.547482][ T75] locks held by virtme-ng-init/75: 4, last CPU#2: [ 6.547486][ T75] #0: ffffffff8dd69cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 6.547501][ T75] #1: ffffffff8dd69d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 6.547508][ T75] #2: ffffffff8dc89660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 6.547515][ T75] #3: ffffffff8dc89560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 6.547521][ T75] irq event stamp: 2888 [ 6.547522][ T75] hardirqs last enabled at (2887): [] __down_trylock_console_sem+0x86/0xa0 [ 6.547526][ T75] hardirqs last disabled at (2888): [] console_emit_next_record+0x3d4/0x4c0 [ 6.547529][ T75] softirqs last enabled at (2378): [] fpu_clone+0xd9/0x410 [ 6.547534][ T75] softirqs last disabled at (2376): [] fpu_clone+0x82/0x410 [ 6.547537][ T75] Preemption disabled at: [ 6.547538][ T75] [] vprintk_emit+0x31b/0x3e0 [ 6.547545][ T75] CPU: 2 UID: 0 PID: 75 Comm: virtme-ng-init Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 6.547550][ T75] Tainted: [W]=WARN [ 6.547551][ T75] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 6.547554][ T75] Call Trace: [ 6.547556][ T75] [ 6.547558][ T75] dump_stack_lvl+0x6f/0xa0 [ 6.547565][ T75] ? vprintk_emit+0x31b/0x3e0 [ 6.547569][ T75] __might_resched.cold+0x1fe/0x2c1 [ 6.547575][ T75] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 6.547581][ T75] ? __kmalloc_noprof+0xdb/0x760 [ 6.547588][ T75] __kmalloc_noprof+0x443/0x760 [ 6.547592][ T75] ? alloc_buf.isra.0+0x4b/0x260 [ 6.547601][ T75] ? do_raw_spin_unlock+0x59/0x250 [ 6.547604][ T75] alloc_buf.isra.0+0x4b/0x260 [ 6.547610][ T75] put_chars+0x1e1/0x2f0 [ 6.547614][ T75] ? __send_to_port+0x420/0x420 [ 6.547616][ T75] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 6.547623][ T75] ? validate_chain+0x38b/0xc20 [ 6.547632][ T75] hvc_console_print+0x292/0x780 [ 6.547643][ T75] ? hvc_write+0x3a0/0x3a0 [ 6.547647][ T75] ? rcu_is_watching+0x16/0xd0 [ 6.547651][ T75] ? lock_acquire+0x13c/0x160 [ 6.547658][ T75] console_emit_next_record+0x22f/0x4c0 [ 6.547664][ T75] ? devkmsg_read+0x4b0/0x4b0 [ 6.547667][ T75] ? console_flush_one_record+0x106/0x710 [ 6.547672][ T75] ? rcu_is_watching+0x16/0xd0 [ 6.547676][ T75] ? lock_acquire+0x13c/0x160 [ 6.547683][ T75] console_flush_one_record+0x46f/0x710 [ 6.547690][ T75] ? console_emit_next_record+0x4c0/0x4c0 [ 6.547693][ T75] ? __lock_acquire+0x518/0xc20 [ 6.547703][ T75] console_unlock+0xee/0x1f0 [ 6.547714][ T75] ? console_flush_one_record+0x710/0x710 [ 6.547717][ T75] ? rcu_is_watching+0x16/0xd0 [ 6.547720][ T75] ? lock_acquire+0x60/0x160 [ 6.547727][ T75] ? __down_trylock_console_sem+0x5e/0xa0 [ 6.547730][ T75] ? vprintk_emit+0x320/0x3e0 [ 6.547735][ T75] vprintk_emit+0x37c/0x3e0 [ 6.547741][ T75] ? wake_up_klogd_work_func+0x90/0x90 [ 6.547747][ T75] ? _copy_from_iter+0x1bb/0x1810 [ 6.547756][ T75] devkmsg_emit.constprop.0+0xbc/0xf1 [ 6.547761][ T75] ? vprintk_emit.cold+0x107/0x107 [ 6.547764][ T75] ? simple_strntoull+0x10f/0x140 [ 6.547770][ T75] ? date_str+0x1e0/0x1e0 [ 6.547775][ T75] ? devkmsg_write+0xd1/0x2c0 [ 6.547783][ T75] devkmsg_write.cold+0x5a/0x8b [ 6.547788][ T75] ? vprintk_default+0x20/0x20 [ 6.547796][ T75] ? vprintk_default+0x20/0x20 [ 6.547800][ T75] new_sync_write+0x33e/0x760 [ 6.547805][ T75] ? kasan_quarantine_put+0x42/0x2b0 [ 6.547811][ T75] ? new_sync_read+0x750/0x750 [ 6.547819][ T75] ? __lock_release.isra.0+0x69/0x1a0 [ 6.547827][ T75] ? __fget_files+0x1e3/0x460 [ 6.547834][ T75] vfs_write+0x6a2/0xbd0 [ 6.547842][ T75] ksys_write+0x116/0x250 [ 6.547847][ T75] ? __ia32_sys_read+0xc0/0xc0 [ 6.547852][ T75] ? rcu_is_watching+0x16/0xd0 [ 6.547858][ T75] do_syscall_64+0xff/0x530 [ 6.547862][ T75] ? exc_page_fault+0xee/0x100 [ 6.547867][ T75] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 6.547870][ T75] RIP: 0033:0x7f58b6739ed2 [ 6.547875][ T75] Code: 08 0f 85 51 ec ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 f3 0f 1e fa 55 48 89 e5 [ 6.547877][ T75] RSP: 002b:00007f58b6680c68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 [ 6.547881][ T75] RAX: ffffffffffffffda RBX: 000000000000002e RCX: 00007f58b6739ed2 [ 6.547883][ T75] RDX: 000000000000002e RSI: 00007f58b0001090 RDI: 0000000000000003 [ 6.547885][ T75] RBP: 00007f58b6680c90 R08: 0000000000000000 R09: 0000000000000000 [ 6.547887][ T75] R10: 0000000000000000 R11: 0000000000000246 R12: 00007f58b67c40a0 [ 6.547888][ T75] R13: 00007f58b66c23e0 R14: 00007f58b0001090 R15: 00007f58b6680da8 [ 6.547902][ T75] [ 6.553277][ C0] clocksource: Watchdog remote CPU 2 read timed out [ 6.553304][ C0] [ 6.553305][ C0] ======================================================== [ 6.553306][ C0] WARNING: possible irq lock inversion dependency detected [ 6.553308][ C0] 7.2.0-virtme #1 Tainted: G W [ 6.553309][ C0] -------------------------------------------------------- [ 6.553310][ C0] swapper/0/0 just changed the state of lock: [ 6.553311][ C0] ffffffff8dc89660 (console_owner){..-.}-{0:0}, at: console_trylock_spinning+0xa4/0x1e0 [ 6.553319][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 6.553321][ C0] (fs_reclaim){+.+.}-{0:0} [ 6.553322][ C0] [ 6.553322][ C0] [ 6.553322][ C0] and interrupts could create inverse lock ordering between them. [ 6.553322][ C0] [ 6.553323][ C0] [ 6.553323][ C0] other info that might help us debug this: [ 6.553323][ C0] Possible interrupt unsafe locking scenario: [ 6.553323][ C0] [ 6.553324][ C0] CPU0 CPU1 [ 6.553325][ C0] ---- ---- [ 6.553325][ C0] lock(fs_reclaim); [ 6.553326][ C0] local_irq_disable(); [ 6.553327][ C0] lock(console_owner); [ 6.553328][ C0] lock(fs_reclaim); [ 6.553329][ C0] [ 6.553329][ C0] lock(console_owner); [ 6.553330][ C0] [ 6.553330][ C0] *** DEADLOCK *** [ 6.553330][ C0] [ 6.553330][ C0] locks held by swapper/0/0: 2, last CPU#0: [ 6.553332][ C0] #0: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 6.553337][ C0] #1: ffffffff8ddce8b8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 6.553341][ C0] [ 6.553341][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 6.553345][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 6.553347][ C0] HARDIRQ-ON-W at: [ 6.553349][ C0] __lock_acquire+0x388/0xc20 [ 6.553352][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.553354][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.553356][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.553358][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.553361][ C0] workqueue_init+0x2a/0x680 [ 6.553364][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.553366][ C0] kernel_init+0x21/0x150 [ 6.553370][ C0] ret_from_fork+0x474/0x6b0 [ 6.553372][ C0] ret_from_fork_asm+0x11/0x20 [ 6.553374][ C0] SOFTIRQ-ON-W at: [ 6.553375][ C0] __lock_acquire+0x388/0xc20 [ 6.553377][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.553378][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.553379][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.553381][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.553382][ C0] workqueue_init+0x2a/0x680 [ 6.553383][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.553384][ C0] kernel_init+0x21/0x150 [ 6.553386][ C0] ret_from_fork+0x474/0x6b0 [ 6.553387][ C0] ret_from_fork_asm+0x11/0x20 [ 6.553388][ C0] INITIAL USE at: [ 6.553389][ C0] __lock_acquire+0x388/0xc20 [ 6.553390][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.553392][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.553393][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.553394][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.553396][ C0] workqueue_init+0x2a/0x680 [ 6.553397][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.553398][ C0] kernel_init+0x21/0x150 [ 6.553400][ C0] ret_from_fork+0x474/0x6b0 [ 6.553401][ C0] ret_from_fork_asm+0x11/0x20 [ 6.553402][ C0] } [ 6.553402][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 6.553407][ C0] ... acquired at: [ 6.553408][ C0] __lock_acquire+0x518/0xc20 [ 6.553409][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.553410][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.553411][ C0] __kmalloc_noprof+0xd3/0x760 [ 6.553413][ C0] alloc_buf.isra.0+0x4b/0x260 [ 6.553415][ C0] put_chars+0x1e1/0x2f0 [ 6.553417][ C0] hvc_console_print+0x292/0x780 [ 6.553418][ C0] console_emit_next_record+0x22f/0x4c0 [ 6.553420][ C0] console_flush_one_record+0x46f/0x710 [ 6.553421][ C0] console_unlock+0xee/0x1f0 [ 6.553423][ C0] vprintk_emit+0x37c/0x3e0 [ 6.553425][ C0] _printk+0xc7/0x100 [ 6.553427][ C0] dm_interface_init+0x50/0x60 [ 6.553429][ C0] dm_init+0x51/0xd0 [ 6.553430][ C0] do_one_initcall+0x124/0x4f0 [ 6.553432][ C0] kernel_init_freeable+0x596/0x630 [ 6.553433][ C0] kernel_init+0x21/0x150 [ 6.553434][ C0] ret_from_fork+0x474/0x6b0 [ 6.553435][ C0] ret_from_fork_asm+0x11/0x20 [ 6.553436][ C0] [ 6.553437][ C0] -> (console_owner){..-.}-{0:0} { [ 6.553439][ C0] IN-SOFTIRQ-W at: [ 6.553439][ C0] __lock_acquire+0x388/0xc20 [ 6.553441][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.553442][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.553444][ C0] vprintk_emit+0x320/0x3e0 [ 6.553445][ C0] _printk+0xc7/0x100 [ 6.553447][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.553449][ C0] call_timer_fn+0x160/0x4d0 [ 6.553451][ C0] __run_timers+0x68f/0xaa0 [ 6.553452][ C0] run_timer_softirq+0xf0/0x160 [ 6.553454][ C0] handle_softirqs+0x1d3/0x900 [ 6.553456][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.553458][ C0] irq_exit_rcu+0xe/0x30 [ 6.553459][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.553461][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.553462][ C0] pv_native_safe_halt+0xf/0x10 [ 6.553464][ C0] default_idle+0x9/0x10 [ 6.553465][ C0] default_idle_call+0x6e/0xb0 [ 6.553467][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.553469][ C0] do_idle+0xd8/0x190 [ 6.553471][ C0] cpu_startup_entry+0x53/0x70 [ 6.553472][ C0] rest_init+0x279/0x280 [ 6.553474][ C0] start_kernel+0x3af/0x3b0 [ 6.553475][ C0] x86_64_start_reservations+0x24/0x30 [ 6.553477][ C0] x86_64_start_kernel+0x12b/0x130 [ 6.553479][ C0] common_startup_64+0x13e/0x148 [ 6.553481][ C0] INITIAL USE at: [ 6.553482][ C0] } [ 6.553482][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 6.553485][ C0] ... acquired at: [ 6.553486][ C0] mark_lock+0x1d7/0xa00 [ 6.553487][ C0] mark_usage+0x42/0x170 [ 6.553488][ C0] __lock_acquire+0x388/0xc20 [ 6.553490][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.553491][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.553493][ C0] vprintk_emit+0x320/0x3e0 [ 6.553494][ C0] _printk+0xc7/0x100 [ 6.553496][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.553497][ C0] call_timer_fn+0x160/0x4d0 [ 6.553498][ C0] __run_timers+0x68f/0xaa0 [ 6.553500][ C0] run_timer_softirq+0xf0/0x160 [ 6.553502][ C0] handle_softirqs+0x1d3/0x900 [ 6.553503][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.553504][ C0] irq_exit_rcu+0xe/0x30 [ 6.553505][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.553507][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.553508][ C0] pv_native_safe_halt+0xf/0x10 [ 6.553509][ C0] default_idle+0x9/0x10 [ 6.553511][ C0] default_idle_call+0x6e/0xb0 [ 6.553512][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.553514][ C0] do_idle+0xd8/0x190 [ 6.553515][ C0] cpu_startup_entry+0x53/0x70 [ 6.553516][ C0] rest_init+0x279/0x280 [ 6.553517][ C0] start_kernel+0x3af/0x3b0 [ 6.553518][ C0] x86_64_start_reservations+0x24/0x30 [ 6.553520][ C0] x86_64_start_kernel+0x12b/0x130 [ 6.553521][ C0] common_startup_64+0x13e/0x148 [ 6.553523][ C0] [ 6.553523][ C0] [ 6.553523][ C0] stack backtrace: [ 6.553525][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 6.553528][ C0] Tainted: [W]=WARN [ 6.553529][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 6.553530][ C0] Call Trace: [ 6.553531][ C0] [ 6.553532][ C0] dump_stack_lvl+0x6f/0xa0 [ 6.553535][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 6.553538][ C0] mark_lock_irq+0x989/0x9c0 [ 6.553539][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 6.553542][ C0] mark_lock+0x1d7/0xa00 [ 6.553544][ C0] mark_usage+0x42/0x170 [ 6.553546][ C0] __lock_acquire+0x388/0xc20 [ 6.553548][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.553550][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 6.553552][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.553554][ C0] ? lock_acquire+0x13c/0x160 [ 6.553556][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.553558][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 6.553560][ C0] vprintk_emit+0x320/0x3e0 [ 6.553562][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 6.553565][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 6.553566][ C0] _printk+0xc7/0x100 [ 6.553568][ C0] ? snapshot_read.cold+0x21/0x21 [ 6.553570][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 6.553572][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.553574][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.553576][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.553577][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.553579][ C0] call_timer_fn+0x160/0x4d0 [ 6.553581][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 6.553583][ C0] ? debug_object_active_state+0x430/0x430 [ 6.553586][ C0] ? find_held_lock+0x2b/0x80 [ 6.553588][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.553589][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.553592][ C0] __run_timers+0x68f/0xaa0 [ 6.553593][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.553596][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 6.553597][ C0] ? __lock_acquire+0x518/0xc20 [ 6.553600][ C0] ? __rwlock_init+0x150/0x150 [ 6.553603][ C0] run_timer_softirq+0xf0/0x160 [ 6.553605][ C0] ? __run_timers+0xaa0/0xaa0 [ 6.553606][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 6.553609][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.553610][ C0] handle_softirqs+0x1d3/0x900 [ 6.553612][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.553614][ C0] ? _local_bh_enable+0xc0/0xc0 [ 6.553616][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.553617][ C0] irq_exit_rcu+0xe/0x30 [ 6.553619][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.553621][ C0] [ 6.553621][ C0] [ 6.553622][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 6.553623][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.553625][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 6.553627][ C0] Code: 48 8b 3d 94 e2 f5 01 e8 1f 00 00 00 48 2b 05 58 a3 95 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 96 11 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 6.553629][ C0] RSP: 0018:ffffffff8da07cf8 EFLAGS: 00000296 [ 6.553631][ C0] RAX: 000000000002aeff RBX: ffffffff8da1c600 RCX: ffffffff8aaf0307 [ 6.553632][ C0] RDX: ffffffff8da1c600 RSI: ffffffff8d838b01 RDI: ffffffff8d28d8e0 [ 6.553633][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 6.553634][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff1b40fa2 [ 6.553635][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 6.553636][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.553639][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 6.553640][ C0] default_idle+0x9/0x10 [ 6.553642][ C0] default_idle_call+0x6e/0xb0 [ 6.553644][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 6.553645][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 6.553647][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 6.553649][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.553651][ C0] do_idle+0xd8/0x190 [ 6.553653][ C0] cpu_startup_entry+0x53/0x70 [ 6.553654][ C0] rest_init+0x279/0x280 [ 6.553656][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 6.553659][ C0] ? rest_init+0x280/0x280 [ 6.553661][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 6.553665][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 6.553667][ C0] ? acpi_enable+0x1e4/0x330 [ 6.553669][ C0] start_kernel+0x3af/0x3b0 [ 6.553671][ C0] x86_64_start_reservations+0x24/0x30 [ 6.553673][ C0] x86_64_start_kernel+0x12b/0x130 [ 6.553675][ C0] common_startup_64+0x13e/0x148 [ 6.553678][ C0] [ 6.989376][ T75] virtme-ng-init: udev is done [ 6.991891][ T1] virtme-ng-init: initialization done