virtme: waiting for virtiofsd to start virtme: use 'microvm' QEMU architecture [ 1.160690][ T1] tun: Universal TUN/TAP device driver, 1.6 [ 1.160714][ T1] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 1.160716][ T1] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 [ 1.160717][ T1] preempt_count: 1, expected: 0 [ 1.160718][ T1] RCU nest depth: 0, expected: 0 [ 1.160719][ T1] locks held by swapper/0/1: 4, last CPU#3: [ 1.160721][ T1] #0: ffffffffa337ddc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 1.160732][ T1] #1: ffffffffa337de38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 1.160737][ T1] #2: ffffffffa329d760 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 1.160742][ T1] #3: ffffffffa329d660 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 1.160746][ T1] irq event stamp: 318598 [ 1.160747][ T1] hardirqs last enabled at (318597): [] __down_trylock_console_sem+0x86/0xa0 [ 1.160750][ T1] hardirqs last disabled at (318598): [] console_emit_next_record+0x3d4/0x4c0 [ 1.160752][ T1] softirqs last enabled at (318502): [] __alloc_skb+0x4c2/0x5f0 [ 1.160756][ T1] softirqs last disabled at (318498): [] __alloc_skb+0x4c2/0x5f0 [ 1.160759][ T1] Preemption disabled at: [ 1.160761][ T1] [] vprintk_emit+0x31b/0x3e0 [ 1.160763][ T1] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 7.2.0-virtme #1 PREEMPT(full) [ 1.160763][ T1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1.160763][ T1] Call Trace: [ 1.160763][ T1] [ 1.160763][ T1] dump_stack_lvl+0x6f/0xa0 [ 1.160763][ T1] ? vprintk_emit+0x31b/0x3e0 [ 1.160763][ T1] __might_resched.cold+0x1fe/0x2c1 [ 1.160763][ T1] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 1.160763][ T1] ? __kmalloc_noprof+0xdb/0x760 [ 1.160763][ T1] __kmalloc_noprof+0x443/0x760 [ 1.160763][ T1] ? alloc_buf.isra.0+0x4b/0x260 [ 1.160763][ T1] ? do_raw_spin_unlock+0x59/0x250 [ 1.160763][ T1] alloc_buf.isra.0+0x4b/0x260 [ 1.160763][ T1] put_chars+0x1e1/0x2f0 [ 1.160763][ T1] ? __send_to_port+0x420/0x420 [ 1.160763][ T1] ? rcu_read_lock_any_held+0x3c/0x90 [ 1.160763][ T1] ? validate_chain+0x38b/0xc20 [ 1.160763][ T1] hvc_console_print+0x292/0x780 [ 1.160763][ T1] ? __lock_acquire+0x518/0xc20 [ 1.160763][ T1] ? __lock_acquire+0x518/0xc20 [ 1.160763][ T1] ? hvc_write+0x3a0/0x3a0 [ 1.160763][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.160763][ T1] ? lock_acquire+0x13c/0x160 [ 1.160763][ T1] console_emit_next_record+0x22f/0x4c0 [ 1.160763][ T1] ? devkmsg_read+0x4b0/0x4b0 [ 1.160763][ T1] ? console_flush_one_record+0x106/0x710 [ 1.160763][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.160763][ T1] ? lock_acquire+0x13c/0x160 [ 1.160763][ T1] console_flush_one_record+0x46f/0x710 [ 1.160763][ T1] ? console_emit_next_record+0x4c0/0x4c0 [ 1.160763][ T1] ? __lock_acquire+0x518/0xc20 [ 1.160763][ T1] console_unlock+0xee/0x1f0 [ 1.160763][ T1] ? console_flush_one_record+0x710/0x710 [ 1.160763][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.160763][ T1] ? lock_acquire+0xe0/0x160 [ 1.160763][ T1] ? __down_trylock_console_sem+0x5e/0xa0 [ 1.160763][ T1] ? vprintk_emit+0x320/0x3e0 [ 1.160763][ T1] vprintk_emit+0x37c/0x3e0 [ 1.160763][ T1] ? wake_up_klogd_work_func+0x90/0x90 [ 1.160763][ T1] ? team_module_init+0x60/0x60 [ 1.160763][ T1] _printk+0xc7/0x100 [ 1.160763][ T1] ? snapshot_read.cold+0x21/0x21 [ 1.160763][ T1] ? lock_pin_lock+0x80/0x180 [ 1.160763][ T1] ? _raw_spin_unlock_irqrestore+0x40/0x80 [ 1.160763][ T1] ? add_device_randomness+0xbb/0x100 [ 1.160763][ T1] ? random_write_iter+0x20/0x20 [ 1.160763][ T1] ? phy_module_init+0x20/0x20 [ 1.160763][ T1] ? do_one_initcall+0x113/0x4f0 [ 1.160763][ T1] tun_init+0x24/0xb0 [ 1.160763][ T1] do_one_initcall+0x124/0x4f0 [ 1.160763][ T1] ? trace_event_raw_event_initcall_level+0x280/0x280 [ 1.160763][ T1] ? parameq+0x110/0x110 [ 1.160763][ T1] ? kernel_init_freeable+0x3f1/0x630 [ 1.160763][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.160763][ T1] kernel_init_freeable+0x596/0x630 [ 1.160763][ T1] ? rest_init+0x280/0x280 [ 1.160763][ T1] kernel_init+0x21/0x150 [ 1.160763][ T1] ? rest_init+0x280/0x280 [ 1.160763][ T1] ret_from_fork+0x474/0x6b0 [ 1.160763][ T1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1.160763][ T1] ? __switch_to+0x5a3/0xe00 [ 1.160763][ T1] ? rest_init+0x280/0x280 [ 1.160763][ T1] ret_from_fork_asm+0x11/0x20 [ 1.160763][ T1] [ 1.180185][ T1] i8042: PNP: No PS/2 controller found. [ 1.189392][ T1] rtc_cmos PNP0B00:00: registered as rtc0 [ 1.189828][ T1] rtc_cmos PNP0B00:00: setting system clock to 2026-08-28T16:12:00 UTC (1787933520) [ 1.190818][ T1] rtc_cmos PNP0B00:00: alarms up to one day, 242 bytes nvram [ 1.194068][ T1] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev [ 1.201245][ T1] ipip: IPv4 and MPLS over IPv4 tunneling driver [ 1.204590][ T1] IPv4 over IPsec tunneling driver [ 1.208512][ T1] NET: Registered PF_INET6 protocol family [ 1.214893][ T1] Segment Routing with IPv6 [ 1.215098][ T1] RPL Segment Routing with IPv6 [ 1.215504][ T1] In-situ OAM (IOAM) with IPv6 [ 1.218840][ T1] sit: IPv6, IPv4 and MPLS over IPv4 tunneling driver [ 1.225561][ T1] NET: Registered PF_PACKET protocol family [ 1.226174][ T1] 8021q: 802.1Q VLAN Support v1.8 [ 1.226604][ T1] sctp: Hash tables configured (bind 32/56) [ 1.227270][ T1] 9pnet: Installing 9P2000 support [ 1.227636][ T1] Key type dns_resolver registered [ 1.228459][ T1] NET: Registered PF_VSOCK protocol family [ 1.233718][ T1] IPI shorthand broadcast: enabled [ 1.344986][ T1] sched_clock: Marking stable (1311001800, 33761086)->(1422185464, -77422578) [ 1.348698][ T1] registered taskstats version 1 [ 1.350924][ T1] Loading compiled-in X.509 certificates [ 1.464297][ T1] Demotion targets for Node 0: null [ 1.464640][ T1] kmemleak: Kernel memory leak detector initialized (mem pool available: 12319) [ 1.464964][ T1] page_owner is disabled [ 1.465675][ T1] PM: Magic number: 6:981:237 [ 1.466198][ T1] netconsole: network logging started [ 1.468426][ T1] ALSA device list: [ 1.468571][ T1] No soundcards found. [ 1.470931][ T1] md: Skipping autodetection of RAID arrays. (raid=autodetect will force) [ 1.473421][ T1] VFS: Mounted root (virtiofs filesystem) readonly on device 0:25. [ 1.474184][ T1] devtmpfs: mounted [ 1.474456][ T1] VFS: Pivoted into new rootfs [ 1.503593][ T1] Freeing unused kernel image (initmem) memory: 2624K [ 1.506431][ T1] Write protecting the kernel read-only data: 65536k [ 1.507120][ T1] Freeing unused kernel image (text/rodata gap) memory: 100K [ 1.509327][ T1] Freeing unused kernel image (rodata/data gap) memory: 312K [ 1.509614][ T1] Run /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init as init process [ 1.509882][ T1] with arguments: [ 1.510008][ T1] /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init [ 1.510242][ T1] with environment: [ 1.510363][ T1] HOME=/ [ 1.510486][ T1] TERM=dumb [ 1.510609][ T1] virtme_hostname=vmksft-net-dbg,debug-threads=on [ 1.510804][ T1] nr_open=2147483584 [ 1.510918][ T1] virtme_link_mods=/srv/vmksft/testing/wt-2/.virtme_mods/lib/modules/0.0.0 [ 1.511199][ T1] virtme_rw_overlay0=/etc [ 1.511358][ T1] virtme_rw_overlay1=/lib [ 1.511515][ T1] virtme_rw_overlay2=/home [ 1.511679][ T1] virtme_rw_overlay3=/opt [ 1.511838][ T1] virtme_rw_overlay4=/srv [ 1.511989][ T1] virtme_rw_overlay5=/usr [ 1.512150][ T1] virtme_rw_overlay6=/var [ 1.512300][ T1] virtme_rw_overlay7=/tmp [ 1.512468][ T1] virtme_console=ttyS0 [ 1.512624][ T1] virtme_chdir=srv/vmksft/testing/wt-2 [ 1.522529][ T71] kwatchdog (71) used greatest stack depth: 28680 bytes left [ 1.528403][ T1] virtme-ng-init: mount devtmpfs -> /dev: EBUSY: Device or resource busy [ 1.529779][ T1] virtme-ng-init: Setting hostname to vmksft-net-dbg,debug-threads=on... [ 1.541705][ T1] overlayfs: failed to set xattr on upper [ 1.542005][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.542270][ T1] overlayfs: ...falling back to uuid=null. [ 1.544771][ T1] overlayfs: failed to set xattr on upper [ 1.544976][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.545218][ T1] overlayfs: ...falling back to uuid=null. [ 1.547326][ T1] overlayfs: failed to set xattr on upper [ 1.547534][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.547944][ T1] overlayfs: ...falling back to uuid=null. [ 1.549976][ T1] overlayfs: failed to set xattr on upper [ 1.550187][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.550438][ T1] overlayfs: ...falling back to uuid=null. [ 1.552982][ T1] overlayfs: failed to set xattr on upper [ 1.553191][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.553458][ T1] overlayfs: ...falling back to uuid=null. [ 1.555331][ T1] overlayfs: failed to set xattr on upper [ 1.555544][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.556358][ T1] overlayfs: ...falling back to uuid=null. [ 1.558419][ T1] overlayfs: failed to set xattr on upper [ 1.558638][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.559348][ T1] overlayfs: ...falling back to uuid=null. [ 1.561538][ T1] overlayfs: failed to set xattr on upper [ 1.561752][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.562002][ T1] overlayfs: ...falling back to uuid=null. [ 1.573664][ T1] virtme-ng-init: running systemd-tmpfiles [ 3.884918][ T72] systemd-tmpfile (72) used greatest stack depth: 24992 bytes left [ 3.884939][ T72] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 3.884941][ T72] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 72, name: systemd-tmpfile [ 3.884942][ T72] preempt_count: 2, expected: 0 [ 3.884943][ T72] RCU nest depth: 0, expected: 0 [ 3.884944][ T72] locks held by systemd-tmpfile/72: 5, last CPU#1: [ 3.884946][ T72] #0: ffffffffa32167b8 (low_water_lock){+.+.}-{3:3}, at: do_exit+0x887/0xdc0 [ 3.884957][ T72] #1: ffffffffa337ddc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 3.884962][ T72] #2: ffffffffa337de38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 3.884967][ T72] #3: ffffffffa329d760 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 3.884970][ T72] #4: ffffffffa329d660 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 3.884974][ T72] irq event stamp: 2173512 [ 3.884975][ T72] hardirqs last enabled at (2173511): [] __down_trylock_console_sem+0x86/0xa0 [ 3.884978][ T72] hardirqs last disabled at (2173512): [] console_emit_next_record+0x3d4/0x4c0 [ 3.884980][ T72] softirqs last enabled at (2171174): [] handle_softirqs+0x67c/0x900 [ 3.884983][ T72] softirqs last disabled at (2171125): [] __irq_exit_rcu+0x145/0x1c0 [ 3.884985][ T72] Preemption disabled at: [ 3.884986][ T72] [<0000000000000000>] 0x0 [ 3.884994][ T72] CPU: 1 UID: 0 PID: 72 Comm: systemd-tmpfile Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 3.884997][ T72] Tainted: [W]=WARN [ 3.884998][ T72] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 3.884999][ T72] Call Trace: [ 3.885001][ T72] [ 3.885002][ T72] dump_stack_lvl+0x6f/0xa0 [ 3.885009][ T72] __might_resched.cold+0x1fe/0x2c1 [ 3.885013][ T72] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 3.885017][ T72] ? __kmalloc_noprof+0xdb/0x760 [ 3.885022][ T72] __kmalloc_noprof+0x443/0x760 [ 3.885024][ T72] ? alloc_buf.isra.0+0x4b/0x260 [ 3.885031][ T72] ? do_raw_spin_unlock+0x59/0x250 [ 3.885033][ T72] alloc_buf.isra.0+0x4b/0x260 [ 3.885037][ T72] put_chars+0x1e1/0x2f0 [ 3.885040][ T72] ? __send_to_port+0x420/0x420 [ 3.885041][ T72] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 3.885044][ T72] ? validate_chain+0x38b/0xc20 [ 3.885050][ T72] hvc_console_print+0x292/0x780 [ 3.885058][ T72] ? hvc_write+0x3a0/0x3a0 [ 3.885060][ T72] ? rcu_is_watching+0x16/0xd0 [ 3.885062][ T72] ? lock_acquire+0x13c/0x160 [ 3.885066][ T72] console_emit_next_record+0x22f/0x4c0 [ 3.885070][ T72] ? devkmsg_read+0x4b0/0x4b0 [ 3.885072][ T72] ? console_flush_one_record+0x106/0x710 [ 3.885075][ T72] ? rcu_is_watching+0x16/0xd0 [ 3.885077][ T72] ? lock_acquire+0x13c/0x160 [ 3.885081][ T72] console_flush_one_record+0x46f/0x710 [ 3.885085][ T72] ? console_emit_next_record+0x4c0/0x4c0 [ 3.885087][ T72] ? __lock_acquire+0x518/0xc20 [ 3.885093][ T72] console_unlock+0xee/0x1f0 [ 3.885095][ T72] ? console_flush_one_record+0x710/0x710 [ 3.885097][ T72] ? rcu_is_watching+0x16/0xd0 [ 3.885099][ T72] ? lock_acquire+0xe0/0x160 [ 3.885103][ T72] ? __down_trylock_console_sem+0x5e/0xa0 [ 3.885105][ T72] ? vprintk_emit+0x320/0x3e0 [ 3.885107][ T72] vprintk_emit+0x37c/0x3e0 [ 3.885110][ T72] ? wake_up_klogd_work_func+0x90/0x90 [ 3.885113][ T72] ? __lock_acquire+0x518/0xc20 [ 3.885117][ T72] _printk+0xc7/0x100 [ 3.885121][ T72] ? snapshot_read.cold+0x21/0x21 [ 3.885124][ T72] ? do_raw_spin_lock+0x131/0x280 [ 3.885126][ T72] ? __rwlock_init+0x150/0x150 [ 3.885130][ T72] ? do_raw_spin_lock+0x131/0x280 [ 3.885133][ T72] do_exit.cold+0x82/0x9c [ 3.885136][ T72] ? exit_notify+0x890/0x890 [ 3.885138][ T72] ? __lock_release.isra.0+0x69/0x1a0 [ 3.885141][ T72] ? rcu_is_watching+0x16/0xd0 [ 3.885144][ T72] do_group_exit+0xb8/0x370 [ 3.885147][ T72] __x64_sys_exit_group+0x3c/0x50 [ 3.885149][ T72] x64_sys_call+0x1567/0x1570 [ 3.885151][ T72] do_syscall_64+0xff/0x530 [ 3.885155][ T72] ? exc_page_fault+0xee/0x100 [ 3.885158][ T72] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3.885160][ T72] RIP: 0033:0x7f66e3b3b1b8 [ 3.885163][ T72] Code: Unable to access opcode bytes at 0x7f66e3b3b18e. [ 3.885164][ T72] RSP: 002b:00007ffed969eb68 EFLAGS: 00000246 [ 3.885164][ T1] virtme-ng-init: Failed to read '/usr/lib/tmpfiles.d/audit.conf': Permission denied [ 3.885164][ T1] Failed to create directory or subvolume "/var/spool/at/spool": Permission denied [ 3.885164][ T1] Failed to create file /var/spool/at/.SEQ: Permission denied [ 3.885164][ T1] Failed to opendir() '/proc/self/fd/6': Permission denied [ 3.885165][ T72] ORIG_RAX: 00000000000000e7 [ 3.885166][ T72] RAX: ffffffffffffffda RBX: 00007f66e3c6bf88 RCX: 00007f66e3b3b1b8 [ 3.885168][ T72] RDX: 00007f66e33994c8 RSI: fffffffffffffe90 RDI: 0000000000000049 [ 3.885169][ T72] RBP: 00007ffed969ebc0 R08: 0000000000000000 R09: 0000000000001000 [ 3.885170][ T72] R10: 00007ffed969e980 R11: 0000000000000246 R12: 0000000000000001 [ 3.885170][ T72] R13: 0000000000000049 R14: 00007f66e3c6a680 R15: 00007f66e3c6bfa0 [ 3.885177][ T72] [ 3.903378][ T1] virtme-ng-init: basic initialization done [ 3.961221][ T78] ip (78) used greatest stack depth: 23848 bytes left [ 3.970009][ T74] virtme-ng-init: Starting systemd-udevd version 259.8-1.fc44 [ 3.970397][ T74] virtme-ng-init: triggering udev coldplug [ 6.511197][ T74] virtme-ng-init: waiting for udev to settle [ 6.511211][ T74] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 6.511214][ T74] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 74, name: virtme-ng-init [ 6.511215][ T74] preempt_count: 1, expected: 0 [ 6.511216][ T74] RCU nest depth: 0, expected: 0 [ 6.511217][ T74] locks held by virtme-ng-init/74: 4, last CPU#3: [ 6.511219][ T74] #0: ffffffffa337ddc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 6.511231][ T74] #1: ffffffffa337de38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 6.511236][ T74] #2: ffffffffa329d760 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 6.511240][ T74] #3: ffffffffa329d660 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 6.511245][ T74] irq event stamp: 4398 [ 6.511246][ T74] hardirqs last enabled at (4397): [] __down_trylock_console_sem+0x86/0xa0 [ 6.511249][ T74] hardirqs last disabled at (4398): [] console_emit_next_record+0x3d4/0x4c0 [ 6.511251][ T74] softirqs last enabled at (3760): [] handle_softirqs+0x67c/0x900 [ 6.511255][ T74] softirqs last disabled at (2801): [] do_softirq+0xac/0xe0 [ 6.511257][ T74] Preemption disabled at: [ 6.511258][ T74] [] vprintk_emit+0x31b/0x3e0 [ 6.511263][ T74] CPU: 3 UID: 0 PID: 74 Comm: virtme-ng-init Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 6.511267][ T74] Tainted: [W]=WARN [ 6.511267][ T74] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 6.511269][ T74] Call Trace: [ 6.511270][ T74] [ 6.511272][ T74] dump_stack_lvl+0x6f/0xa0 [ 6.511278][ T74] ? vprintk_emit+0x31b/0x3e0 [ 6.511280][ T74] __might_resched.cold+0x1fe/0x2c1 [ 6.511284][ T74] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 6.511288][ T74] ? __kmalloc_noprof+0xdb/0x760 [ 6.511293][ T74] __kmalloc_noprof+0x443/0x760 [ 6.511295][ T74] ? alloc_buf.isra.0+0x4b/0x260 [ 6.511301][ T74] ? do_raw_spin_unlock+0x59/0x250 [ 6.511304][ T74] alloc_buf.isra.0+0x4b/0x260 [ 6.511308][ T74] put_chars+0x1e1/0x2f0 [ 6.511310][ T74] ? __send_to_port+0x420/0x420 [ 6.511313][ T74] ? validate_chain+0x38b/0xc20 [ 6.511319][ T74] hvc_console_print+0x292/0x780 [ 6.511326][ T74] ? hvc_write+0x3a0/0x3a0 [ 6.511329][ T74] ? rcu_is_watching+0x16/0xd0 [ 6.511332][ T74] ? lock_acquire+0x13c/0x160 [ 6.511336][ T74] console_emit_next_record+0x22f/0x4c0 [ 6.511340][ T74] ? devkmsg_read+0x4b0/0x4b0 [ 6.511342][ T74] ? console_flush_one_record+0x106/0x710 [ 6.511345][ T74] ? rcu_is_watching+0x16/0xd0 [ 6.511347][ T74] ? lock_acquire+0x13c/0x160 [ 6.511351][ T74] console_flush_one_record+0x46f/0x710 [ 6.511355][ T74] ? console_emit_next_record+0x4c0/0x4c0 [ 6.511357][ T74] ? __lock_acquire+0x518/0xc20 [ 6.511362][ T74] console_unlock+0xee/0x1f0 [ 6.511365][ T74] ? console_flush_one_record+0x710/0x710 [ 6.511367][ T74] ? rcu_is_watching+0x16/0xd0 [ 6.511369][ T74] ? lock_acquire+0xe0/0x160 [ 6.511373][ T74] ? __down_trylock_console_sem+0x5e/0xa0 [ 6.511375][ T74] ? vprintk_emit+0x320/0x3e0 [ 6.511377][ T74] vprintk_emit+0x37c/0x3e0 [ 6.511380][ T74] ? wake_up_klogd_work_func+0x90/0x90 [ 6.511383][ T74] ? _copy_from_iter+0x1bb/0x1810 [ 6.511395][ T74] devkmsg_emit.constprop.0+0xbc/0xf1 [ 6.511399][ T74] ? vprintk_emit.cold+0x107/0x107 [ 6.511401][ T74] ? simple_strntoull+0x10f/0x140 [ 6.511405][ T74] ? date_str+0x1e0/0x1e0 [ 6.511408][ T74] ? devkmsg_write+0xd1/0x2c0 [ 6.511412][ T74] devkmsg_write.cold+0x5a/0x8b [ 6.511414][ T74] ? vprintk_default+0x20/0x20 [ 6.511418][ T74] ? vprintk_default+0x20/0x20 [ 6.511420][ T74] new_sync_write+0x33e/0x760 [ 6.511424][ T74] ? kasan_quarantine_put+0x62/0x2b0 [ 6.511428][ T74] ? new_sync_read+0x750/0x750 [ 6.511430][ T74] ? lock_acquire.part.0+0xd4/0x280 [ 6.511433][ T74] ? __lock_release.isra.0+0x69/0x1a0 [ 6.511438][ T74] ? __fget_files+0x1e3/0x460 [ 6.511442][ T74] vfs_write+0x655/0x970 [ 6.511446][ T74] ksys_write+0x116/0x250 [ 6.511449][ T74] ? __ia32_sys_read+0xc0/0xc0 [ 6.511451][ T74] ? rcu_is_watching+0x16/0xd0 [ 6.511454][ T74] do_syscall_64+0xff/0x530 [ 6.511457][ T74] ? exc_page_fault+0xee/0x100 [ 6.511460][ T74] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 6.511463][ T74] RIP: 0033:0x7fb6722b0ed2 [ 6.511467][ T74] Code: 08 0f 85 51 ec ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 f3 0f 1e fa 55 48 89 e5 [ 6.511468][ T74] RSP: 002b:00007fb6721f7c68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 [ 6.511471][ T74] RAX: ffffffffffffffda RBX: 000000000000002e RCX: 00007fb6722b0ed2 [ 6.511472][ T74] RDX: 000000000000002e RSI: 00007fb66c0012c0 RDI: 0000000000000003 [ 6.511473][ T74] RBP: 00007fb6721f7c90 R08: 0000000000000000 R09: 0000000000000000 [ 6.511474][ T74] R10: 0000000000000000 R11: 0000000000000246 R12: 00007fb67233b0a0 [ 6.511475][ T74] R13: 00007fb6722393e0 R14: 00007fb66c0012c0 R15: 00007fb6721f7da8 [ 6.511482][ T74] [ 6.521901][ C0] clocksource: Watchdog remote CPU 3 read timed out [ 6.521926][ C0] [ 6.521927][ C0] ======================================================== [ 6.521928][ C0] WARNING: possible irq lock inversion dependency detected [ 6.521930][ C0] 7.2.0-virtme #1 Tainted: G W [ 6.521931][ C0] -------------------------------------------------------- [ 6.521932][ C0] (udev-worker)/89 just changed the state of lock: [ 6.521933][ C0] ffffffffa329d760 (console_owner){..-.}-{0:0}, at: console_trylock_spinning+0xa4/0x1e0 [ 6.521943][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 6.521944][ C0] (fs_reclaim){+.+.}-{0:0} [ 6.521946][ C0] [ 6.521946][ C0] [ 6.521946][ C0] and interrupts could create inverse lock ordering between them. [ 6.521946][ C0] [ 6.521947][ C0] [ 6.521947][ C0] other info that might help us debug this: [ 6.521947][ C0] Possible interrupt unsafe locking scenario: [ 6.521947][ C0] [ 6.521948][ C0] CPU0 CPU1 [ 6.521949][ C0] ---- ---- [ 6.521949][ C0] lock(fs_reclaim); [ 6.521950][ C0] local_irq_disable(); [ 6.521951][ C0] lock(console_owner); [ 6.521952][ C0] lock(fs_reclaim); [ 6.521953][ C0] [ 6.521953][ C0] lock(console_owner); [ 6.521954][ C0] [ 6.521954][ C0] *** DEADLOCK *** [ 6.521954][ C0] [ 6.521954][ C0] locks held by (udev-worker)/89: 3, last CPU#0: [ 6.521955][ C0] #0: ffffffffa3394c00 (rcu_read_lock){....}-{1:3}, at: path_init+0x7b5/0x1a60 [ 6.521961][ C0] #1: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 6.521967][ C0] #2: ffffffffa33e29f8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 6.521971][ C0] [ 6.521971][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 6.521975][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 6.521977][ C0] HARDIRQ-ON-W at: [ 6.521978][ C0] __lock_acquire+0x388/0xc20 [ 6.521982][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.521984][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.521987][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.521989][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.521992][ C0] workqueue_init+0x2a/0x680 [ 6.521996][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.521999][ C0] kernel_init+0x21/0x150 [ 6.522002][ C0] ret_from_fork+0x474/0x6b0 [ 6.522005][ C0] ret_from_fork_asm+0x11/0x20 [ 6.522008][ C0] SOFTIRQ-ON-W at: [ 6.522009][ C0] __lock_acquire+0x388/0xc20 [ 6.522011][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.522012][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.522014][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.522015][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.522016][ C0] workqueue_init+0x2a/0x680 [ 6.522018][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.522019][ C0] kernel_init+0x21/0x150 [ 6.522021][ C0] ret_from_fork+0x474/0x6b0 [ 6.522022][ C0] ret_from_fork_asm+0x11/0x20 [ 6.522023][ C0] INITIAL USE at: [ 6.522024][ C0] __lock_acquire+0x388/0xc20 [ 6.522025][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.522027][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.522028][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.522029][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.522031][ C0] workqueue_init+0x2a/0x680 [ 6.522032][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.522034][ C0] kernel_init+0x21/0x150 [ 6.522035][ C0] ret_from_fork+0x474/0x6b0 [ 6.522037][ C0] ret_from_fork_asm+0x11/0x20 [ 6.522038][ C0] } [ 6.522039][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 6.522042][ C0] ... acquired at: [ 6.522044][ C0] __lock_acquire+0x518/0xc20 [ 6.522045][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.522046][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.522048][ C0] __kmalloc_noprof+0xd3/0x760 [ 6.522049][ C0] alloc_buf.isra.0+0x4b/0x260 [ 6.522053][ C0] put_chars+0x1e1/0x2f0 [ 6.522054][ C0] hvc_console_print+0x292/0x780 [ 6.522057][ C0] console_emit_next_record+0x22f/0x4c0 [ 6.522059][ C0] console_flush_one_record+0x46f/0x710 [ 6.522060][ C0] console_unlock+0xee/0x1f0 [ 6.522062][ C0] vprintk_emit+0x37c/0x3e0 [ 6.522063][ C0] _printk+0xc7/0x100 [ 6.522066][ C0] tun_init+0x24/0xb0 [ 6.522069][ C0] do_one_initcall+0x124/0x4f0 [ 6.522070][ C0] kernel_init_freeable+0x596/0x630 [ 6.522072][ C0] kernel_init+0x21/0x150 [ 6.522073][ C0] ret_from_fork+0x474/0x6b0 [ 6.522074][ C0] ret_from_fork_asm+0x11/0x20 [ 6.522076][ C0] [ 6.522076][ C0] -> (console_owner){..-.}-{0:0} { [ 6.522078][ C0] IN-SOFTIRQ-W at: [ 6.522079][ C0] __lock_acquire+0x388/0xc20 [ 6.522080][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.522082][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.522083][ C0] vprintk_emit+0x320/0x3e0 [ 6.522084][ C0] _printk+0xc7/0x100 [ 6.522086][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.522088][ C0] call_timer_fn+0x160/0x4d0 [ 6.522090][ C0] __run_timers+0x68f/0xaa0 [ 6.522092][ C0] run_timer_softirq+0xf0/0x160 [ 6.522093][ C0] handle_softirqs+0x1d3/0x900 [ 6.522096][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.522098][ C0] irq_exit_rcu+0xe/0x30 [ 6.522099][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.522101][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.522102][ C0] __d_lookup_rcu+0xc7/0x410 [ 6.522104][ C0] lookup_fast+0x84/0x630 [ 6.522106][ C0] open_last_lookups+0x410/0x1030 [ 6.522108][ C0] path_openat+0x136/0x3b0 [ 6.522109][ C0] do_file_open+0x209/0x480 [ 6.522110][ C0] do_sys_openat2+0xe0/0x170 [ 6.522111][ C0] __x64_sys_openat+0x10e/0x210 [ 6.522112][ C0] do_syscall_64+0xff/0x530 [ 6.522115][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 6.522116][ C0] INITIAL USE at: [ 6.522117][ C0] } [ 6.522117][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 6.522120][ C0] ... acquired at: [ 6.522120][ C0] mark_lock+0x1d7/0xa00 [ 6.522122][ C0] mark_usage+0x42/0x170 [ 6.522123][ C0] __lock_acquire+0x388/0xc20 [ 6.522124][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.522126][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.522127][ C0] vprintk_emit+0x320/0x3e0 [ 6.522128][ C0] _printk+0xc7/0x100 [ 6.522130][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.522131][ C0] call_timer_fn+0x160/0x4d0 [ 6.522132][ C0] __run_timers+0x68f/0xaa0 [ 6.522134][ C0] run_timer_softirq+0xf0/0x160 [ 6.522135][ C0] handle_softirqs+0x1d3/0x900 [ 6.522137][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.522138][ C0] irq_exit_rcu+0xe/0x30 [ 6.522139][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.522141][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.522142][ C0] __d_lookup_rcu+0xc7/0x410 [ 6.522143][ C0] lookup_fast+0x84/0x630 [ 6.522145][ C0] open_last_lookups+0x410/0x1030 [ 6.522146][ C0] path_openat+0x136/0x3b0 [ 6.522147][ C0] do_file_open+0x209/0x480 [ 6.522148][ C0] do_sys_openat2+0xe0/0x170 [ 6.522149][ C0] __x64_sys_openat+0x10e/0x210 [ 6.522150][ C0] do_syscall_64+0xff/0x530 [ 6.522151][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 6.522152][ C0] [ 6.522153][ C0] [ 6.522153][ C0] stack backtrace: [ 6.522155][ C0] CPU: 0 UID: 0 PID: 89 Comm: (udev-worker) Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 6.522158][ C0] Tainted: [W]=WARN [ 6.522159][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 6.522160][ C0] Call Trace: [ 6.522161][ C0] [ 6.522162][ C0] dump_stack_lvl+0x6f/0xa0 [ 6.522166][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 6.522169][ C0] mark_lock_irq+0x989/0x9c0 [ 6.522170][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 6.522173][ C0] mark_lock+0x1d7/0xa00 [ 6.522175][ C0] mark_usage+0x42/0x170 [ 6.522177][ C0] __lock_acquire+0x388/0xc20 [ 6.522179][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.522181][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 6.522183][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.522185][ C0] ? lock_acquire+0x13c/0x160 [ 6.522187][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.522189][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 6.522191][ C0] vprintk_emit+0x320/0x3e0 [ 6.522192][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 6.522194][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 6.522196][ C0] _printk+0xc7/0x100 [ 6.522198][ C0] ? snapshot_read.cold+0x21/0x21 [ 6.522200][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 6.522202][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.522204][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.522206][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.522208][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.522209][ C0] call_timer_fn+0x160/0x4d0 [ 6.522211][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 6.522213][ C0] ? debug_object_active_state+0x430/0x430 [ 6.522216][ C0] ? find_held_lock+0x2b/0x80 [ 6.522218][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.522220][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.522222][ C0] __run_timers+0x68f/0xaa0 [ 6.522223][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.522226][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 6.522228][ C0] ? __lock_acquire+0x518/0xc20 [ 6.522231][ C0] ? __rwlock_init+0x150/0x150 [ 6.522233][ C0] run_timer_softirq+0xf0/0x160 [ 6.522236][ C0] ? __run_timers+0xaa0/0xaa0 [ 6.522237][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.522239][ C0] handle_softirqs+0x1d3/0x900 [ 6.522241][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.522242][ C0] ? _local_bh_enable+0xc0/0xc0 [ 6.522245][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.522246][ C0] irq_exit_rcu+0xe/0x30 [ 6.522248][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.522249][ C0] [ 6.522250][ C0] [ 6.522250][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.522252][ C0] RIP: 0010:__d_lookup_rcu+0xc7/0x410 [ 6.522254][ C0] Code: 02 00 0f 85 26 03 00 00 48 8b 46 08 49 8d 2c ec 48 89 ea 48 89 44 24 20 48 c1 ea 03 48 b8 00 00 00 00 00 fc ff df 80 3c 02 00 <0f> 85 e7 02 00 00 4c 8b 7d 00 e8 2a 08 f1 01 85 c0 0f 85 c9 01 00 [ 6.522256][ C0] RSP: 0018:ffa0000000537a50 EFLAGS: 00000246 [ 6.522258][ C0] RAX: dffffc0000000000 RBX: ff1100000cee7590 RCX: ff1100000cee7590 [ 6.522259][ C0] RDX: 1fe220000d7d8174 RSI: ffa0000000537c30 RDI: ffa0000000537c38 [ 6.522260][ C0] RBP: ff1100006bec0ba0 R08: 0000000000000000 R09: 0000000000008100 [ 6.522261][ C0] R10: 0000000000000000 R11: ff1100000be82de6 R12: ff1100006be00000 [ 6.522262][ C0] R13: 1ff40000000a6f69 R14: 0000000000000101 R15: dffffc0000000000 [ 6.522265][ C0] lookup_fast+0x84/0x630 [ 6.522267][ C0] ? vfs_rename+0x1d00/0x1d00 [ 6.522269][ C0] ? __asan_memset+0x27/0x50 [ 6.522271][ C0] open_last_lookups+0x410/0x1030 [ 6.522274][ C0] path_openat+0x136/0x3b0 [ 6.522275][ C0] ? rcu_read_lock_any_held+0x3c/0x90 [ 6.522278][ C0] ? kernel_tmpfile_open+0x70/0x70 [ 6.522279][ C0] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 6.522281][ C0] do_file_open+0x209/0x480 [ 6.522283][ C0] ? path_openat+0x3b0/0x3b0 [ 6.522284][ C0] ? __lock_acquire+0x518/0xc20 [ 6.522286][ C0] ? simple_transaction_release+0x50/0x50 [ 6.522290][ C0] ? _raw_spin_unlock+0x2d/0x50 [ 6.522293][ C0] ? alloc_fd+0x33a/0x600 [ 6.522296][ C0] do_sys_openat2+0xe0/0x170 [ 6.522297][ C0] ? build_open_flags+0x6e0/0x6e0 [ 6.522299][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.522300][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 6.522303][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 6.522305][ C0] __x64_sys_openat+0x10e/0x210 [ 6.522306][ C0] ? fput_close_sync+0xde/0x1b0 [ 6.522308][ C0] ? __ia32_sys_open+0x1b0/0x1b0 [ 6.522310][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.522311][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 6.522313][ C0] do_syscall_64+0xff/0x530 [ 6.522315][ C0] ? irq_exit_rcu+0x1a/0x30 [ 6.522316][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 6.522318][ C0] RIP: 0033:0x7f7455b2e54e [ 6.522320][ C0] Code: 4d 89 d8 e8 b4 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 6.522321][ C0] RSP: 002b:00007ffcb57193d0 EFLAGS: 00000202 ORIG_RAX: 0000000000000101 [ 6.522323][ C0] RAX: ffffffffffffffda RBX: 00000000ffffffc9 RCX: 00007f7455b2e54e [ 6.522323][ C0] RDX: 0000000000080100 RSI: 00007ffcb5719490 RDI: ffffffffffffff9c [ 6.522324][ C0] RBP: 00007ffcb57193e0 R08: 0000000000000000 R09: 0000000000000000 [ 6.522325][ C0] R10: 0000000000000000 R11: 0000000000000202 R12: 0000557c70b71540 [ 6.522326][ C0] R13: 00007f74560b97ae R14: ffffffffffffffff R15: 0000000000000000 [ 6.522328][ C0] [ 6.989069][ T74] virtme-ng-init: udev is done [ 6.991030][ T1] virtme-ng-init: initialization done