virtme: waiting for virtiofsd to start virtme: use 'microvm' QEMU architecture [ 1.161858][ T1] tun: Universal TUN/TAP device driver, 1.6 [ 1.161902][ T1] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 1.161904][ T1] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 [ 1.161905][ T1] preempt_count: 1, expected: 0 [ 1.161906][ T1] RCU nest depth: 0, expected: 0 [ 1.161907][ T1] locks held by swapper/0/1: 4, last CPU#0: [ 1.161909][ T1] #0: ffffffffad769cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 1.161920][ T1] #1: ffffffffad769d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 1.161924][ T1] #2: ffffffffad689660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 1.161927][ T1] #3: ffffffffad689560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 1.161931][ T1] irq event stamp: 307860 [ 1.161932][ T1] hardirqs last enabled at (307859): [] __down_trylock_console_sem+0x86/0xa0 [ 1.161935][ T1] hardirqs last disabled at (307860): [] console_emit_next_record+0x3d4/0x4c0 [ 1.161937][ T1] softirqs last enabled at (307808): [] handle_softirqs+0x67c/0x900 [ 1.161940][ T1] softirqs last disabled at (307803): [] __irq_exit_rcu+0x145/0x1c0 [ 1.161943][ T1] Preemption disabled at: [ 1.161943][ T1] [] vprintk_emit+0x31b/0x3e0 [ 1.161948][ T1] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 7.2.0-virtme #1 PREEMPT(full) [ 1.161951][ T1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1.161952][ T1] Call Trace: [ 1.161954][ T1] [ 1.161957][ T1] dump_stack_lvl+0x6f/0xa0 [ 1.161962][ T1] ? vprintk_emit+0x31b/0x3e0 [ 1.161964][ T1] __might_resched.cold+0x1fe/0x2c1 [ 1.161968][ T1] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 1.161971][ T1] ? __kmalloc_noprof+0xdb/0x760 [ 1.161977][ T1] __kmalloc_noprof+0x443/0x760 [ 1.161979][ T1] ? alloc_buf.isra.0+0x4b/0x260 [ 1.161985][ T1] ? do_raw_spin_unlock+0x59/0x250 [ 1.161988][ T1] alloc_buf.isra.0+0x4b/0x260 [ 1.161991][ T1] put_chars+0x1e1/0x2f0 [ 1.161994][ T1] ? __send_to_port+0x420/0x420 [ 1.161997][ T1] ? rcu_read_lock_any_held+0x3c/0x90 [ 1.162001][ T1] ? validate_chain+0x38b/0xc20 [ 1.162006][ T1] hvc_console_print+0x292/0x780 [ 1.162009][ T1] ? __lock_acquire+0x518/0xc20 [ 1.162010][ T1] ? __lock_acquire+0x518/0xc20 [ 1.162015][ T1] ? hvc_write+0x3a0/0x3a0 [ 1.162018][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.162021][ T1] ? lock_acquire+0x13c/0x160 [ 1.162025][ T1] console_emit_next_record+0x22f/0x4c0 [ 1.162028][ T1] ? devkmsg_read+0x4b0/0x4b0 [ 1.162029][ T1] ? console_flush_one_record+0x106/0x710 [ 1.162032][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.162034][ T1] ? lock_acquire+0x13c/0x160 [ 1.162038][ T1] console_flush_one_record+0x46f/0x710 [ 1.162041][ T1] ? console_emit_next_record+0x4c0/0x4c0 [ 1.162043][ T1] ? __lock_acquire+0x518/0xc20 [ 1.162048][ T1] console_unlock+0xee/0x1f0 [ 1.162050][ T1] ? console_flush_one_record+0x710/0x710 [ 1.162052][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.162053][ T1] ? lock_acquire+0x60/0x160 [ 1.162057][ T1] ? __down_trylock_console_sem+0x5e/0xa0 [ 1.162059][ T1] ? vprintk_emit+0x320/0x3e0 [ 1.162062][ T1] vprintk_emit+0x37c/0x3e0 [ 1.162065][ T1] ? wake_up_klogd_work_func+0x90/0x90 [ 1.162070][ T1] ? phy_module_init+0x20/0x20 [ 1.162075][ T1] _printk+0xc7/0x100 [ 1.162080][ T1] ? snapshot_read.cold+0x21/0x21 [ 1.162083][ T1] ? lock_acquire+0x160/0x160 [ 1.162087][ T1] ? _raw_spin_unlock_irqrestore+0x40/0x80 [ 1.162091][ T1] ? add_device_randomness+0xbb/0x100 [ 1.162094][ T1] ? random_write_iter+0x20/0x20 [ 1.162096][ T1] ? timer_init_key+0x10d/0x280 [ 1.162099][ T1] ? do_one_initcall+0x113/0x4f0 [ 1.162102][ T1] tun_init+0x24/0xb0 [ 1.162104][ T1] do_one_initcall+0x124/0x4f0 [ 1.162106][ T1] ? trace_event_raw_event_initcall_level+0x280/0x280 [ 1.162108][ T1] ? parameq+0x110/0x110 [ 1.162114][ T1] ? kernel_init_freeable+0x3f1/0x630 [ 1.162117][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.162120][ T1] kernel_init_freeable+0x596/0x630 [ 1.162123][ T1] ? rest_init+0x280/0x280 [ 1.162127][ T1] kernel_init+0x21/0x150 [ 1.162129][ T1] ? rest_init+0x280/0x280 [ 1.162130][ T1] ret_from_fork+0x474/0x6b0 [ 1.162134][ T1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1.162137][ T1] ? __switch_to+0x5a3/0xe00 [ 1.162141][ T1] ? rest_init+0x280/0x280 [ 1.162143][ T1] ret_from_fork_asm+0x11/0x20 [ 1.162151][ T1] [ 1.187299][ T1] i8042: PNP: No PS/2 controller found. [ 1.197915][ T1] rtc_cmos PNP0B00:00: registered as rtc0 [ 1.198362][ T1] rtc_cmos PNP0B00:00: setting system clock to 2026-08-28T03:58:16 UTC (1787889496) [ 1.200022][ T1] rtc_cmos PNP0B00:00: alarms up to one day, 242 bytes nvram [ 1.208266][ T1] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev [ 1.219504][ T1] NET: Registered PF_INET6 protocol family [ 1.226056][ T1] Segment Routing with IPv6 [ 1.226496][ T1] In-situ OAM (IOAM) with IPv6 [ 1.227031][ T1] NET: Registered PF_PACKET protocol family [ 1.227393][ T1] 9pnet: Installing 9P2000 support [ 1.228013][ T1] Key type dns_resolver registered [ 1.229120][ T1] NET: Registered PF_VSOCK protocol family [ 1.235754][ T1] IPI shorthand broadcast: enabled [ 1.348049][ T1] sched_clock: Marking stable (1312001742, 35776417)->(1445017002, -97238843) [ 1.350522][ T1] registered taskstats version 1 [ 1.353121][ T1] Loading compiled-in X.509 certificates [ 1.452621][ T1] Demotion targets for Node 0: null [ 1.452962][ T1] kmemleak: Kernel memory leak detector initialized (mem pool available: 12240) [ 1.453254][ T1] page_owner is disabled [ 1.454574][ T1] PM: Magic number: 6:874:968 [ 1.455044][ T1] netconsole: network logging started [ 1.456482][ T1] ALSA device list: [ 1.457767][ T1] No soundcards found. [ 1.459646][ T1] md: Skipping autodetection of RAID arrays. (raid=autodetect will force) [ 1.459881][ T71] kwatchdog (71) used greatest stack depth: 29688 bytes left [ 1.462422][ T1] VFS: Mounted root (virtiofs filesystem) readonly on device 0:24. [ 1.463325][ T1] devtmpfs: mounted [ 1.463630][ T1] VFS: Pivoted into new rootfs [ 1.492932][ T1] Freeing unused kernel image (initmem) memory: 2536K [ 1.493301][ T1] Write protecting the kernel read-only data: 55296k [ 1.494001][ T1] Freeing unused kernel image (text/rodata gap) memory: 664K [ 1.494516][ T1] Freeing unused kernel image (rodata/data gap) memory: 624K [ 1.495090][ T1] Run /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init as init process [ 1.495377][ T1] with arguments: [ 1.495508][ T1] /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init [ 1.495749][ T1] with environment: [ 1.495887][ T1] HOME=/ [ 1.496007][ T1] TERM=dumb [ 1.496130][ T1] virtme_hostname=vmksft-packetdrill-dbg,debug-threads=on [ 1.496354][ T1] nr_open=2147483584 [ 1.496492][ T1] virtme_link_mods=/srv/vmksft/testing/wt-8/.virtme_mods/lib/modules/0.0.0 [ 1.496800][ T1] virtme_rw_overlay0=/etc [ 1.496988][ T1] virtme_rw_overlay1=/lib [ 1.497139][ T1] virtme_rw_overlay2=/home [ 1.497327][ T1] virtme_rw_overlay3=/opt [ 1.497509][ T1] virtme_rw_overlay4=/srv [ 1.497666][ T1] virtme_rw_overlay5=/usr [ 1.497830][ T1] virtme_rw_overlay6=/var [ 1.498001][ T1] virtme_rw_overlay7=/tmp [ 1.498215][ T1] virtme_console=ttyS0 [ 1.498365][ T1] virtme_chdir=srv/vmksft/testing/wt-8 [ 1.518588][ T1] virtme-ng-init: mount devtmpfs -> /dev: EBUSY: Device or resource busy [ 1.520698][ T1] virtme-ng-init: Setting hostname to vmksft-packetdrill-dbg,debug-threads=on... [ 1.531667][ T1] overlayfs: failed to set xattr on upper [ 1.532003][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.532281][ T1] overlayfs: ...falling back to uuid=null. [ 1.534660][ T1] overlayfs: failed to set xattr on upper [ 1.534896][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.535143][ T1] overlayfs: ...falling back to uuid=null. [ 1.537295][ T1] overlayfs: failed to set xattr on upper [ 1.537627][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.538391][ T1] overlayfs: ...falling back to uuid=null. [ 1.540454][ T1] overlayfs: failed to set xattr on upper [ 1.540694][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.540948][ T1] overlayfs: ...falling back to uuid=null. [ 1.543426][ T1] overlayfs: failed to set xattr on upper [ 1.543881][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.544345][ T1] overlayfs: ...falling back to uuid=null. [ 1.546926][ T1] overlayfs: failed to set xattr on upper [ 1.547187][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.547447][ T1] overlayfs: ...falling back to uuid=null. [ 1.549534][ T1] overlayfs: failed to set xattr on upper [ 1.549899][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.550256][ T1] overlayfs: ...falling back to uuid=null. [ 1.552282][ T1] overlayfs: failed to set xattr on upper [ 1.552505][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.552744][ T1] overlayfs: ...falling back to uuid=null. [ 1.569147][ T1] virtme-ng-init: running systemd-tmpfiles [ 3.779392][ T73] systemd-tmpfile (73) used greatest stack depth: 24992 bytes left [ 3.779410][ T73] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 3.779412][ T73] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 73, name: systemd-tmpfile [ 3.779414][ T73] preempt_count: 2, expected: 0 [ 3.779415][ T73] RCU nest depth: 0, expected: 0 [ 3.779416][ T73] locks held by systemd-tmpfile/73: 5, last CPU#1: [ 3.779418][ T73] #0: ffffffffad6027b8 (low_water_lock){+.+.}-{3:3}, at: do_exit+0x887/0xdc0 [ 3.779430][ T73] #1: ffffffffad769cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 3.779434][ T73] #2: ffffffffad769d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 3.779437][ T73] #3: ffffffffad689660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 3.779440][ T73] #4: ffffffffad689560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 3.779444][ T73] irq event stamp: 2371626 [ 3.779445][ T73] hardirqs last enabled at (2371625): [] __down_trylock_console_sem+0x86/0xa0 [ 3.779448][ T73] hardirqs last disabled at (2371626): [] console_emit_next_record+0x3d4/0x4c0 [ 3.779450][ T73] softirqs last enabled at (2370696): [] handle_softirqs+0x67c/0x900 [ 3.779452][ T73] softirqs last disabled at (2370691): [] __irq_exit_rcu+0x145/0x1c0 [ 3.779454][ T73] Preemption disabled at: [ 3.779455][ T73] [<0000000000000000>] 0x0 [ 3.779462][ T73] CPU: 1 UID: 0 PID: 73 Comm: systemd-tmpfile Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 3.779465][ T73] Tainted: [W]=WARN [ 3.779466][ T73] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 3.779468][ T73] Call Trace: [ 3.779470][ T73] [ 3.779471][ T73] dump_stack_lvl+0x6f/0xa0 [ 3.779476][ T73] __might_resched.cold+0x1fe/0x2c1 [ 3.779481][ T73] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 3.779484][ T73] ? __kmalloc_noprof+0xdb/0x760 [ 3.779489][ T73] __kmalloc_noprof+0x443/0x760 [ 3.779491][ T73] ? alloc_buf.isra.0+0x4b/0x260 [ 3.779498][ T73] ? do_raw_spin_unlock+0x59/0x250 [ 3.779500][ T73] alloc_buf.isra.0+0x4b/0x260 [ 3.779504][ T73] put_chars+0x1e1/0x2f0 [ 3.779506][ T73] ? __send_to_port+0x420/0x420 [ 3.779508][ T73] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 3.779512][ T73] ? validate_chain+0x38b/0xc20 [ 3.779517][ T73] hvc_console_print+0x292/0x780 [ 3.779523][ T73] ? hvc_write+0x3a0/0x3a0 [ 3.779526][ T73] ? rcu_is_watching+0x16/0xd0 [ 3.779527][ T73] ? lock_acquire+0x13c/0x160 [ 3.779531][ T73] console_emit_next_record+0x22f/0x4c0 [ 3.779535][ T73] ? devkmsg_read+0x4b0/0x4b0 [ 3.779536][ T73] ? console_flush_one_record+0x106/0x710 [ 3.779538][ T73] ? rcu_is_watching+0x16/0xd0 [ 3.779540][ T73] ? lock_acquire+0x13c/0x160 [ 3.779544][ T73] console_flush_one_record+0x46f/0x710 [ 3.779547][ T73] ? console_emit_next_record+0x4c0/0x4c0 [ 3.779549][ T73] ? __lock_acquire+0x518/0xc20 [ 3.779554][ T73] console_unlock+0xee/0x1f0 [ 3.779556][ T73] ? console_flush_one_record+0x710/0x710 [ 3.779557][ T73] ? rcu_is_watching+0x16/0xd0 [ 3.779559][ T73] ? lock_acquire+0x60/0x160 [ 3.779563][ T73] ? __down_trylock_console_sem+0x5e/0xa0 [ 3.779564][ T73] ? vprintk_emit+0x320/0x3e0 [ 3.779567][ T73] vprintk_emit+0x37c/0x3e0 [ 3.779570][ T73] ? wake_up_klogd_work_func+0x90/0x90 [ 3.779573][ T73] ? __lock_acquire+0x518/0xc20 [ 3.779577][ T73] _printk+0xc7/0x100 [ 3.779580][ T73] ? snapshot_read.cold+0x21/0x21 [ 3.779583][ T73] ? do_raw_spin_lock+0x131/0x280 [ 3.779586][ T73] ? __rwlock_init+0x150/0x150 [ 3.779590][ T73] ? do_raw_spin_lock+0x131/0x280 [ 3.779592][ T73] do_exit.cold+0x82/0x9c [ 3.779596][ T73] ? exit_notify+0x890/0x890 [ 3.779597][ T73] ? __lock_release.isra.0+0x69/0x1a0 [ 3.779600][ T73] ? rcu_is_watching+0x16/0xd0 [ 3.779604][ T73] do_group_exit+0xb8/0x370 [ 3.779607][ T73] __x64_sys_exit_group+0x3c/0x50 [ 3.779608][ T73] x64_sys_call+0x1567/0x1570 [ 3.779611][ T73] do_syscall_64+0xff/0x530 [ 3.779615][ T73] ? exc_page_fault+0xee/0x100 [ 3.779618][ T73] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3.779620][ T73] RIP: 0033:0x7fc0ce5051b8 [ 3.779622][ T73] Code: Unable to access opcode bytes at 0x7fc0ce50518e. [ 3.779623][ T73] RSP: 002b:00007ffcce732598 EFLAGS: 00000246 [ 3.779624][ T1] virtme-ng-init: Failed to read '/usr/lib/tmpfiles.d/audit.conf': Permission denied [ 3.779624][ T1] Failed to create directory or subvolume "/var/spool/at/spool": Permission denied [ 3.779624][ T1] Failed to create file /var/spool/at/.SEQ: Permission denied [ 3.779624][ T1] Failed to opendir() '/proc/self/fd/6': Permission denied [ 3.779625][ T73] ORIG_RAX: 00000000000000e7 [ 3.779626][ T73] RAX: ffffffffffffffda RBX: 00007fc0ce635f88 RCX: 00007fc0ce5051b8 [ 3.779627][ T73] RDX: 00007fc0cdd634c8 RSI: fffffffffffffe90 RDI: 0000000000000049 [ 3.779628][ T73] RBP: 00007ffcce7325f0 R08: 0000000000000000 R09: 0000000000001000 [ 3.779629][ T73] R10: 00007ffcce7323b0 R11: 0000000000000246 R12: 0000000000000001 [ 3.779630][ T73] R13: 0000000000000049 R14: 00007fc0ce634680 R15: 00007fc0ce635fa0 [ 3.779636][ T73] [ 3.796941][ T1] virtme-ng-init: basic initialization done [ 3.836306][ T79] ip (79) used greatest stack depth: 24448 bytes left [ 3.866483][ T75] virtme-ng-init: Starting systemd-udevd version 259.8-1.fc44 [ 3.866943][ T75] virtme-ng-init: triggering udev coldplug [ 5.943025][ T75] virtme-ng-init: waiting for udev to settle [ 5.943041][ T75] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 5.943044][ T75] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 75, name: virtme-ng-init [ 5.943046][ T75] preempt_count: 1, expected: 0 [ 5.943047][ T75] RCU nest depth: 0, expected: 0 [ 5.943048][ T75] locks held by virtme-ng-init/75: 4, last CPU#2: [ 5.943051][ T75] #0: ffffffffad769cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 5.943064][ T75] #1: ffffffffad769d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 5.943068][ T75] #2: ffffffffad689660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 5.943072][ T75] #3: ffffffffad689560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 5.943076][ T75] irq event stamp: 2954 [ 5.943077][ T75] hardirqs last enabled at (2953): [] __down_trylock_console_sem+0x86/0xa0 [ 5.943081][ T75] hardirqs last disabled at (2954): [] console_emit_next_record+0x3d4/0x4c0 [ 5.943083][ T75] softirqs last enabled at (2802): [] handle_softirqs+0x67c/0x900 [ 5.943087][ T75] softirqs last disabled at (2797): [] __irq_exit_rcu+0x145/0x1c0 [ 5.943089][ T75] Preemption disabled at: [ 5.943090][ T75] [] vprintk_emit+0x31b/0x3e0 [ 5.943096][ T75] CPU: 2 UID: 0 PID: 75 Comm: virtme-ng-init Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 5.943100][ T75] Tainted: [W]=WARN [ 5.943101][ T75] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 5.943103][ T75] Call Trace: [ 5.943105][ T75] [ 5.943107][ T75] dump_stack_lvl+0x6f/0xa0 [ 5.943112][ T75] ? vprintk_emit+0x31b/0x3e0 [ 5.943114][ T75] __might_resched.cold+0x1fe/0x2c1 [ 5.943119][ T75] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 5.943123][ T75] ? __kmalloc_noprof+0xdb/0x760 [ 5.943129][ T75] __kmalloc_noprof+0x443/0x760 [ 5.943132][ T75] ? alloc_buf.isra.0+0x4b/0x260 [ 5.943139][ T75] ? do_raw_spin_unlock+0x59/0x250 [ 5.943142][ T75] alloc_buf.isra.0+0x4b/0x260 [ 5.943146][ T75] put_chars+0x1e1/0x2f0 [ 5.943150][ T75] ? __send_to_port+0x420/0x420 [ 5.943152][ T75] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 5.943157][ T75] ? validate_chain+0x38b/0xc20 [ 5.943164][ T75] hvc_console_print+0x292/0x780 [ 5.943172][ T75] ? hvc_write+0x3a0/0x3a0 [ 5.943175][ T75] ? rcu_is_watching+0x16/0xd0 [ 5.943178][ T75] ? lock_acquire+0x13c/0x160 [ 5.943183][ T75] console_emit_next_record+0x22f/0x4c0 [ 5.943187][ T75] ? devkmsg_read+0x4b0/0x4b0 [ 5.943188][ T75] ? console_flush_one_record+0x106/0x710 [ 5.943191][ T75] ? rcu_is_watching+0x16/0xd0 [ 5.943193][ T75] ? lock_acquire+0x13c/0x160 [ 5.943197][ T75] console_flush_one_record+0x46f/0x710 [ 5.943201][ T75] ? console_emit_next_record+0x4c0/0x4c0 [ 5.943203][ T75] ? __lock_acquire+0x518/0xc20 [ 5.943209][ T75] console_unlock+0xee/0x1f0 [ 5.943211][ T75] ? console_flush_one_record+0x710/0x710 [ 5.943213][ T75] ? rcu_is_watching+0x16/0xd0 [ 5.943215][ T75] ? lock_acquire+0x60/0x160 [ 5.943219][ T75] ? __down_trylock_console_sem+0x5e/0xa0 [ 5.943221][ T75] ? vprintk_emit+0x320/0x3e0 [ 5.943225][ T75] vprintk_emit+0x37c/0x3e0 [ 5.943228][ T75] ? wake_up_klogd_work_func+0x90/0x90 [ 5.943231][ T75] ? _copy_from_iter+0x1bb/0x1810 [ 5.943238][ T75] devkmsg_emit.constprop.0+0xbc/0xf1 [ 5.943243][ T75] ? vprintk_emit.cold+0x107/0x107 [ 5.943245][ T75] ? simple_strntoull+0x10f/0x140 [ 5.943250][ T75] ? date_str+0x1e0/0x1e0 [ 5.943254][ T75] ? devkmsg_write+0xd1/0x2c0 [ 5.943258][ T75] devkmsg_write.cold+0x5a/0x8b [ 5.943261][ T75] ? vprintk_default+0x20/0x20 [ 5.943266][ T75] ? vprintk_default+0x20/0x20 [ 5.943268][ T75] new_sync_write+0x33e/0x760 [ 5.943272][ T75] ? kasan_quarantine_put+0x42/0x2b0 [ 5.943276][ T75] ? new_sync_read+0x750/0x750 [ 5.943281][ T75] ? __lock_release.isra.0+0x69/0x1a0 [ 5.943286][ T75] ? __fget_files+0x1e3/0x460 [ 5.943290][ T75] vfs_write+0x6a2/0xbd0 [ 5.943295][ T75] ksys_write+0x116/0x250 [ 5.943297][ T75] ? __ia32_sys_read+0xc0/0xc0 [ 5.943300][ T75] ? rcu_is_watching+0x16/0xd0 [ 5.943304][ T75] do_syscall_64+0xff/0x530 [ 5.943306][ T75] ? exc_page_fault+0xee/0x100 [ 5.943309][ T75] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5.943311][ T75] RIP: 0033:0x7fc76e758ed2 [ 5.943315][ T75] Code: 08 0f 85 51 ec ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 f3 0f 1e fa 55 48 89 e5 [ 5.943317][ T75] RSP: 002b:00007fc76e69fc68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 [ 5.943320][ T75] RAX: ffffffffffffffda RBX: 000000000000002e RCX: 00007fc76e758ed2 [ 5.943321][ T75] RDX: 000000000000002e RSI: 00007fc7680012c0 RDI: 0000000000000003 [ 5.943322][ T75] RBP: 00007fc76e69fc90 R08: 0000000000000000 R09: 0000000000000000 [ 5.943323][ T75] R10: 0000000000000000 R11: 0000000000000246 R12: 00007fc76e7e30a0 [ 5.943324][ T75] R13: 00007fc76e6e13e0 R14: 00007fc7680012c0 R15: 00007fc76e69fda8 [ 5.943331][ T75] [ 5.954931][ C0] clocksource: Watchdog remote CPU 2 read timed out [ 5.954970][ C0] [ 5.954972][ C0] ======================================================== [ 5.954974][ C0] WARNING: possible irq lock inversion dependency detected [ 5.954977][ C0] 7.2.0-virtme #1 Tainted: G W [ 5.954978][ C0] -------------------------------------------------------- [ 5.954979][ C0] swapper/0/0 just changed the state of lock: [ 5.954981][ C0] ffffffffad689660 (console_owner){..-.}-{0:0}, at: console_trylock_spinning+0xa4/0x1e0 [ 5.954996][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 5.954997][ C0] (fs_reclaim){+.+.}-{0:0} [ 5.954999][ C0] [ 5.954999][ C0] [ 5.954999][ C0] and interrupts could create inverse lock ordering between them. [ 5.954999][ C0] [ 5.955000][ C0] [ 5.955000][ C0] other info that might help us debug this: [ 5.955001][ C0] Possible interrupt unsafe locking scenario: [ 5.955001][ C0] [ 5.955002][ C0] CPU0 CPU1 [ 5.955003][ C0] ---- ---- [ 5.955003][ C0] lock(fs_reclaim); [ 5.955004][ C0] local_irq_disable(); [ 5.955005][ C0] lock(console_owner); [ 5.955006][ C0] lock(fs_reclaim); [ 5.955007][ C0] [ 5.955007][ C0] lock(console_owner); [ 5.955008][ C0] [ 5.955008][ C0] *** DEADLOCK *** [ 5.955008][ C0] [ 5.955009][ C0] locks held by swapper/0/0: 2, last CPU#0: [ 5.955010][ C0] #0: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 5.955016][ C0] #1: ffffffffad7ce8b8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 5.955021][ C0] [ 5.955021][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 5.955027][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 5.955030][ C0] HARDIRQ-ON-W at: [ 5.955031][ C0] __lock_acquire+0x388/0xc20 [ 5.955035][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.955038][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.955041][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 5.955045][ C0] kthread_create_worker_on_node+0xea/0x210 [ 5.955048][ C0] workqueue_init+0x2a/0x680 [ 5.955052][ C0] kernel_init_freeable+0x2fe/0x630 [ 5.955056][ C0] kernel_init+0x21/0x150 [ 5.955059][ C0] ret_from_fork+0x474/0x6b0 [ 5.955063][ C0] ret_from_fork_asm+0x11/0x20 [ 5.955067][ C0] SOFTIRQ-ON-W at: [ 5.955068][ C0] __lock_acquire+0x388/0xc20 [ 5.955070][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.955072][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.955073][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 5.955075][ C0] kthread_create_worker_on_node+0xea/0x210 [ 5.955077][ C0] workqueue_init+0x2a/0x680 [ 5.955079][ C0] kernel_init_freeable+0x2fe/0x630 [ 5.955081][ C0] kernel_init+0x21/0x150 [ 5.955082][ C0] ret_from_fork+0x474/0x6b0 [ 5.955084][ C0] ret_from_fork_asm+0x11/0x20 [ 5.955086][ C0] INITIAL USE at: [ 5.955087][ C0] __lock_acquire+0x388/0xc20 [ 5.955089][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.955091][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.955092][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 5.955094][ C0] kthread_create_worker_on_node+0xea/0x210 [ 5.955096][ C0] workqueue_init+0x2a/0x680 [ 5.955098][ C0] kernel_init_freeable+0x2fe/0x630 [ 5.955100][ C0] kernel_init+0x21/0x150 [ 5.955101][ C0] ret_from_fork+0x474/0x6b0 [ 5.955103][ C0] ret_from_fork_asm+0x11/0x20 [ 5.955105][ C0] } [ 5.955105][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 5.955110][ C0] ... acquired at: [ 5.955111][ C0] __lock_acquire+0x518/0xc20 [ 5.955113][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.955115][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.955116][ C0] __kmalloc_noprof+0xd3/0x760 [ 5.955118][ C0] alloc_buf.isra.0+0x4b/0x260 [ 5.955122][ C0] put_chars+0x1e1/0x2f0 [ 5.955123][ C0] hvc_console_print+0x292/0x780 [ 5.955126][ C0] console_emit_next_record+0x22f/0x4c0 [ 5.955128][ C0] console_flush_one_record+0x46f/0x710 [ 5.955129][ C0] console_unlock+0xee/0x1f0 [ 5.955130][ C0] vprintk_emit+0x37c/0x3e0 [ 5.955132][ C0] _printk+0xc7/0x100 [ 5.955135][ C0] tun_init+0x24/0xb0 [ 5.955137][ C0] do_one_initcall+0x124/0x4f0 [ 5.955139][ C0] kernel_init_freeable+0x596/0x630 [ 5.955141][ C0] kernel_init+0x21/0x150 [ 5.955143][ C0] ret_from_fork+0x474/0x6b0 [ 5.955144][ C0] ret_from_fork_asm+0x11/0x20 [ 5.955146][ C0] [ 5.955146][ C0] -> (console_owner){..-.}-{0:0} { [ 5.955149][ C0] IN-SOFTIRQ-W at: [ 5.955150][ C0] __lock_acquire+0x388/0xc20 [ 5.955152][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.955154][ C0] console_trylock_spinning+0xb5/0x1e0 [ 5.955156][ C0] vprintk_emit+0x320/0x3e0 [ 5.955158][ C0] _printk+0xc7/0x100 [ 5.955159][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 5.955162][ C0] call_timer_fn+0x160/0x4d0 [ 5.955163][ C0] __run_timers+0x68f/0xaa0 [ 5.955164][ C0] run_timer_softirq+0xf0/0x160 [ 5.955166][ C0] handle_softirqs+0x1d3/0x900 [ 5.955169][ C0] __irq_exit_rcu+0x145/0x1c0 [ 5.955170][ C0] irq_exit_rcu+0xe/0x30 [ 5.955172][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 5.955174][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5.955177][ C0] pv_native_safe_halt+0xf/0x10 [ 5.955178][ C0] default_idle+0x9/0x10 [ 5.955180][ C0] default_idle_call+0x6e/0xb0 [ 5.955182][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 5.955185][ C0] do_idle+0xd8/0x190 [ 5.955187][ C0] cpu_startup_entry+0x53/0x70 [ 5.955188][ C0] rest_init+0x279/0x280 [ 5.955190][ C0] start_kernel+0x3af/0x3b0 [ 5.955192][ C0] x86_64_start_reservations+0x24/0x30 [ 5.955194][ C0] x86_64_start_kernel+0x12b/0x130 [ 5.955195][ C0] common_startup_64+0x13e/0x148 [ 5.955198][ C0] INITIAL USE at: [ 5.955199][ C0] } [ 5.955199][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 5.955203][ C0] ... acquired at: [ 5.955203][ C0] mark_lock+0x1d7/0xa00 [ 5.955205][ C0] mark_usage+0x42/0x170 [ 5.955206][ C0] __lock_acquire+0x388/0xc20 [ 5.955208][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.955209][ C0] console_trylock_spinning+0xb5/0x1e0 [ 5.955211][ C0] vprintk_emit+0x320/0x3e0 [ 5.955212][ C0] _printk+0xc7/0x100 [ 5.955213][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 5.955215][ C0] call_timer_fn+0x160/0x4d0 [ 5.955216][ C0] __run_timers+0x68f/0xaa0 [ 5.955217][ C0] run_timer_softirq+0xf0/0x160 [ 5.955218][ C0] handle_softirqs+0x1d3/0x900 [ 5.955219][ C0] __irq_exit_rcu+0x145/0x1c0 [ 5.955220][ C0] irq_exit_rcu+0xe/0x30 [ 5.955222][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 5.955223][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5.955224][ C0] pv_native_safe_halt+0xf/0x10 [ 5.955225][ C0] default_idle+0x9/0x10 [ 5.955227][ C0] default_idle_call+0x6e/0xb0 [ 5.955228][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 5.955229][ C0] do_idle+0xd8/0x190 [ 5.955231][ C0] cpu_startup_entry+0x53/0x70 [ 5.955232][ C0] rest_init+0x279/0x280 [ 5.955233][ C0] start_kernel+0x3af/0x3b0 [ 5.955235][ C0] x86_64_start_reservations+0x24/0x30 [ 5.955236][ C0] x86_64_start_kernel+0x12b/0x130 [ 5.955237][ C0] common_startup_64+0x13e/0x148 [ 5.955238][ C0] [ 5.955238][ C0] [ 5.955238][ C0] stack backtrace: [ 5.955242][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 5.955245][ C0] Tainted: [W]=WARN [ 5.955246][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 5.955247][ C0] Call Trace: [ 5.955249][ C0] [ 5.955250][ C0] dump_stack_lvl+0x6f/0xa0 [ 5.955253][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 5.955256][ C0] mark_lock_irq+0x989/0x9c0 [ 5.955258][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 5.955261][ C0] mark_lock+0x1d7/0xa00 [ 5.955263][ C0] mark_usage+0x42/0x170 [ 5.955265][ C0] __lock_acquire+0x388/0xc20 [ 5.955268][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.955269][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 5.955272][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.955274][ C0] ? lock_acquire+0x13c/0x160 [ 5.955276][ C0] console_trylock_spinning+0xb5/0x1e0 [ 5.955278][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 5.955280][ C0] vprintk_emit+0x320/0x3e0 [ 5.955282][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 5.955284][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 5.955286][ C0] _printk+0xc7/0x100 [ 5.955288][ C0] ? snapshot_read.cold+0x21/0x21 [ 5.955290][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 5.955292][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 5.955295][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 5.955296][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 5.955299][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 5.955300][ C0] call_timer_fn+0x160/0x4d0 [ 5.955302][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 5.955303][ C0] ? debug_object_active_state+0x430/0x430 [ 5.955306][ C0] ? find_held_lock+0x2b/0x80 [ 5.955308][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 5.955310][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.955312][ C0] __run_timers+0x68f/0xaa0 [ 5.955313][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 5.955316][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 5.955317][ C0] ? __lock_acquire+0x518/0xc20 [ 5.955320][ C0] ? __rwlock_init+0x150/0x150 [ 5.955323][ C0] run_timer_softirq+0xf0/0x160 [ 5.955325][ C0] ? __run_timers+0xaa0/0xaa0 [ 5.955326][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 5.955329][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.955330][ C0] handle_softirqs+0x1d3/0x900 [ 5.955332][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 5.955334][ C0] ? _local_bh_enable+0xc0/0xc0 [ 5.955337][ C0] __irq_exit_rcu+0x145/0x1c0 [ 5.955338][ C0] irq_exit_rcu+0xe/0x30 [ 5.955340][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 5.955342][ C0] [ 5.955342][ C0] [ 5.955343][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 5.955345][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5.955346][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 5.955349][ C0] Code: 48 8b 3d 94 e2 f8 01 e8 1f 00 00 00 48 2b 05 58 e3 99 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 d6 16 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 5.955351][ C0] RSP: 0018:ffffffffad407cf8 EFLAGS: 00000296 [ 5.955353][ C0] RAX: 000000000003531b RBX: ffffffffad41c600 RCX: ffffffffaa4ed307 [ 5.955354][ C0] RDX: ffffffffad41c600 RSI: ffffffffad229f9e RDI: ffffffffacc8d8e0 [ 5.955355][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5.955356][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff5a80fa2 [ 5.955357][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 5.955358][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 5.955361][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 5.955363][ C0] default_idle+0x9/0x10 [ 5.955364][ C0] default_idle_call+0x6e/0xb0 [ 5.955366][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 5.955368][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 5.955369][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 5.955373][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.955374][ C0] do_idle+0xd8/0x190 [ 5.955376][ C0] cpu_startup_entry+0x53/0x70 [ 5.955378][ C0] rest_init+0x279/0x280 [ 5.955380][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 5.955382][ C0] ? rest_init+0x280/0x280 [ 5.955384][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 5.955387][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 5.955389][ C0] ? acpi_enable+0x1e4/0x330 [ 5.955392][ C0] start_kernel+0x3af/0x3b0 [ 5.955394][ C0] x86_64_start_reservations+0x24/0x30 [ 5.955395][ C0] x86_64_start_kernel+0x12b/0x130 [ 5.955396][ C0] common_startup_64+0x13e/0x148 [ 5.955400][ C0] [ 6.332597][ T75] virtme-ng-init: udev is done [ 6.335236][ T1] virtme-ng-init: initialization done