virtme: waiting for virtiofsd to start virtme: use 'microvm' QEMU architecture [ 1.035502][ T1] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev [ 1.035527][ T1] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 1.035529][ T1] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 [ 1.035530][ T1] preempt_count: 1, expected: 0 [ 1.035531][ T1] RCU nest depth: 0, expected: 0 [ 1.035532][ T1] locks held by swapper/0/1: 4, last CPU#3: [ 1.035534][ T1] #0: ffffffffab569cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 1.035545][ T1] #1: ffffffffab569d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 1.035548][ T1] #2: ffffffffab489660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 1.035552][ T1] #3: ffffffffab489560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 1.035555][ T1] irq event stamp: 317690 [ 1.035556][ T1] hardirqs last enabled at (317689): [] __down_trylock_console_sem+0x86/0xa0 [ 1.035559][ T1] hardirqs last disabled at (317690): [] console_emit_next_record+0x3d4/0x4c0 [ 1.035561][ T1] softirqs last enabled at (316876): [] handle_softirqs+0x67c/0x900 [ 1.035564][ T1] softirqs last disabled at (316523): [] __irq_exit_rcu+0x145/0x1c0 [ 1.035566][ T1] Preemption disabled at: [ 1.035567][ T1] [] vprintk_emit+0x31b/0x3e0 [ 1.035572][ T1] CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 7.2.0-virtme #1 PREEMPT(full) [ 1.035574][ T1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1.035576][ T1] Call Trace: [ 1.035578][ T1] [ 1.035581][ T1] dump_stack_lvl+0x6f/0xa0 [ 1.035585][ T1] ? vprintk_emit+0x31b/0x3e0 [ 1.035587][ T1] __might_resched.cold+0x1fe/0x2c1 [ 1.035591][ T1] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 1.035594][ T1] ? __kmalloc_noprof+0xdb/0x760 [ 1.035599][ T1] __kmalloc_noprof+0x443/0x760 [ 1.035602][ T1] ? alloc_buf.isra.0+0x4b/0x260 [ 1.035607][ T1] ? do_raw_spin_unlock+0x59/0x250 [ 1.035610][ T1] alloc_buf.isra.0+0x4b/0x260 [ 1.035613][ T1] put_chars+0x1e1/0x2f0 [ 1.035615][ T1] ? prb_final_commit+0x50/0x50 [ 1.035618][ T1] ? __send_to_port+0x420/0x420 [ 1.035621][ T1] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 1.035624][ T1] ? rcu_read_lock_any_held+0x3c/0x90 [ 1.035627][ T1] ? validate_chain+0x38b/0xc20 [ 1.035631][ T1] hvc_console_print+0x292/0x780 [ 1.035634][ T1] ? mark_usage+0x61/0x170 [ 1.035636][ T1] ? __lock_acquire+0x518/0xc20 [ 1.035638][ T1] ? __lock_acquire+0x518/0xc20 [ 1.035642][ T1] ? hvc_write+0x3a0/0x3a0 [ 1.035644][ T1] ? console_emit_next_record+0x1df/0x4c0 [ 1.035646][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.035648][ T1] ? lock_acquire+0x13c/0x160 [ 1.035652][ T1] console_emit_next_record+0x22f/0x4c0 [ 1.035655][ T1] ? devkmsg_read+0x4b0/0x4b0 [ 1.035656][ T1] ? console_flush_one_record+0x106/0x710 [ 1.035659][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.035661][ T1] ? lock_acquire+0x13c/0x160 [ 1.035664][ T1] console_flush_one_record+0x46f/0x710 [ 1.035668][ T1] ? console_emit_next_record+0x4c0/0x4c0 [ 1.035669][ T1] ? __lock_acquire+0x518/0xc20 [ 1.035674][ T1] console_unlock+0xee/0x1f0 [ 1.035676][ T1] ? console_flush_one_record+0x710/0x710 [ 1.035678][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.035679][ T1] ? lock_acquire+0x60/0x160 [ 1.035683][ T1] ? __down_trylock_console_sem+0x5e/0xa0 [ 1.035685][ T1] ? vprintk_emit+0x320/0x3e0 [ 1.035688][ T1] vprintk_emit+0x37c/0x3e0 [ 1.035690][ T1] ? wake_up_klogd_work_func+0x90/0x90 [ 1.035693][ T1] ? misc_register+0x151/0x670 [ 1.035696][ T1] ? md_run_setup+0x90/0x90 [ 1.035700][ T1] _printk+0xc7/0x100 [ 1.035703][ T1] ? snapshot_read.cold+0x21/0x21 [ 1.035705][ T1] ? md_run_setup+0x90/0x90 [ 1.035709][ T1] ? md_run_setup+0x90/0x90 [ 1.035712][ T1] dm_interface_init+0x50/0x60 [ 1.035714][ T1] dm_init+0x51/0xd0 [ 1.035717][ T1] ? md_run_setup+0x90/0x90 [ 1.035719][ T1] do_one_initcall+0x124/0x4f0 [ 1.035722][ T1] ? trace_event_raw_event_initcall_level+0x280/0x280 [ 1.035724][ T1] ? parameq+0x110/0x110 [ 1.035729][ T1] ? kernel_init_freeable+0x3f1/0x630 [ 1.035733][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.035736][ T1] kernel_init_freeable+0x596/0x630 [ 1.035738][ T1] ? rest_init+0x280/0x280 [ 1.035743][ T1] kernel_init+0x21/0x150 [ 1.035745][ T1] ? rest_init+0x280/0x280 [ 1.035746][ T1] ret_from_fork+0x474/0x6b0 [ 1.035750][ T1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1.035753][ T1] ? __switch_to+0x5a3/0xe00 [ 1.035757][ T1] ? rest_init+0x280/0x280 [ 1.035759][ T1] ret_from_fork_asm+0x11/0x20 [ 1.035767][ T1] [ 1.058694][ T1] NET: Registered PF_INET6 protocol family [ 1.064696][ T1] Segment Routing with IPv6 [ 1.065137][ T1] In-situ OAM (IOAM) with IPv6 [ 1.065507][ T1] NET: Registered PF_PACKET protocol family [ 1.065829][ T1] 9pnet: Installing 9P2000 support [ 1.066183][ T1] Key type dns_resolver registered [ 1.066835][ T1] NET: Registered PF_VSOCK protocol family [ 1.071004][ T1] IPI shorthand broadcast: enabled [ 1.173911][ T1] sched_clock: Marking stable (1136001937, 37318239)->(1254069564, -80749388) [ 1.176197][ T1] registered taskstats version 1 [ 1.179128][ T1] Loading compiled-in X.509 certificates [ 1.277611][ T1] Demotion targets for Node 0: null [ 1.277932][ T1] kmemleak: Kernel memory leak detector initialized (mem pool available: 12241) [ 1.278212][ T1] page_owner is disabled [ 1.279241][ T1] PM: Magic number: 6:182:4 [ 1.279697][ T1] netconsole: network logging started [ 1.281058][ T1] ALSA device list: [ 1.281820][ T1] No soundcards found. [ 1.282889][ T1] md: Skipping autodetection of RAID arrays. (raid=autodetect will force) [ 1.285416][ T1] VFS: Mounted root (virtiofs filesystem) readonly on device 0:24. [ 1.286218][ T1] devtmpfs: mounted [ 1.286513][ T1] VFS: Pivoted into new rootfs [ 1.316247][ T1] Freeing unused kernel image (initmem) memory: 2536K [ 1.316678][ T1] Write protecting the kernel read-only data: 55296k [ 1.317296][ T1] Freeing unused kernel image (text/rodata gap) memory: 664K [ 1.317813][ T1] Freeing unused kernel image (rodata/data gap) memory: 624K [ 1.318412][ T1] Run /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init as init process [ 1.318680][ T1] with arguments: [ 1.318790][ T1] /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init [ 1.319041][ T1] with environment: [ 1.319150][ T1] HOME=/ [ 1.319258][ T1] TERM=dumb [ 1.319385][ T1] virtme_hostname=vmksft-packetdrill-dbg,debug-threads=on [ 1.319652][ T1] nr_open=2147483584 [ 1.319755][ T1] virtme_link_mods=/srv/vmksft/testing/wt-8/.virtme_mods/lib/modules/0.0.0 [ 1.320000][ T1] virtme_rw_overlay0=/etc [ 1.320140][ T1] virtme_rw_overlay1=/lib [ 1.320277][ T1] virtme_rw_overlay2=/home [ 1.320435][ T1] virtme_rw_overlay3=/opt [ 1.320580][ T1] virtme_rw_overlay4=/srv [ 1.320724][ T1] virtme_rw_overlay5=/usr [ 1.320865][ T1] virtme_rw_overlay6=/var [ 1.321003][ T1] virtme_rw_overlay7=/tmp [ 1.321139][ T1] virtme_console=ttyS0 [ 1.321285][ T1] virtme_chdir=srv/vmksft/testing/wt-8 [ 1.341889][ T1] virtme-ng-init: mount devtmpfs -> /dev: EBUSY: Device or resource busy [ 1.343092][ T1] virtme-ng-init: Setting hostname to vmksft-packetdrill-dbg,debug-threads=on... [ 1.353167][ T1] overlayfs: failed to set xattr on upper [ 1.353449][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.353700][ T1] overlayfs: ...falling back to uuid=null. [ 1.356112][ T1] overlayfs: failed to set xattr on upper [ 1.356342][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.356567][ T1] overlayfs: ...falling back to uuid=null. [ 1.358557][ T1] overlayfs: failed to set xattr on upper [ 1.358753][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.358975][ T1] overlayfs: ...falling back to uuid=null. [ 1.361378][ T1] overlayfs: failed to set xattr on upper [ 1.361580][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.361807][ T1] overlayfs: ...falling back to uuid=null. [ 1.363815][ T1] overlayfs: failed to set xattr on upper [ 1.364006][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.364225][ T1] overlayfs: ...falling back to uuid=null. [ 1.365916][ T1] overlayfs: failed to set xattr on upper [ 1.366102][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.366469][ T1] overlayfs: ...falling back to uuid=null. [ 1.368404][ T1] overlayfs: failed to set xattr on upper [ 1.368602][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.368830][ T1] overlayfs: ...falling back to uuid=null. [ 1.370774][ T1] overlayfs: failed to set xattr on upper [ 1.370972][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.371190][ T1] overlayfs: ...falling back to uuid=null. [ 1.384769][ T1] virtme-ng-init: running systemd-tmpfiles [ 1.417909][ T74] kwatchdog (74) used greatest stack depth: 29688 bytes left [ 3.558745][ T73] systemd-tmpfile (73) used greatest stack depth: 25104 bytes left [ 3.558763][ T73] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 3.558765][ T73] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 73, name: systemd-tmpfile [ 3.558766][ T73] preempt_count: 2, expected: 0 [ 3.558767][ T73] RCU nest depth: 0, expected: 0 [ 3.558768][ T73] locks held by systemd-tmpfile/73: 5, last CPU#3: [ 3.558771][ T73] #0: ffffffffab4027b8 (low_water_lock){+.+.}-{3:3}, at: do_exit+0x887/0xdc0 [ 3.558783][ T73] #1: ffffffffab569cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 3.558788][ T73] #2: ffffffffab569d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 3.558791][ T73] #3: ffffffffab489660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 3.558794][ T73] #4: ffffffffab489560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 3.558797][ T73] irq event stamp: 2297430 [ 3.558798][ T73] hardirqs last enabled at (2297429): [] __down_trylock_console_sem+0x86/0xa0 [ 3.558802][ T73] hardirqs last disabled at (2297430): [] console_emit_next_record+0x3d4/0x4c0 [ 3.558803][ T73] softirqs last enabled at (2296010): [] handle_softirqs+0x67c/0x900 [ 3.558806][ T73] softirqs last disabled at (2295711): [] __irq_exit_rcu+0x145/0x1c0 [ 3.558808][ T73] Preemption disabled at: [ 3.558809][ T73] [<0000000000000000>] 0x0 [ 3.558816][ T73] CPU: 3 UID: 0 PID: 73 Comm: systemd-tmpfile Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 3.558819][ T73] Tainted: [W]=WARN [ 3.558820][ T73] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 3.558822][ T73] Call Trace: [ 3.558824][ T73] [ 3.558825][ T73] dump_stack_lvl+0x6f/0xa0 [ 3.558831][ T73] __might_resched.cold+0x1fe/0x2c1 [ 3.558835][ T73] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 3.558838][ T73] ? __kmalloc_noprof+0xdb/0x760 [ 3.558844][ T73] __kmalloc_noprof+0x443/0x760 [ 3.558847][ T73] ? alloc_buf.isra.0+0x4b/0x260 [ 3.558853][ T73] ? do_raw_spin_unlock+0x59/0x250 [ 3.558856][ T73] alloc_buf.isra.0+0x4b/0x260 [ 3.558859][ T73] put_chars+0x1e1/0x2f0 [ 3.558862][ T73] ? __send_to_port+0x420/0x420 [ 3.558864][ T73] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 3.558868][ T73] ? validate_chain+0x38b/0xc20 [ 3.558873][ T73] hvc_console_print+0x292/0x780 [ 3.558880][ T73] ? hvc_write+0x3a0/0x3a0 [ 3.558882][ T73] ? rcu_is_watching+0x16/0xd0 [ 3.558884][ T73] ? lock_acquire+0x13c/0x160 [ 3.558889][ T73] console_emit_next_record+0x22f/0x4c0 [ 3.558892][ T73] ? devkmsg_read+0x4b0/0x4b0 [ 3.558893][ T73] ? console_flush_one_record+0x106/0x710 [ 3.558896][ T73] ? rcu_is_watching+0x16/0xd0 [ 3.558898][ T73] ? lock_acquire+0x13c/0x160 [ 3.558902][ T73] console_flush_one_record+0x46f/0x710 [ 3.558905][ T73] ? console_emit_next_record+0x4c0/0x4c0 [ 3.558907][ T73] ? __lock_acquire+0x518/0xc20 [ 3.558912][ T73] console_unlock+0xee/0x1f0 [ 3.558915][ T73] ? console_flush_one_record+0x710/0x710 [ 3.558916][ T73] ? rcu_is_watching+0x16/0xd0 [ 3.558918][ T73] ? lock_acquire+0x60/0x160 [ 3.558922][ T73] ? __down_trylock_console_sem+0x5e/0xa0 [ 3.558924][ T73] ? vprintk_emit+0x320/0x3e0 [ 3.558926][ T73] vprintk_emit+0x37c/0x3e0 [ 3.558930][ T73] ? wake_up_klogd_work_func+0x90/0x90 [ 3.558933][ T73] ? __lock_acquire+0x518/0xc20 [ 3.558936][ T73] _printk+0xc7/0x100 [ 3.558940][ T73] ? snapshot_read.cold+0x21/0x21 [ 3.558943][ T73] ? do_raw_spin_lock+0x131/0x280 [ 3.558946][ T73] ? __rwlock_init+0x150/0x150 [ 3.558950][ T73] ? do_raw_spin_lock+0x131/0x280 [ 3.558953][ T73] do_exit.cold+0x82/0x9c [ 3.558956][ T73] ? exit_notify+0x890/0x890 [ 3.558958][ T73] ? __lock_release.isra.0+0x69/0x1a0 [ 3.558961][ T73] ? rcu_is_watching+0x16/0xd0 [ 3.558965][ T73] do_group_exit+0xb8/0x370 [ 3.558968][ T73] __x64_sys_exit_group+0x3c/0x50 [ 3.558970][ T73] x64_sys_call+0x1567/0x1570 [ 3.558973][ T73] do_syscall_64+0xff/0x530 [ 3.558977][ T73] ? exc_page_fault+0xee/0x100 [ 3.558980][ T73] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3.558983][ T73] RIP: 0033:0x7fcce0cb01b8 [ 3.558985][ T73] Code: Unable to access opcode bytes at 0x7fcce0cb018e. [ 3.558986][ T73] RSP: 002b:00007ffe56a72d68 EFLAGS: 00000246 [ 3.558986][ T1] virtme-ng-init: Failed to read '/usr/lib/tmpfiles.d/audit.conf': Permission denied [ 3.558986][ T1] Failed to create directory or subvolume "/var/spool/at/spool": Permission denied [ 3.558986][ T1] Failed to create file /var/spool/at/.SEQ: Permission denied [ 3.558986][ T1] Failed to opendir() '/proc/self/fd/6': Permission denied [ 3.558987][ T73] ORIG_RAX: 00000000000000e7 [ 3.558989][ T73] RAX: ffffffffffffffda RBX: 00007fcce0de0f88 RCX: 00007fcce0cb01b8 [ 3.558990][ T73] RDX: 00007fcce050e4c8 RSI: fffffffffffffe90 RDI: 0000000000000049 [ 3.558991][ T73] RBP: 00007ffe56a72dc0 R08: 0000000000000000 R09: 0000000000001000 [ 3.558992][ T73] R10: 00007ffe56a72b80 R11: 0000000000000246 R12: 0000000000000001 [ 3.558993][ T73] R13: 0000000000000049 R14: 00007fcce0ddf680 R15: 00007fcce0de0fa0 [ 3.558999][ T73] [ 3.577684][ T1] virtme-ng-init: basic initialization done [ 3.622374][ T78] ip (78) used greatest stack depth: 24240 bytes left [ 3.641307][ T75] virtme-ng-init: Starting systemd-udevd version 259.8-1.fc44 [ 3.641773][ T75] virtme-ng-init: triggering udev coldplug [ 5.877860][ T75] virtme-ng-init: waiting for udev to settle [ 5.877877][ T75] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 5.877880][ T75] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 75, name: virtme-ng-init [ 5.877883][ T75] preempt_count: 1, expected: 0 [ 5.877884][ T75] RCU nest depth: 0, expected: 0 [ 5.877885][ T75] locks held by virtme-ng-init/75: 4, last CPU#2: [ 5.877888][ T75] #0: ffffffffab569cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 5.877904][ T75] #1: ffffffffab569d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 5.877910][ T75] #2: ffffffffab489660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 5.877916][ T75] #3: ffffffffab489560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 5.877922][ T75] irq event stamp: 3154 [ 5.877923][ T75] hardirqs last enabled at (3153): [] __down_trylock_console_sem+0x86/0xa0 [ 5.877928][ T75] hardirqs last disabled at (3154): [] console_emit_next_record+0x3d4/0x4c0 [ 5.877930][ T75] softirqs last enabled at (3114): [] handle_softirqs+0x67c/0x900 [ 5.877935][ T75] softirqs last disabled at (2973): [] __irq_exit_rcu+0x145/0x1c0 [ 5.877939][ T75] Preemption disabled at: [ 5.877939][ T75] [] vprintk_emit+0x31b/0x3e0 [ 5.877946][ T75] CPU: 2 UID: 0 PID: 75 Comm: virtme-ng-init Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 5.877951][ T75] Tainted: [W]=WARN [ 5.877952][ T75] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 5.877955][ T75] Call Trace: [ 5.877957][ T75] [ 5.877960][ T75] dump_stack_lvl+0x6f/0xa0 [ 5.877967][ T75] ? vprintk_emit+0x31b/0x3e0 [ 5.877970][ T75] __might_resched.cold+0x1fe/0x2c1 [ 5.877976][ T75] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 5.877981][ T75] ? __kmalloc_noprof+0xdb/0x760 [ 5.877988][ T75] __kmalloc_noprof+0x443/0x760 [ 5.877992][ T75] ? alloc_buf.isra.0+0x4b/0x260 [ 5.878001][ T75] ? do_raw_spin_unlock+0x59/0x250 [ 5.878004][ T75] alloc_buf.isra.0+0x4b/0x260 [ 5.878010][ T75] put_chars+0x1e1/0x2f0 [ 5.878014][ T75] ? __send_to_port+0x420/0x420 [ 5.878016][ T75] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 5.878023][ T75] ? validate_chain+0x38b/0xc20 [ 5.878032][ T75] hvc_console_print+0x292/0x780 [ 5.878043][ T75] ? hvc_write+0x3a0/0x3a0 [ 5.878047][ T75] ? rcu_is_watching+0x16/0xd0 [ 5.878050][ T75] ? lock_acquire+0x13c/0x160 [ 5.878057][ T75] console_emit_next_record+0x22f/0x4c0 [ 5.878063][ T75] ? devkmsg_read+0x4b0/0x4b0 [ 5.878065][ T75] ? console_flush_one_record+0x106/0x710 [ 5.878069][ T75] ? rcu_is_watching+0x16/0xd0 [ 5.878073][ T75] ? lock_acquire+0x13c/0x160 [ 5.878080][ T75] console_flush_one_record+0x46f/0x710 [ 5.878086][ T75] ? console_emit_next_record+0x4c0/0x4c0 [ 5.878088][ T75] ? __lock_acquire+0x518/0xc20 [ 5.878098][ T75] console_unlock+0xee/0x1f0 [ 5.878102][ T75] ? console_flush_one_record+0x710/0x710 [ 5.878104][ T75] ? rcu_is_watching+0x16/0xd0 [ 5.878107][ T75] ? lock_acquire+0x60/0x160 [ 5.878114][ T75] ? __down_trylock_console_sem+0x5e/0xa0 [ 5.878117][ T75] ? vprintk_emit+0x320/0x3e0 [ 5.878122][ T75] vprintk_emit+0x37c/0x3e0 [ 5.878128][ T75] ? wake_up_klogd_work_func+0x90/0x90 [ 5.878133][ T75] ? _copy_from_iter+0x1bb/0x1810 [ 5.878142][ T75] devkmsg_emit.constprop.0+0xbc/0xf1 [ 5.878148][ T75] ? vprintk_emit.cold+0x107/0x107 [ 5.878150][ T75] ? simple_strntoull+0x10f/0x140 [ 5.878157][ T75] ? date_str+0x1e0/0x1e0 [ 5.878162][ T75] ? devkmsg_write+0xd1/0x2c0 [ 5.878170][ T75] devkmsg_write.cold+0x5a/0x8b [ 5.878174][ T75] ? vprintk_default+0x20/0x20 [ 5.878182][ T75] ? vprintk_default+0x20/0x20 [ 5.878185][ T75] new_sync_write+0x33e/0x760 [ 5.878191][ T75] ? kasan_quarantine_put+0x42/0x2b0 [ 5.878197][ T75] ? new_sync_read+0x750/0x750 [ 5.878204][ T75] ? __lock_release.isra.0+0x69/0x1a0 [ 5.878213][ T75] ? __fget_files+0x1e3/0x460 [ 5.878219][ T75] vfs_write+0x6a2/0xbd0 [ 5.878225][ T75] ksys_write+0x116/0x250 [ 5.878230][ T75] ? __ia32_sys_read+0xc0/0xc0 [ 5.878234][ T75] ? fpregs_restore_userregs+0x14b/0x300 [ 5.878238][ T75] ? rcu_is_watching+0x16/0xd0 [ 5.878244][ T75] do_syscall_64+0xff/0x530 [ 5.878247][ T75] ? exc_page_fault+0xee/0x100 [ 5.878252][ T75] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5.878256][ T75] RIP: 0033:0x7fd5d29a4ed2 [ 5.878261][ T75] Code: 08 0f 85 51 ec ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 f3 0f 1e fa 55 48 89 e5 [ 5.878264][ T75] RSP: 002b:00007fd5d28ebc68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 [ 5.878268][ T75] RAX: ffffffffffffffda RBX: 000000000000002e RCX: 00007fd5d29a4ed2 [ 5.878270][ T75] RDX: 000000000000002e RSI: 00007fd5cc0012c0 RDI: 0000000000000003 [ 5.878271][ T75] RBP: 00007fd5d28ebc90 R08: 0000000000000000 R09: 0000000000000000 [ 5.878273][ T75] R10: 0000000000000000 R11: 0000000000000246 R12: 00007fd5d2a2f0a0 [ 5.878274][ T75] R13: 00007fd5d292d3e0 R14: 00007fd5cc0012c0 R15: 00007fd5d28ebda8 [ 5.878287][ T75] [ 5.913454][ C0] clocksource: Watchdog remote CPU 2 read timed out [ 5.913481][ C0] [ 5.913483][ C0] ======================================================== [ 5.913484][ C0] WARNING: possible irq lock inversion dependency detected [ 5.913486][ C0] 7.2.0-virtme #1 Tainted: G W [ 5.913488][ C0] -------------------------------------------------------- [ 5.913489][ C0] swapper/0/0 just changed the state of lock: [ 5.913490][ C0] ffffffffab489660 (console_owner){..-.}-{0:0}, at: console_trylock_spinning+0xa4/0x1e0 [ 5.913503][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 5.913504][ C0] (fs_reclaim){+.+.}-{0:0} [ 5.913505][ C0] [ 5.913505][ C0] [ 5.913505][ C0] and interrupts could create inverse lock ordering between them. [ 5.913505][ C0] [ 5.913506][ C0] [ 5.913506][ C0] other info that might help us debug this: [ 5.913507][ C0] Possible interrupt unsafe locking scenario: [ 5.913507][ C0] [ 5.913507][ C0] CPU0 CPU1 [ 5.913508][ C0] ---- ---- [ 5.913508][ C0] lock(fs_reclaim); [ 5.913509][ C0] local_irq_disable(); [ 5.913510][ C0] lock(console_owner); [ 5.913510][ C0] lock(fs_reclaim); [ 5.913511][ C0] [ 5.913512][ C0] lock(console_owner); [ 5.913512][ C0] [ 5.913512][ C0] *** DEADLOCK *** [ 5.913512][ C0] [ 5.913513][ C0] locks held by swapper/0/0: 2, last CPU#0: [ 5.913514][ C0] #0: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 5.913520][ C0] #1: ffffffffab5ce8b8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 5.913524][ C0] [ 5.913524][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 5.913529][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 5.913536][ C0] HARDIRQ-ON-W at: [ 5.913538][ C0] __lock_acquire+0x388/0xc20 [ 5.913541][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.913543][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.913546][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 5.913549][ C0] kthread_create_worker_on_node+0xea/0x210 [ 5.913552][ C0] workqueue_init+0x2a/0x680 [ 5.913555][ C0] kernel_init_freeable+0x2fe/0x630 [ 5.913558][ C0] kernel_init+0x21/0x150 [ 5.913562][ C0] ret_from_fork+0x474/0x6b0 [ 5.913565][ C0] ret_from_fork_asm+0x11/0x20 [ 5.913568][ C0] SOFTIRQ-ON-W at: [ 5.913569][ C0] __lock_acquire+0x388/0xc20 [ 5.913571][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.913572][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.913574][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 5.913575][ C0] kthread_create_worker_on_node+0xea/0x210 [ 5.913577][ C0] workqueue_init+0x2a/0x680 [ 5.913578][ C0] kernel_init_freeable+0x2fe/0x630 [ 5.913580][ C0] kernel_init+0x21/0x150 [ 5.913581][ C0] ret_from_fork+0x474/0x6b0 [ 5.913582][ C0] ret_from_fork_asm+0x11/0x20 [ 5.913584][ C0] INITIAL USE at: [ 5.913584][ C0] __lock_acquire+0x388/0xc20 [ 5.913586][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.913588][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.913589][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 5.913590][ C0] kthread_create_worker_on_node+0xea/0x210 [ 5.913592][ C0] workqueue_init+0x2a/0x680 [ 5.913593][ C0] kernel_init_freeable+0x2fe/0x630 [ 5.913595][ C0] kernel_init+0x21/0x150 [ 5.913596][ C0] ret_from_fork+0x474/0x6b0 [ 5.913597][ C0] ret_from_fork_asm+0x11/0x20 [ 5.913599][ C0] } [ 5.913599][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 5.913604][ C0] ... acquired at: [ 5.913605][ C0] __lock_acquire+0x518/0xc20 [ 5.913606][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.913608][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.913609][ C0] __kmalloc_noprof+0xd3/0x760 [ 5.913611][ C0] alloc_buf.isra.0+0x4b/0x260 [ 5.913614][ C0] put_chars+0x1e1/0x2f0 [ 5.913615][ C0] hvc_console_print+0x292/0x780 [ 5.913617][ C0] console_emit_next_record+0x22f/0x4c0 [ 5.913619][ C0] console_flush_one_record+0x46f/0x710 [ 5.913620][ C0] console_unlock+0xee/0x1f0 [ 5.913621][ C0] vprintk_emit+0x37c/0x3e0 [ 5.913622][ C0] _printk+0xc7/0x100 [ 5.913624][ C0] dm_interface_init+0x50/0x60 [ 5.913627][ C0] dm_init+0x51/0xd0 [ 5.913628][ C0] do_one_initcall+0x124/0x4f0 [ 5.913630][ C0] kernel_init_freeable+0x596/0x630 [ 5.913631][ C0] kernel_init+0x21/0x150 [ 5.913633][ C0] ret_from_fork+0x474/0x6b0 [ 5.913634][ C0] ret_from_fork_asm+0x11/0x20 [ 5.913635][ C0] [ 5.913636][ C0] -> (console_owner){..-.}-{0:0} { [ 5.913638][ C0] IN-SOFTIRQ-W at: [ 5.913638][ C0] __lock_acquire+0x388/0xc20 [ 5.913640][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.913641][ C0] console_trylock_spinning+0xb5/0x1e0 [ 5.913643][ C0] vprintk_emit+0x320/0x3e0 [ 5.913644][ C0] _printk+0xc7/0x100 [ 5.913646][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 5.913647][ C0] call_timer_fn+0x160/0x4d0 [ 5.913648][ C0] __run_timers+0x68f/0xaa0 [ 5.913650][ C0] run_timer_softirq+0xf0/0x160 [ 5.913651][ C0] handle_softirqs+0x1d3/0x900 [ 5.913653][ C0] __irq_exit_rcu+0x145/0x1c0 [ 5.913655][ C0] irq_exit_rcu+0xe/0x30 [ 5.913656][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 5.913659][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5.913660][ C0] pv_native_safe_halt+0xf/0x10 [ 5.913662][ C0] default_idle+0x9/0x10 [ 5.913663][ C0] default_idle_call+0x6e/0xb0 [ 5.913664][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 5.913667][ C0] do_idle+0xd8/0x190 [ 5.913668][ C0] cpu_startup_entry+0x53/0x70 [ 5.913669][ C0] rest_init+0x279/0x280 [ 5.913671][ C0] start_kernel+0x3af/0x3b0 [ 5.913672][ C0] x86_64_start_reservations+0x24/0x30 [ 5.913674][ C0] x86_64_start_kernel+0x12b/0x130 [ 5.913675][ C0] common_startup_64+0x13e/0x148 [ 5.913677][ C0] INITIAL USE at: [ 5.913678][ C0] } [ 5.913679][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 5.913682][ C0] ... acquired at: [ 5.913682][ C0] mark_lock+0x1d7/0xa00 [ 5.913684][ C0] mark_usage+0x42/0x170 [ 5.913685][ C0] __lock_acquire+0x388/0xc20 [ 5.913687][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.913688][ C0] console_trylock_spinning+0xb5/0x1e0 [ 5.913690][ C0] vprintk_emit+0x320/0x3e0 [ 5.913691][ C0] _printk+0xc7/0x100 [ 5.913693][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 5.913694][ C0] call_timer_fn+0x160/0x4d0 [ 5.913695][ C0] __run_timers+0x68f/0xaa0 [ 5.913696][ C0] run_timer_softirq+0xf0/0x160 [ 5.913697][ C0] handle_softirqs+0x1d3/0x900 [ 5.913698][ C0] __irq_exit_rcu+0x145/0x1c0 [ 5.913699][ C0] irq_exit_rcu+0xe/0x30 [ 5.913701][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 5.913702][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5.913703][ C0] pv_native_safe_halt+0xf/0x10 [ 5.913704][ C0] default_idle+0x9/0x10 [ 5.913705][ C0] default_idle_call+0x6e/0xb0 [ 5.913707][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 5.913708][ C0] do_idle+0xd8/0x190 [ 5.913709][ C0] cpu_startup_entry+0x53/0x70 [ 5.913711][ C0] rest_init+0x279/0x280 [ 5.913712][ C0] start_kernel+0x3af/0x3b0 [ 5.913713][ C0] x86_64_start_reservations+0x24/0x30 [ 5.913714][ C0] x86_64_start_kernel+0x12b/0x130 [ 5.913715][ C0] common_startup_64+0x13e/0x148 [ 5.913717][ C0] [ 5.913717][ C0] [ 5.913717][ C0] stack backtrace: [ 5.913720][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 5.913723][ C0] Tainted: [W]=WARN [ 5.913724][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 5.913726][ C0] Call Trace: [ 5.913727][ C0] [ 5.913728][ C0] dump_stack_lvl+0x6f/0xa0 [ 5.913732][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 5.913735][ C0] mark_lock_irq+0x989/0x9c0 [ 5.913736][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 5.913740][ C0] mark_lock+0x1d7/0xa00 [ 5.913742][ C0] mark_usage+0x42/0x170 [ 5.913743][ C0] __lock_acquire+0x388/0xc20 [ 5.913746][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.913748][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 5.913750][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.913752][ C0] ? lock_acquire+0x13c/0x160 [ 5.913755][ C0] console_trylock_spinning+0xb5/0x1e0 [ 5.913757][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 5.913759][ C0] vprintk_emit+0x320/0x3e0 [ 5.913760][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 5.913762][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 5.913764][ C0] _printk+0xc7/0x100 [ 5.913766][ C0] ? snapshot_read.cold+0x21/0x21 [ 5.913768][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 5.913770][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 5.913772][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 5.913774][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 5.913776][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 5.913778][ C0] call_timer_fn+0x160/0x4d0 [ 5.913779][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 5.913781][ C0] ? debug_object_active_state+0x430/0x430 [ 5.913783][ C0] ? find_held_lock+0x2b/0x80 [ 5.913785][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 5.913787][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.913789][ C0] __run_timers+0x68f/0xaa0 [ 5.913790][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 5.913793][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 5.913794][ C0] ? __lock_acquire+0x518/0xc20 [ 5.913797][ C0] ? __rwlock_init+0x150/0x150 [ 5.913800][ C0] run_timer_softirq+0xf0/0x160 [ 5.913801][ C0] ? __run_timers+0xaa0/0xaa0 [ 5.913803][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 5.913805][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.913807][ C0] handle_softirqs+0x1d3/0x900 [ 5.913809][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 5.913811][ C0] ? _local_bh_enable+0xc0/0xc0 [ 5.913813][ C0] __irq_exit_rcu+0x145/0x1c0 [ 5.913815][ C0] irq_exit_rcu+0xe/0x30 [ 5.913816][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 5.913818][ C0] [ 5.913818][ C0] [ 5.913819][ C0] ? lockdep_hardirqs_on_prepare.part.0+0x9a/0x160 [ 5.913821][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5.913823][ C0] RIP: 0010:pv_native_safe_halt+0xf/0x10 [ 5.913825][ C0] Code: 48 8b 3d 94 e2 f8 01 e8 1f 00 00 00 48 2b 05 58 e3 99 00 c3 0f 1f 80 00 00 00 00 f3 0f 1e fa eb 07 0f 00 2d 13 d6 16 00 fb f4 0f 1f 40 d6 48 83 ec 20 8b 17 49 89 f8 83 e2 fe 41 89 d2 0f 01 [ 5.913827][ C0] RSP: 0018:ffffffffab207cf8 EFLAGS: 00000296 [ 5.913829][ C0] RAX: 000000000002bd53 RBX: ffffffffab21c600 RCX: ffffffffa82ed307 [ 5.913830][ C0] RDX: ffffffffab21c600 RSI: ffffffffab029fb9 RDI: ffffffffaaa8d8e0 [ 5.913831][ C0] RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000 [ 5.913832][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: 1ffffffff5640fa2 [ 5.913833][ C0] R13: 0000000000000000 R14: dffffc0000000000 R15: 0000000000014770 [ 5.913834][ C0] ? cpuidle_idle_call.constprop.0+0x237/0x410 [ 5.913837][ C0] ? lockdep_hardirqs_on+0x91/0x130 [ 5.913838][ C0] default_idle+0x9/0x10 [ 5.913839][ C0] default_idle_call+0x6e/0xb0 [ 5.913841][ C0] cpuidle_idle_call.constprop.0+0x237/0x410 [ 5.913843][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 5.913845][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 5.913847][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.913849][ C0] do_idle+0xd8/0x190 [ 5.913851][ C0] cpu_startup_entry+0x53/0x70 [ 5.913852][ C0] rest_init+0x279/0x280 [ 5.913854][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 5.913857][ C0] ? rest_init+0x280/0x280 [ 5.913858][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 5.913861][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 5.913863][ C0] ? acpi_enable+0x1e4/0x330 [ 5.913865][ C0] start_kernel+0x3af/0x3b0 [ 5.913867][ C0] x86_64_start_reservations+0x24/0x30 [ 5.913869][ C0] x86_64_start_kernel+0x12b/0x130 [ 5.913870][ C0] common_startup_64+0x13e/0x148 [ 5.913873][ C0] [ 6.366087][ T75] virtme-ng-init: udev is done [ 6.368540][ T1] virtme-ng-init: initialization done