virtme: waiting for virtiofsd to start virtme: use 'microvm' QEMU architecture [ 1.117625][ T1] loop: module loaded [ 1.117657][ T1] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 1.117660][ T1] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 [ 1.117662][ T1] preempt_count: 1, expected: 0 [ 1.117663][ T1] RCU nest depth: 0, expected: 0 [ 1.117665][ T1] locks held by swapper/0/1: 4, last CPU#0: [ 1.117667][ T1] #0: ffffffffa6369cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 1.117683][ T1] #1: ffffffffa6369d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 1.117690][ T1] #2: ffffffffa6289660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 1.117696][ T1] #3: ffffffffa6289560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 1.117702][ T1] irq event stamp: 293166 [ 1.117704][ T1] hardirqs last enabled at (293165): [] __down_trylock_console_sem+0x86/0xa0 [ 1.117707][ T1] hardirqs last disabled at (293166): [] console_emit_next_record+0x3d4/0x4c0 [ 1.117710][ T1] softirqs last enabled at (293112): [] bdi_register_va+0x491/0x780 [ 1.117715][ T1] softirqs last disabled at (293110): [] bdi_register_va+0x2ef/0x780 [ 1.117719][ T1] Preemption disabled at: [ 1.117719][ T1] [] vprintk_emit+0x31b/0x3e0 [ 1.117726][ T1] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 7.2.0-virtme #1 PREEMPT(full) [ 1.117730][ T1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 1.117733][ T1] Call Trace: [ 1.117735][ T1] [ 1.117739][ T1] dump_stack_lvl+0x6f/0xa0 [ 1.117746][ T1] ? vprintk_emit+0x31b/0x3e0 [ 1.117750][ T1] __might_resched.cold+0x1fe/0x2c1 [ 1.117756][ T1] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 1.117761][ T1] ? __kmalloc_noprof+0xdb/0x760 [ 1.117768][ T1] __kmalloc_noprof+0x443/0x760 [ 1.117772][ T1] ? alloc_buf.isra.0+0x4b/0x260 [ 1.117780][ T1] ? do_raw_spin_unlock+0x59/0x250 [ 1.117784][ T1] alloc_buf.isra.0+0x4b/0x260 [ 1.117788][ T1] put_chars+0x1e1/0x2f0 [ 1.117791][ T1] ? desc_read_finalized_seq+0x79/0x120 [ 1.117794][ T1] ? __send_to_port+0x420/0x420 [ 1.117799][ T1] ? rcu_read_lock_any_held+0x3c/0x90 [ 1.117804][ T1] ? validate_chain+0x38b/0xc20 [ 1.117811][ T1] hvc_console_print+0x292/0x780 [ 1.117815][ T1] ? __lock_acquire+0x518/0xc20 [ 1.117817][ T1] ? __lock_acquire+0x518/0xc20 [ 1.117826][ T1] ? hvc_write+0x3a0/0x3a0 [ 1.117828][ T1] ? console_emit_next_record+0x1df/0x4c0 [ 1.117833][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.117837][ T1] ? lock_acquire+0x13c/0x160 [ 1.117844][ T1] console_emit_next_record+0x22f/0x4c0 [ 1.117850][ T1] ? devkmsg_read+0x4b0/0x4b0 [ 1.117853][ T1] ? console_flush_one_record+0x106/0x710 [ 1.117858][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.117862][ T1] ? lock_acquire+0x13c/0x160 [ 1.117868][ T1] console_flush_one_record+0x46f/0x710 [ 1.117875][ T1] ? console_emit_next_record+0x4c0/0x4c0 [ 1.117878][ T1] ? __lock_acquire+0x518/0xc20 [ 1.117887][ T1] console_unlock+0xee/0x1f0 [ 1.117892][ T1] ? console_flush_one_record+0x710/0x710 [ 1.117894][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.117898][ T1] ? lock_acquire+0x60/0x160 [ 1.117904][ T1] ? __down_trylock_console_sem+0x5e/0xa0 [ 1.117907][ T1] ? vprintk_emit+0x320/0x3e0 [ 1.117912][ T1] vprintk_emit+0x37c/0x3e0 [ 1.117918][ T1] ? wake_up_klogd_work_func+0x90/0x90 [ 1.117927][ T1] ? max_loop_setup+0x30/0x30 [ 1.117933][ T1] _printk+0xc7/0x100 [ 1.117937][ T1] ? snapshot_read.cold+0x21/0x21 [ 1.117949][ T1] ? __mutex_unlock_slowpath+0x14d/0x740 [ 1.117955][ T1] loop_init+0x12a/0x130 [ 1.117959][ T1] do_one_initcall+0x124/0x4f0 [ 1.117963][ T1] ? trace_event_raw_event_initcall_level+0x280/0x280 [ 1.117966][ T1] ? parameq+0x110/0x110 [ 1.117974][ T1] ? kernel_init_freeable+0x3f1/0x630 [ 1.117979][ T1] ? rcu_is_watching+0x16/0xd0 [ 1.117985][ T1] kernel_init_freeable+0x596/0x630 [ 1.117990][ T1] ? rest_init+0x280/0x280 [ 1.117995][ T1] kernel_init+0x21/0x150 [ 1.117999][ T1] ? rest_init+0x280/0x280 [ 1.118001][ T1] ret_from_fork+0x474/0x6b0 [ 1.118007][ T1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 1.118012][ T1] ? __switch_to+0x5a3/0xe00 [ 1.118017][ T1] ? rest_init+0x280/0x280 [ 1.118021][ T1] ret_from_fork_asm+0x11/0x20 [ 1.118034][ T1] [ 1.158972][ T1] i8042: PNP: No PS/2 controller found. [ 1.173550][ T1] rtc_cmos PNP0B00:00: registered as rtc0 [ 1.174136][ T1] rtc_cmos PNP0B00:00: setting system clock to 2026-08-28T06:50:59 UTC (1787899859) [ 1.175648][ T1] rtc_cmos PNP0B00:00: alarms up to one day, 242 bytes nvram [ 1.180135][ T1] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev [ 1.191485][ T1] NET: Registered PF_INET6 protocol family [ 1.198781][ T1] Segment Routing with IPv6 [ 1.199732][ T1] In-situ OAM (IOAM) with IPv6 [ 1.200330][ T1] NET: Registered PF_PACKET protocol family [ 1.200743][ T1] 9pnet: Installing 9P2000 support [ 1.201334][ T1] Key type dns_resolver registered [ 1.202558][ T1] NET: Registered PF_VSOCK protocol family [ 1.208285][ T1] IPI shorthand broadcast: enabled [ 1.341052][ T1] sched_clock: Marking stable (1303001778, 37250269)->(1442928209, -102676162) [ 1.344869][ T1] registered taskstats version 1 [ 1.348070][ T1] Loading compiled-in X.509 certificates [ 1.410080][ T69] kwatchdog (69) used greatest stack depth: 29688 bytes left [ 1.518855][ T1] Demotion targets for Node 0: null [ 1.519318][ T1] kmemleak: Kernel memory leak detector initialized (mem pool available: 12235) [ 1.519766][ T1] page_owner is disabled [ 1.520720][ T1] PM: Magic number: 6:539:823 [ 1.521380][ T1] netconsole: network logging started [ 1.523700][ T1] ALSA device list: [ 1.523922][ T1] No soundcards found. [ 1.525846][ T1] md: Skipping autodetection of RAID arrays. (raid=autodetect will force) [ 1.530248][ T1] VFS: Mounted root (virtiofs filesystem) readonly on device 0:24. [ 1.531438][ T1] devtmpfs: mounted [ 1.531829][ T1] VFS: Pivoted into new rootfs [ 1.582112][ T1] Freeing unused kernel image (initmem) memory: 2544K [ 1.582481][ T1] Write protecting the kernel read-only data: 55296k [ 1.583316][ T1] Freeing unused kernel image (text/rodata gap) memory: 328K [ 1.583978][ T1] Freeing unused kernel image (rodata/data gap) memory: 556K [ 1.584431][ T1] Run /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init as init process [ 1.584844][ T1] with arguments: [ 1.585040][ T1] /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init [ 1.585420][ T1] with environment: [ 1.585609][ T1] HOME=/ [ 1.585813][ T1] TERM=dumb [ 1.585993][ T1] virtme_hostname=vmksft-forwarding-dbg,debug-threads=on [ 1.586364][ T1] nr_open=2147483584 [ 1.586553][ T1] virtme_link_mods=/srv/vmksft/testing/wt-4/.virtme_mods/lib/modules/0.0.0 [ 1.586970][ T1] virtme_rw_overlay0=/etc [ 1.587215][ T1] virtme_rw_overlay1=/lib [ 1.587475][ T1] virtme_rw_overlay2=/home [ 1.587720][ T1] virtme_rw_overlay3=/opt [ 1.587958][ T1] virtme_rw_overlay4=/srv [ 1.588204][ T1] virtme_rw_overlay5=/usr [ 1.588454][ T1] virtme_rw_overlay6=/var [ 1.588701][ T1] virtme_rw_overlay7=/tmp [ 1.588947][ T1] virtme_console=ttyS0 [ 1.589186][ T1] virtme_chdir=srv/vmksft/testing/wt-4 [ 1.614438][ T1] virtme-ng-init: mount devtmpfs -> /dev: EBUSY: Device or resource busy [ 1.616485][ T1] virtme-ng-init: Setting hostname to vmksft-forwarding-dbg,debug-threads=on... [ 1.633659][ T1] overlayfs: failed to set xattr on upper [ 1.634065][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.634579][ T1] overlayfs: ...falling back to uuid=null. [ 1.638179][ T1] overlayfs: failed to set xattr on upper [ 1.638662][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.639047][ T1] overlayfs: ...falling back to uuid=null. [ 1.642112][ T1] overlayfs: failed to set xattr on upper [ 1.642461][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.642845][ T1] overlayfs: ...falling back to uuid=null. [ 1.645815][ T1] overlayfs: failed to set xattr on upper [ 1.646144][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.646972][ T1] overlayfs: ...falling back to uuid=null. [ 1.649953][ T1] overlayfs: failed to set xattr on upper [ 1.650964][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.651387][ T1] overlayfs: ...falling back to uuid=null. [ 1.654012][ T1] overlayfs: failed to set xattr on upper [ 1.654363][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.654743][ T1] overlayfs: ...falling back to uuid=null. [ 1.657741][ T1] overlayfs: failed to set xattr on upper [ 1.658069][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.659476][ T1] overlayfs: ...falling back to uuid=null. [ 1.662983][ T1] overlayfs: failed to set xattr on upper [ 1.663311][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.663697][ T1] overlayfs: ...falling back to uuid=null. [ 1.681461][ T1] virtme-ng-init: running systemd-tmpfiles [ 4.048453][ T71] systemd-tmpfile (71) used greatest stack depth: 25104 bytes left [ 4.048473][ T71] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 4.048475][ T71] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 71, name: systemd-tmpfile [ 4.048477][ T71] preempt_count: 2, expected: 0 [ 4.048478][ T71] RCU nest depth: 0, expected: 0 [ 4.048479][ T71] locks held by systemd-tmpfile/71: 5, last CPU#0: [ 4.048481][ T71] #0: ffffffffa62027b8 (low_water_lock){+.+.}-{3:3}, at: do_exit+0x887/0xdc0 [ 4.048494][ T71] #1: ffffffffa6369cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 4.048500][ T71] #2: ffffffffa6369d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 4.048504][ T71] #3: ffffffffa6289660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 4.048508][ T71] #4: ffffffffa6289560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 4.048511][ T71] irq event stamp: 2432034 [ 4.048512][ T71] hardirqs last enabled at (2432033): [] __down_trylock_console_sem+0x86/0xa0 [ 4.048515][ T71] hardirqs last disabled at (2432034): [] console_emit_next_record+0x3d4/0x4c0 [ 4.048517][ T71] softirqs last enabled at (2429736): [] handle_softirqs+0x67c/0x900 [ 4.048519][ T71] softirqs last disabled at (2428819): [] __irq_exit_rcu+0x145/0x1c0 [ 4.048521][ T71] Preemption disabled at: [ 4.048521][ T71] [<0000000000000000>] 0x0 [ 4.048528][ T71] CPU: 0 UID: 0 PID: 71 Comm: systemd-tmpfile Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 4.048532][ T71] Tainted: [W]=WARN [ 4.048533][ T71] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 4.048535][ T71] Call Trace: [ 4.048536][ T71] [ 4.048538][ T71] dump_stack_lvl+0x6f/0xa0 [ 4.048545][ T71] __might_resched.cold+0x1fe/0x2c1 [ 4.048549][ T71] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 4.048553][ T71] ? __kmalloc_noprof+0xdb/0x760 [ 4.048558][ T71] __kmalloc_noprof+0x443/0x760 [ 4.048561][ T71] ? alloc_buf.isra.0+0x4b/0x260 [ 4.048567][ T71] ? do_raw_spin_unlock+0x59/0x250 [ 4.048570][ T71] alloc_buf.isra.0+0x4b/0x260 [ 4.048573][ T71] put_chars+0x1e1/0x2f0 [ 4.048575][ T71] ? __send_to_port+0x420/0x420 [ 4.048577][ T71] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 4.048581][ T71] ? validate_chain+0x38b/0xc20 [ 4.048586][ T71] hvc_console_print+0x292/0x780 [ 4.048593][ T71] ? hvc_write+0x3a0/0x3a0 [ 4.048595][ T71] ? rcu_is_watching+0x16/0xd0 [ 4.048597][ T71] ? lock_acquire+0x13c/0x160 [ 4.048601][ T71] console_emit_next_record+0x22f/0x4c0 [ 4.048604][ T71] ? devkmsg_read+0x4b0/0x4b0 [ 4.048606][ T71] ? console_flush_one_record+0x106/0x710 [ 4.048609][ T71] ? rcu_is_watching+0x16/0xd0 [ 4.048612][ T71] ? lock_acquire+0x13c/0x160 [ 4.048615][ T71] console_flush_one_record+0x46f/0x710 [ 4.048620][ T71] ? console_emit_next_record+0x4c0/0x4c0 [ 4.048621][ T71] ? __lock_acquire+0x518/0xc20 [ 4.048626][ T71] console_unlock+0xee/0x1f0 [ 4.048629][ T71] ? console_flush_one_record+0x710/0x710 [ 4.048631][ T71] ? rcu_is_watching+0x16/0xd0 [ 4.048633][ T71] ? lock_acquire+0x60/0x160 [ 4.048637][ T71] ? __down_trylock_console_sem+0x5e/0xa0 [ 4.048638][ T71] ? vprintk_emit+0x320/0x3e0 [ 4.048642][ T71] vprintk_emit+0x37c/0x3e0 [ 4.048645][ T71] ? wake_up_klogd_work_func+0x90/0x90 [ 4.048649][ T71] ? __lock_acquire+0x518/0xc20 [ 4.048652][ T71] _printk+0xc7/0x100 [ 4.048656][ T71] ? snapshot_read.cold+0x21/0x21 [ 4.048659][ T71] ? do_raw_spin_lock+0x131/0x280 [ 4.048661][ T71] ? __rwlock_init+0x150/0x150 [ 4.048665][ T71] ? do_raw_spin_lock+0x131/0x280 [ 4.048667][ T71] do_exit.cold+0x82/0x9c [ 4.048671][ T71] ? exit_notify+0x890/0x890 [ 4.048673][ T71] ? __lock_release.isra.0+0x69/0x1a0 [ 4.048676][ T71] ? rcu_is_watching+0x16/0xd0 [ 4.048680][ T71] do_group_exit+0xb8/0x370 [ 4.048683][ T71] __x64_sys_exit_group+0x3c/0x50 [ 4.048684][ T71] x64_sys_call+0x1567/0x1570 [ 4.048687][ T71] do_syscall_64+0xff/0x530 [ 4.048690][ T71] ? exc_page_fault+0xee/0x100 [ 4.048693][ T71] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 4.048696][ T71] RIP: 0033:0x7fb42e49b1b8 [ 4.048698][ T71] Code: Unable to access opcode bytes at 0x7fb42e49b18e. [ 4.048699][ T71] RSP: 002b:00007ffebecfbf08 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7 [ 4.048702][ T71] RAX: ffffffffffffffda RBX: 00007fb42e5cbf88 RCX: 00007fb42e49b1b8 [ 4.048703][ T71] RDX: 00007fb42dcf94c8 RSI: fffffffffffffe90 RDI: 0000000000000049 [ 4.048704][ T71] RBP: 00007ffebecfbf60 R08: 0000000000000000 R09: 0000000000001000 [ 4.048705][ T71] R10: 00007ffebecfbd20 R11: 0000000000000246 R12: 0000000000000001 [ 4.048705][ T71] R13: 0000000000000049 R14: 00007fb42e5ca680 R15: 00007fb42e5cbfa0 [ 4.048712][ T71] [ 4.048803][ T1] virtme-ng-init: Failed to read '/usr/lib/tmpfiles.d/audit.conf': Permission denied [ 4.048803][ T1] Failed to create directory or subvolume "/var/spool/at/spool": Permission denied [ 4.048803][ T1] Failed to create file /var/spool/at/.SEQ: Permission denied [ 4.048803][ T1] Failed to opendir() '/proc/self/fd/6': Permission denied [ 4.079161][ T1] virtme-ng-init: basic initialization done [ 4.123872][ T78] ip (78) used greatest stack depth: 24432 bytes left [ 4.155736][ T74] virtme-ng-init: Starting systemd-udevd version 259.8-1.fc44 [ 4.156116][ T74] virtme-ng-init: triggering udev coldplug [ 6.361115][ T74] virtme-ng-init: waiting for udev to settle [ 6.361132][ T74] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 6.361136][ T74] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 74, name: virtme-ng-init [ 6.361138][ T74] preempt_count: 1, expected: 0 [ 6.361139][ T74] RCU nest depth: 0, expected: 0 [ 6.361141][ T74] locks held by virtme-ng-init/74: 4, last CPU#3: [ 6.361144][ T74] #0: ffffffffa6369cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 6.361160][ T74] #1: ffffffffa6369d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 6.361166][ T74] #2: ffffffffa6289660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 6.361172][ T74] #3: ffffffffa6289560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 6.361178][ T74] irq event stamp: 4028 [ 6.361179][ T74] hardirqs last enabled at (4027): [] __down_trylock_console_sem+0x86/0xa0 [ 6.361183][ T74] hardirqs last disabled at (4028): [] console_emit_next_record+0x3d4/0x4c0 [ 6.361186][ T74] softirqs last enabled at (3866): [] handle_softirqs+0x67c/0x900 [ 6.361190][ T74] softirqs last disabled at (2885): [] __irq_exit_rcu+0x145/0x1c0 [ 6.361193][ T74] Preemption disabled at: [ 6.361194][ T74] [] vprintk_emit+0x31b/0x3e0 [ 6.361202][ T74] CPU: 3 UID: 0 PID: 74 Comm: virtme-ng-init Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 6.361206][ T74] Tainted: [W]=WARN [ 6.361208][ T74] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 6.361210][ T74] Call Trace: [ 6.361212][ T74] [ 6.361214][ T74] dump_stack_lvl+0x6f/0xa0 [ 6.361221][ T74] ? vprintk_emit+0x31b/0x3e0 [ 6.361225][ T74] __might_resched.cold+0x1fe/0x2c1 [ 6.361231][ T74] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 6.361236][ T74] ? __kmalloc_noprof+0xdb/0x760 [ 6.361244][ T74] __kmalloc_noprof+0x443/0x760 [ 6.361247][ T74] ? alloc_buf.isra.0+0x4b/0x260 [ 6.361258][ T74] ? do_raw_spin_unlock+0x59/0x250 [ 6.361262][ T74] alloc_buf.isra.0+0x4b/0x260 [ 6.361267][ T74] put_chars+0x1e1/0x2f0 [ 6.361271][ T74] ? __send_to_port+0x420/0x420 [ 6.361273][ T74] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 6.361279][ T74] ? validate_chain+0x38b/0xc20 [ 6.361298][ T74] hvc_console_print+0x292/0x780 [ 6.361308][ T74] ? hvc_write+0x3a0/0x3a0 [ 6.361312][ T74] ? rcu_is_watching+0x16/0xd0 [ 6.361316][ T74] ? lock_acquire+0x13c/0x160 [ 6.361322][ T74] console_emit_next_record+0x22f/0x4c0 [ 6.361329][ T74] ? devkmsg_read+0x4b0/0x4b0 [ 6.361331][ T74] ? console_flush_one_record+0x106/0x710 [ 6.361336][ T74] ? rcu_is_watching+0x16/0xd0 [ 6.361340][ T74] ? lock_acquire+0x13c/0x160 [ 6.361346][ T74] console_flush_one_record+0x46f/0x710 [ 6.361353][ T74] ? console_emit_next_record+0x4c0/0x4c0 [ 6.361356][ T74] ? __lock_acquire+0x518/0xc20 [ 6.361365][ T74] console_unlock+0xee/0x1f0 [ 6.361369][ T74] ? console_flush_one_record+0x710/0x710 [ 6.361372][ T74] ? rcu_is_watching+0x16/0xd0 [ 6.361375][ T74] ? lock_acquire+0x60/0x160 [ 6.361381][ T74] ? __down_trylock_console_sem+0x5e/0xa0 [ 6.361384][ T74] ? vprintk_emit+0x320/0x3e0 [ 6.361389][ T74] vprintk_emit+0x37c/0x3e0 [ 6.361395][ T74] ? wake_up_klogd_work_func+0x90/0x90 [ 6.361400][ T74] ? _copy_from_iter+0x1bb/0x1810 [ 6.361409][ T74] devkmsg_emit.constprop.0+0xbc/0xf1 [ 6.361414][ T74] ? vprintk_emit.cold+0x107/0x107 [ 6.361417][ T74] ? simple_strntoull+0x10f/0x140 [ 6.361423][ T74] ? date_str+0x1e0/0x1e0 [ 6.361428][ T74] ? devkmsg_write+0xd1/0x2c0 [ 6.361435][ T74] devkmsg_write.cold+0x5a/0x8b [ 6.361439][ T74] ? vprintk_default+0x20/0x20 [ 6.361447][ T74] ? vprintk_default+0x20/0x20 [ 6.361451][ T74] new_sync_write+0x33e/0x760 [ 6.361456][ T74] ? kasan_quarantine_put+0x42/0x2b0 [ 6.361461][ T74] ? new_sync_read+0x750/0x750 [ 6.361468][ T74] ? __lock_release.isra.0+0x69/0x1a0 [ 6.361476][ T74] ? __fget_files+0x1e3/0x460 [ 6.361482][ T74] vfs_write+0x6a2/0xbd0 [ 6.361493][ T74] ksys_write+0x116/0x250 [ 6.361498][ T74] ? __ia32_sys_read+0xc0/0xc0 [ 6.361503][ T74] ? rcu_is_watching+0x16/0xd0 [ 6.361509][ T74] do_syscall_64+0xff/0x530 [ 6.361512][ T74] ? exc_page_fault+0xee/0x100 [ 6.361516][ T74] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 6.361520][ T74] RIP: 0033:0x7f156eba1ed2 [ 6.361525][ T74] Code: 08 0f 85 51 ec ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 f3 0f 1e fa 55 48 89 e5 [ 6.361528][ T74] RSP: 002b:00007f156eae8c68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 [ 6.361531][ T74] RAX: ffffffffffffffda RBX: 000000000000002e RCX: 00007f156eba1ed2 [ 6.361533][ T74] RDX: 000000000000002e RSI: 00007f15680012c0 RDI: 0000000000000003 [ 6.361535][ T74] RBP: 00007f156eae8c90 R08: 0000000000000000 R09: 0000000000000000 [ 6.361536][ T74] R10: 0000000000000000 R11: 0000000000000246 R12: 00007f156ec2c0a0 [ 6.361538][ T74] R13: 00007f156eb2a3e0 R14: 00007f15680012c0 R15: 00007f156eae8da8 [ 6.361550][ T74] [ 6.409394][ C0] clocksource: Watchdog remote CPU 3 read timed out [ 6.409417][ C0] [ 6.409419][ C0] ======================================================== [ 6.409420][ C0] WARNING: possible irq lock inversion dependency detected [ 6.409422][ C0] 7.2.0-virtme #1 Tainted: G W [ 6.409424][ C0] -------------------------------------------------------- [ 6.409424][ C0] (udev-worker)/82 just changed the state of lock: [ 6.409425][ C0] ffffffffa6289660 (console_owner){..-.}-{0:0}, at: console_trylock_spinning+0xa4/0x1e0 [ 6.409439][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 6.409440][ C0] (fs_reclaim){+.+.}-{0:0} [ 6.409441][ C0] [ 6.409441][ C0] [ 6.409441][ C0] and interrupts could create inverse lock ordering between them. [ 6.409441][ C0] [ 6.409442][ C0] [ 6.409442][ C0] other info that might help us debug this: [ 6.409443][ C0] Possible interrupt unsafe locking scenario: [ 6.409443][ C0] [ 6.409443][ C0] CPU0 CPU1 [ 6.409444][ C0] ---- ---- [ 6.409444][ C0] lock(fs_reclaim); [ 6.409445][ C0] local_irq_disable(); [ 6.409445][ C0] lock(console_owner); [ 6.409446][ C0] lock(fs_reclaim); [ 6.409447][ C0] [ 6.409448][ C0] lock(console_owner); [ 6.409451][ C0] [ 6.409451][ C0] *** DEADLOCK *** [ 6.409451][ C0] [ 6.409451][ C0] locks held by (udev-worker)/82: 3, last CPU#0: [ 6.409453][ C0] #0: ff11000009dcb5a0 (&p->lock){+.+.}-{4:4}, at: seq_read_iter+0xc6/0x1250 [ 6.409459][ C0] #1: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 6.409464][ C0] #2: ffffffffa63ce8b8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 6.409468][ C0] [ 6.409468][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 6.409472][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 6.409474][ C0] HARDIRQ-ON-W at: [ 6.409476][ C0] __lock_acquire+0x388/0xc20 [ 6.409479][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.409480][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.409483][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.409487][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.409491][ C0] workqueue_init+0x2a/0x680 [ 6.409495][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.409498][ C0] kernel_init+0x21/0x150 [ 6.409503][ C0] ret_from_fork+0x474/0x6b0 [ 6.409506][ C0] ret_from_fork_asm+0x11/0x20 [ 6.409508][ C0] SOFTIRQ-ON-W at: [ 6.409509][ C0] __lock_acquire+0x388/0xc20 [ 6.409511][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.409512][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.409513][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.409515][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.409516][ C0] workqueue_init+0x2a/0x680 [ 6.409517][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.409518][ C0] kernel_init+0x21/0x150 [ 6.409520][ C0] ret_from_fork+0x474/0x6b0 [ 6.409521][ C0] ret_from_fork_asm+0x11/0x20 [ 6.409522][ C0] INITIAL USE at: [ 6.409523][ C0] __lock_acquire+0x388/0xc20 [ 6.409524][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.409525][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.409527][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 6.409528][ C0] kthread_create_worker_on_node+0xea/0x210 [ 6.409529][ C0] workqueue_init+0x2a/0x680 [ 6.409530][ C0] kernel_init_freeable+0x2fe/0x630 [ 6.409531][ C0] kernel_init+0x21/0x150 [ 6.409533][ C0] ret_from_fork+0x474/0x6b0 [ 6.409534][ C0] ret_from_fork_asm+0x11/0x20 [ 6.409535][ C0] } [ 6.409536][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 6.409540][ C0] ... acquired at: [ 6.409541][ C0] __lock_acquire+0x518/0xc20 [ 6.409542][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.409544][ C0] fs_reclaim_acquire+0xd5/0x120 [ 6.409545][ C0] __kmalloc_noprof+0xd3/0x760 [ 6.409546][ C0] alloc_buf.isra.0+0x4b/0x260 [ 6.409549][ C0] put_chars+0x1e1/0x2f0 [ 6.409550][ C0] hvc_console_print+0x292/0x780 [ 6.409552][ C0] console_emit_next_record+0x22f/0x4c0 [ 6.409554][ C0] console_flush_one_record+0x46f/0x710 [ 6.409555][ C0] console_unlock+0xee/0x1f0 [ 6.409557][ C0] vprintk_emit+0x37c/0x3e0 [ 6.409558][ C0] _printk+0xc7/0x100 [ 6.409562][ C0] loop_init+0x12a/0x130 [ 6.409565][ C0] do_one_initcall+0x124/0x4f0 [ 6.409566][ C0] kernel_init_freeable+0x596/0x630 [ 6.409567][ C0] kernel_init+0x21/0x150 [ 6.409568][ C0] ret_from_fork+0x474/0x6b0 [ 6.409569][ C0] ret_from_fork_asm+0x11/0x20 [ 6.409571][ C0] [ 6.409571][ C0] -> (console_owner){..-.}-{0:0} { [ 6.409573][ C0] IN-SOFTIRQ-W at: [ 6.409574][ C0] __lock_acquire+0x388/0xc20 [ 6.409575][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.409576][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.409578][ C0] vprintk_emit+0x320/0x3e0 [ 6.409579][ C0] _printk+0xc7/0x100 [ 6.409581][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.409583][ C0] call_timer_fn+0x160/0x4d0 [ 6.409585][ C0] __run_timers+0x68f/0xaa0 [ 6.409586][ C0] run_timer_softirq+0xf0/0x160 [ 6.409588][ C0] handle_softirqs+0x1d3/0x900 [ 6.409590][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.409591][ C0] irq_exit_rcu+0xe/0x30 [ 6.409593][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.409595][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.409597][ C0] kasan_report+0x11f/0x130 [ 6.409599][ C0] memchr_inv+0x1be/0x2d0 [ 6.409601][ C0] slab_pad_check.part.0+0xc3/0x140 [ 6.409602][ C0] check_slab+0x8a/0xa0 [ 6.409603][ C0] alloc_debug_processing+0x27/0x100 [ 6.409605][ C0] alloc_single_from_new_slab+0xb2/0x300 [ 6.409606][ C0] ___slab_alloc+0x181/0x2f0 [ 6.409607][ C0] __kvmalloc_node_noprof+0x461/0x8b0 [ 6.409609][ C0] seq_read_iter+0x6e3/0x1250 [ 6.409610][ C0] new_sync_read+0x280/0x750 [ 6.409613][ C0] vfs_read+0x3dd/0x7b0 [ 6.409614][ C0] ksys_read+0x116/0x250 [ 6.409616][ C0] do_syscall_64+0xff/0x530 [ 6.409617][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 6.409619][ C0] INITIAL USE at: [ 6.409620][ C0] } [ 6.409620][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 6.409623][ C0] ... acquired at: [ 6.409623][ C0] mark_lock+0x1d7/0xa00 [ 6.409625][ C0] mark_usage+0x42/0x170 [ 6.409626][ C0] __lock_acquire+0x388/0xc20 [ 6.409627][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.409628][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.409630][ C0] vprintk_emit+0x320/0x3e0 [ 6.409631][ C0] _printk+0xc7/0x100 [ 6.409633][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.409634][ C0] call_timer_fn+0x160/0x4d0 [ 6.409635][ C0] __run_timers+0x68f/0xaa0 [ 6.409637][ C0] run_timer_softirq+0xf0/0x160 [ 6.409638][ C0] handle_softirqs+0x1d3/0x900 [ 6.409639][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.409641][ C0] irq_exit_rcu+0xe/0x30 [ 6.409642][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.409643][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.409644][ C0] kasan_report+0x11f/0x130 [ 6.409646][ C0] memchr_inv+0x1be/0x2d0 [ 6.409647][ C0] slab_pad_check.part.0+0xc3/0x140 [ 6.409648][ C0] check_slab+0x8a/0xa0 [ 6.409649][ C0] alloc_debug_processing+0x27/0x100 [ 6.409650][ C0] alloc_single_from_new_slab+0xb2/0x300 [ 6.409651][ C0] ___slab_alloc+0x181/0x2f0 [ 6.409652][ C0] __kvmalloc_node_noprof+0x461/0x8b0 [ 6.409654][ C0] seq_read_iter+0x6e3/0x1250 [ 6.409655][ C0] new_sync_read+0x280/0x750 [ 6.409656][ C0] vfs_read+0x3dd/0x7b0 [ 6.409658][ C0] ksys_read+0x116/0x250 [ 6.409659][ C0] do_syscall_64+0xff/0x530 [ 6.409660][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 6.409661][ C0] [ 6.409662][ C0] [ 6.409662][ C0] stack backtrace: [ 6.409665][ C0] CPU: 0 UID: 0 PID: 82 Comm: (udev-worker) Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 6.409668][ C0] Tainted: [W]=WARN [ 6.409669][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 6.409670][ C0] Call Trace: [ 6.409671][ C0] [ 6.409673][ C0] dump_stack_lvl+0x6f/0xa0 [ 6.409677][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 6.409679][ C0] mark_lock_irq+0x989/0x9c0 [ 6.409681][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 6.409684][ C0] mark_lock+0x1d7/0xa00 [ 6.409686][ C0] mark_usage+0x42/0x170 [ 6.409687][ C0] __lock_acquire+0x388/0xc20 [ 6.409690][ C0] lock_acquire.part.0+0xd4/0x280 [ 6.409691][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 6.409693][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.409696][ C0] ? lock_acquire+0x13c/0x160 [ 6.409698][ C0] console_trylock_spinning+0xb5/0x1e0 [ 6.409700][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 6.409702][ C0] vprintk_emit+0x320/0x3e0 [ 6.409704][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 6.409706][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 6.409708][ C0] _printk+0xc7/0x100 [ 6.409710][ C0] ? snapshot_read.cold+0x21/0x21 [ 6.409712][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 6.409713][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.409716][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 6.409717][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.409719][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.409720][ C0] call_timer_fn+0x160/0x4d0 [ 6.409722][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 6.409724][ C0] ? debug_object_active_state+0x430/0x430 [ 6.409727][ C0] ? find_held_lock+0x2b/0x80 [ 6.409729][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.409731][ C0] ? mark_held_locks+0x40/0x70 [ 6.409733][ C0] __run_timers+0x68f/0xaa0 [ 6.409734][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 6.409737][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 6.409738][ C0] ? __lock_acquire+0x518/0xc20 [ 6.409741][ C0] ? __rwlock_init+0x150/0x150 [ 6.409744][ C0] run_timer_softirq+0xf0/0x160 [ 6.409746][ C0] ? __run_timers+0xaa0/0xaa0 [ 6.409747][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.409749][ C0] handle_softirqs+0x1d3/0x900 [ 6.409751][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 6.409753][ C0] ? _local_bh_enable+0xc0/0xc0 [ 6.409755][ C0] __irq_exit_rcu+0x145/0x1c0 [ 6.409756][ C0] irq_exit_rcu+0xe/0x30 [ 6.409757][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 6.409759][ C0] [ 6.409760][ C0] [ 6.409760][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 6.409762][ C0] RIP: 0010:kasan_report+0x11f/0x130 [ 6.409765][ C0] Code: 88 5c 24 28 e8 f2 fb ff ff 48 8d 7c 24 10 e8 38 55 0d ff 0f b6 d3 4c 89 ee 48 8d 7c 24 08 e8 e8 fc ff ff b8 01 00 00 00 55 9d <48> 83 c4 70 5b 5d 41 5c 41 5d 41 5e c3 0f 1f 40 00 0f 1f 40 d6 48 [ 6.409767][ C0] RSP: 0018:ffa00000005479c8 EFLAGS: 00000282 [ 6.409769][ C0] RAX: 0000000000000000 RBX: ff1100000b870000 RCX: ffffffffa553c01e [ 6.409771][ C0] RDX: 0000000000000000 RSI: 0000000000000008 RDI: 00000000ffffffff [ 6.409772][ C0] RBP: 0000000000000282 R08: 000000000000005a R09: ff1100000b870000 [ 6.409773][ C0] R10: dffffc0000000000 R11: fffffbfff4c02897 R12: ffd40000002e1a00 [ 6.409773][ C0] R13: ff1100000b86e858 R14: ff11000005c446c0 R15: ff1100000b86e000 [ 6.409775][ C0] ? memchr_inv+0x1be/0x2d0 [ 6.409778][ C0] memchr_inv+0x1be/0x2d0 [ 6.409780][ C0] slab_pad_check.part.0+0xc3/0x140 [ 6.409782][ C0] check_slab+0x8a/0xa0 [ 6.409783][ C0] ? build_slab_freelist+0x6d/0x260 [ 6.409784][ C0] alloc_debug_processing+0x27/0x100 [ 6.409786][ C0] alloc_single_from_new_slab+0xb2/0x300 [ 6.409788][ C0] ___slab_alloc+0x181/0x2f0 [ 6.409790][ C0] ? __pcs_replace_empty_main+0x42f/0x6a0 [ 6.409792][ C0] __kvmalloc_node_noprof+0x461/0x8b0 [ 6.409794][ C0] ? seq_read_iter+0x6e3/0x1250 [ 6.409796][ C0] seq_read_iter+0x6e3/0x1250 [ 6.409799][ C0] ? kernfs_file_read_iter+0x4c0/0x4c0 [ 6.409802][ C0] new_sync_read+0x280/0x750 [ 6.409804][ C0] ? generic_write_checks_count+0x480/0x480 [ 6.409806][ C0] ? kmem_cache_free+0xf8/0x550 [ 6.409808][ C0] ? vfs_fstat+0x46/0x90 [ 6.409811][ C0] vfs_read+0x3dd/0x7b0 [ 6.409813][ C0] ? fdget_pos+0x1a4/0x310 [ 6.409815][ C0] ksys_read+0x116/0x250 [ 6.409817][ C0] ? vfs_write+0xbd0/0xbd0 [ 6.409819][ C0] ? rcu_is_watching+0x16/0xd0 [ 6.409821][ C0] do_syscall_64+0xff/0x530 [ 6.409823][ C0] ? irq_exit_rcu+0x1a/0x30 [ 6.409824][ C0] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 6.409826][ C0] RIP: 0033:0x7f171d04354e [ 6.409828][ C0] Code: 4d 89 d8 e8 b4 bd 00 00 4c 8b 5d f8 41 8b 93 08 03 00 00 59 5e 48 83 f8 fc 74 11 c9 c3 0f 1f 80 00 00 00 00 48 8b 45 10 0f 05 c3 83 e2 39 83 fa 08 75 e7 e8 03 ff ff ff 0f 1f 00 f3 0f 1e fa [ 6.409829][ C0] RSP: 002b:00007ffd513d4ad0 EFLAGS: 00000202 ORIG_RAX: 0000000000000000 [ 6.409831][ C0] RAX: ffffffffffffffda RBX: 00005570940efe20 RCX: 00007f171d04354e [ 6.409832][ C0] RDX: 0000000000001008 RSI: 00005570940efe20 RDI: 0000000000000014 [ 6.409832][ C0] RBP: 00007ffd513d4ae0 R08: 0000000000000000 R09: 0000000000000000 [ 6.409833][ C0] R10: 0000000000000000 R11: 0000000000000202 R12: 0000000000000014 [ 6.409834][ C0] R13: 0000000000001008 R14: ffffffffffffffff R15: 0000000000000002 [ 6.409836][ C0] [ 6.780713][ T74] virtme-ng-init: udev is done [ 6.783015][ T1] virtme-ng-init: initialization done