virtme: waiting for virtiofsd to start virtme: use 'microvm' QEMU architecture [ 0.969935][ T1] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev [ 0.969956][ T1] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 0.969957][ T1] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 1, name: swapper/0 [ 0.969959][ T1] preempt_count: 1, expected: 0 [ 0.969960][ T1] RCU nest depth: 0, expected: 0 [ 0.969960][ T1] locks held by swapper/0/1: 4, last CPU#0: [ 0.969962][ T1] #0: ffffffffa6b79cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 0.969974][ T1] #1: ffffffffa6b79d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 0.969978][ T1] #2: ffffffffa6a99660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 0.969982][ T1] #3: ffffffffa6a99560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 0.969985][ T1] irq event stamp: 310462 [ 0.969986][ T1] hardirqs last enabled at (310461): [] __down_trylock_console_sem+0x86/0xa0 [ 0.969989][ T1] hardirqs last disabled at (310462): [] console_emit_next_record+0x3d4/0x4c0 [ 0.969991][ T1] softirqs last enabled at (309226): [] handle_softirqs+0x67c/0x900 [ 0.969994][ T1] softirqs last disabled at (309033): [] __irq_exit_rcu+0x145/0x1c0 [ 0.969996][ T1] Preemption disabled at: [ 0.969997][ T1] [] vprintk_emit+0x31b/0x3e0 [ 0.970002][ T1] CPU: 0 UID: 0 PID: 1 Comm: swapper/0 Not tainted 7.2.0-virtme #1 PREEMPT(full) [ 0.970004][ T1] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 0.970006][ T1] Call Trace: [ 0.970007][ T1] [ 0.970010][ T1] dump_stack_lvl+0x6f/0xa0 [ 0.970016][ T1] ? vprintk_emit+0x31b/0x3e0 [ 0.970019][ T1] __might_resched.cold+0x1fe/0x2c1 [ 0.970023][ T1] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 0.970027][ T1] ? __kmalloc_noprof+0xdb/0x760 [ 0.970032][ T1] __kmalloc_noprof+0x443/0x760 [ 0.970034][ T1] ? alloc_buf.isra.0+0x4b/0x260 [ 0.970041][ T1] ? do_raw_spin_unlock+0x59/0x250 [ 0.970043][ T1] alloc_buf.isra.0+0x4b/0x260 [ 0.970046][ T1] put_chars+0x1e1/0x2f0 [ 0.970048][ T1] ? prb_final_commit+0x50/0x50 [ 0.970050][ T1] ? __send_to_port+0x420/0x420 [ 0.970053][ T1] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 0.970058][ T1] ? rcu_read_lock_any_held+0x3c/0x90 [ 0.970060][ T1] ? validate_chain+0x38b/0xc20 [ 0.970064][ T1] hvc_console_print+0x292/0x780 [ 0.970067][ T1] ? mark_usage+0x61/0x170 [ 0.970069][ T1] ? __lock_acquire+0x518/0xc20 [ 0.970070][ T1] ? __lock_acquire+0x518/0xc20 [ 0.970074][ T1] ? hvc_write+0x3a0/0x3a0 [ 0.970076][ T1] ? console_emit_next_record+0x1df/0x4c0 [ 0.970079][ T1] ? rcu_is_watching+0x16/0xd0 [ 0.970082][ T1] ? lock_acquire+0x13c/0x160 [ 0.970085][ T1] console_emit_next_record+0x22f/0x4c0 [ 0.970089][ T1] ? devkmsg_read+0x4b0/0x4b0 [ 0.970090][ T1] ? console_flush_one_record+0x106/0x710 [ 0.970094][ T1] ? rcu_is_watching+0x16/0xd0 [ 0.970096][ T1] ? lock_acquire+0x13c/0x160 [ 0.970100][ T1] console_flush_one_record+0x46f/0x710 [ 0.970104][ T1] ? console_emit_next_record+0x4c0/0x4c0 [ 0.970105][ T1] ? __lock_acquire+0x518/0xc20 [ 0.970110][ T1] console_unlock+0xee/0x1f0 [ 0.970113][ T1] ? console_flush_one_record+0x710/0x710 [ 0.970115][ T1] ? rcu_is_watching+0x16/0xd0 [ 0.970117][ T1] ? lock_acquire+0x60/0x160 [ 0.970120][ T1] ? __down_trylock_console_sem+0x5e/0xa0 [ 0.970122][ T1] ? vprintk_emit+0x320/0x3e0 [ 0.970125][ T1] vprintk_emit+0x37c/0x3e0 [ 0.970129][ T1] ? wake_up_klogd_work_func+0x90/0x90 [ 0.970132][ T1] ? misc_register+0x151/0x670 [ 0.970135][ T1] ? md_run_setup+0x90/0x90 [ 0.970140][ T1] _printk+0xc7/0x100 [ 0.970143][ T1] ? snapshot_read.cold+0x21/0x21 [ 0.970144][ T1] ? md_run_setup+0x90/0x90 [ 0.970151][ T1] ? md_run_setup+0x90/0x90 [ 0.970151][ T1] dm_interface_init+0x50/0x60 [ 0.970151][ T1] dm_init+0x51/0xd0 [ 0.970151][ T1] ? md_run_setup+0x90/0x90 [ 0.970151][ T1] do_one_initcall+0x124/0x4f0 [ 0.970151][ T1] ? trace_event_raw_event_initcall_level+0x280/0x280 [ 0.970151][ T1] ? parameq+0x110/0x110 [ 0.970151][ T1] ? kernel_init_freeable+0x3f1/0x630 [ 0.970151][ T1] ? rcu_is_watching+0x16/0xd0 [ 0.970151][ T1] kernel_init_freeable+0x596/0x630 [ 0.970151][ T1] ? rest_init+0x280/0x280 [ 0.970151][ T1] kernel_init+0x21/0x150 [ 0.970151][ T1] ? rest_init+0x280/0x280 [ 0.970151][ T1] ret_from_fork+0x474/0x6b0 [ 0.970151][ T1] ? arch_exit_to_user_mode_prepare.isra.0+0x120/0x120 [ 0.970151][ T1] ? __switch_to+0x5a3/0xe00 [ 0.970151][ T1] ? rest_init+0x280/0x280 [ 0.970151][ T1] ret_from_fork_asm+0x11/0x20 [ 0.970151][ T1] [ 0.994933][ T1] nf_conntrack_irc: The irc conntrack helper is scheduled for removal. [ 0.994933][ T1] Please contact the netfilter-devel mailing list if you still need this. [ 0.996036][ T1] NET: Registered PF_INET6 protocol family [ 0.999736][ T1] Segment Routing with IPv6 [ 1.000100][ T1] In-situ OAM (IOAM) with IPv6 [ 1.000570][ T1] NET: Registered PF_PACKET protocol family [ 1.001914][ T1] NET: Registered PF_RDS protocol family [ 1.002609][ T1] Registered RDS/tcp transport [ 1.002849][ T1] 9pnet: Installing 9P2000 support [ 1.003181][ T1] Key type dns_resolver registered [ 1.003796][ T1] NET: Registered PF_VSOCK protocol family [ 1.008011][ T1] IPI shorthand broadcast: enabled [ 1.108627][ T1] sched_clock: Marking stable (1074001299, 34148267)->(1207723399, -99573833) [ 1.110851][ T1] registered taskstats version 1 [ 1.112534][ T1] Loading compiled-in X.509 certificates [ 1.213992][ T1] Demotion targets for Node 0: null [ 1.214273][ T1] kmemleak: Kernel memory leak detector initialized (mem pool available: 12149) [ 1.214550][ T1] page_owner is disabled [ 1.215464][ T1] PM: Magic number: 6:563:31 [ 1.215840][ T1] netconsole: network logging started [ 1.217131][ T1] ALSA device list: [ 1.217763][ T1] No soundcards found. [ 1.218865][ T1] md: Skipping autodetection of RAID arrays. (raid=autodetect will force) [ 1.221463][ T1] VFS: Mounted root (virtiofs filesystem) readonly on device 0:24. [ 1.222231][ T1] devtmpfs: mounted [ 1.222505][ T1] VFS: Pivoted into new rootfs [ 1.251862][ T1] Freeing unused kernel image (initmem) memory: 2576K [ 1.252080][ T1] Write protecting the kernel read-only data: 57344k [ 1.252908][ T1] Freeing unused kernel image (text/rodata gap) memory: 716K [ 1.253247][ T1] Freeing unused kernel image (rodata/data gap) memory: 260K [ 1.253876][ T1] Run /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init as init process [ 1.254116][ T1] with arguments: [ 1.254509][ T1] /usr/lib/python3.14/site-packages/virtme/guest/bin/virtme-ng-init [ 1.254725][ T1] with environment: [ 1.254841][ T1] HOME=/ [ 1.254946][ T1] TERM=dumb [ 1.255049][ T1] virtme_hostname=vmksft-net-extra-dbg,debug-threads=on [ 1.255540][ T1] nr_open=2147483584 [ 1.256645][ T1] virtme_link_mods=/srv/vmksft/testing/wt-6/.virtme_mods/lib/modules/0.0.0 [ 1.256888][ T1] virtme_rw_overlay0=/etc [ 1.257032][ T1] virtme_rw_overlay1=/lib [ 1.257175][ T1] virtme_rw_overlay2=/home [ 1.257310][ T1] virtme_rw_overlay3=/opt [ 1.257450][ T1] virtme_rw_overlay4=/srv [ 1.257592][ T1] virtme_rw_overlay5=/usr [ 1.257734][ T1] virtme_rw_overlay6=/var [ 1.257874][ T1] virtme_rw_overlay7=/tmp [ 1.258009][ T1] virtme_console=ttyS0 [ 1.258152][ T1] virtme_chdir=srv/vmksft/testing/wt-6 [ 1.272628][ T1] virtme-ng-init: mount devtmpfs -> /dev: EBUSY: Device or resource busy [ 1.273824][ T1] virtme-ng-init: Setting hostname to vmksft-net-extra-dbg,debug-threads=on... [ 1.283865][ T1] overlayfs: failed to set xattr on upper [ 1.284145][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.284494][ T1] overlayfs: ...falling back to uuid=null. [ 1.286789][ T1] overlayfs: failed to set xattr on upper [ 1.287022][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.287361][ T1] overlayfs: ...falling back to uuid=null. [ 1.289244][ T1] overlayfs: failed to set xattr on upper [ 1.289484][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.289751][ T1] overlayfs: ...falling back to uuid=null. [ 1.291616][ T1] overlayfs: failed to set xattr on upper [ 1.291896][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.292382][ T1] overlayfs: ...falling back to uuid=null. [ 1.294363][ T1] overlayfs: failed to set xattr on upper [ 1.294606][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.294872][ T1] overlayfs: ...falling back to uuid=null. [ 1.296632][ T1] overlayfs: failed to set xattr on upper [ 1.296871][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.297129][ T1] overlayfs: ...falling back to uuid=null. [ 1.299088][ T1] overlayfs: failed to set xattr on upper [ 1.299343][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.299621][ T1] overlayfs: ...falling back to uuid=null. [ 1.301776][ T1] overlayfs: failed to set xattr on upper [ 1.301999][ T1] overlayfs: ...falling back to redirect_dir=nofollow. [ 1.302280][ T1] overlayfs: ...falling back to uuid=null. [ 1.313101][ T1] virtme-ng-init: running systemd-tmpfiles [ 1.404824][ T74] kwatchdog (74) used greatest stack depth: 29688 bytes left [ 3.294519][ T72] systemd-tmpfile (72) used greatest stack depth: 24576 bytes left [ 3.294535][ T72] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 3.294537][ T72] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 72, name: systemd-tmpfile [ 3.294538][ T72] preempt_count: 2, expected: 0 [ 3.294539][ T72] RCU nest depth: 0, expected: 0 [ 3.294540][ T72] locks held by systemd-tmpfile/72: 5, last CPU#1: [ 3.294542][ T72] #0: ffffffffa6a127b8 (low_water_lock){+.+.}-{3:3}, at: do_exit+0x887/0xdc0 [ 3.294553][ T72] #1: ffffffffa6b79cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 3.294559][ T72] #2: ffffffffa6b79d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 3.294563][ T72] #3: ffffffffa6a99660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 3.294566][ T72] #4: ffffffffa6a99560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 3.294570][ T72] irq event stamp: 2335446 [ 3.294571][ T72] hardirqs last enabled at (2335445): [] __down_trylock_console_sem+0x86/0xa0 [ 3.294574][ T72] hardirqs last disabled at (2335446): [] console_emit_next_record+0x3d4/0x4c0 [ 3.294576][ T72] softirqs last enabled at (2335214): [] handle_softirqs+0x67c/0x900 [ 3.294578][ T72] softirqs last disabled at (2335203): [] __irq_exit_rcu+0x145/0x1c0 [ 3.294580][ T72] Preemption disabled at: [ 3.294581][ T72] [<0000000000000000>] 0x0 [ 3.294587][ T72] CPU: 1 UID: 0 PID: 72 Comm: systemd-tmpfile Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 3.294591][ T72] Tainted: [W]=WARN [ 3.294591][ T72] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 3.294593][ T72] Call Trace: [ 3.294595][ T72] [ 3.294596][ T72] dump_stack_lvl+0x6f/0xa0 [ 3.294602][ T72] __might_resched.cold+0x1fe/0x2c1 [ 3.294606][ T72] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 3.294610][ T72] ? __kmalloc_noprof+0xdb/0x760 [ 3.294615][ T72] __kmalloc_noprof+0x443/0x760 [ 3.294617][ T72] ? alloc_buf.isra.0+0x4b/0x260 [ 3.294623][ T72] ? do_raw_spin_unlock+0x59/0x250 [ 3.294625][ T72] alloc_buf.isra.0+0x4b/0x260 [ 3.294629][ T72] put_chars+0x1e1/0x2f0 [ 3.294632][ T72] ? __send_to_port+0x420/0x420 [ 3.294633][ T72] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 3.294638][ T72] ? validate_chain+0x38b/0xc20 [ 3.294643][ T72] hvc_console_print+0x292/0x780 [ 3.294649][ T72] ? hvc_write+0x3a0/0x3a0 [ 3.294651][ T72] ? rcu_is_watching+0x16/0xd0 [ 3.294654][ T72] ? lock_acquire+0x13c/0x160 [ 3.294658][ T72] console_emit_next_record+0x22f/0x4c0 [ 3.294661][ T72] ? devkmsg_read+0x4b0/0x4b0 [ 3.294663][ T72] ? console_flush_one_record+0x106/0x710 [ 3.294666][ T72] ? rcu_is_watching+0x16/0xd0 [ 3.294676][ T72] ? lock_acquire+0x13c/0x160 [ 3.294680][ T72] console_flush_one_record+0x46f/0x710 [ 3.294684][ T72] ? console_emit_next_record+0x4c0/0x4c0 [ 3.294685][ T72] ? __lock_acquire+0x518/0xc20 [ 3.294690][ T72] console_unlock+0xee/0x1f0 [ 3.294693][ T72] ? console_flush_one_record+0x710/0x710 [ 3.294695][ T72] ? rcu_is_watching+0x16/0xd0 [ 3.294697][ T72] ? lock_acquire+0x60/0x160 [ 3.294701][ T72] ? __down_trylock_console_sem+0x5e/0xa0 [ 3.294702][ T72] ? vprintk_emit+0x320/0x3e0 [ 3.294706][ T72] vprintk_emit+0x37c/0x3e0 [ 3.294709][ T72] ? wake_up_klogd_work_func+0x90/0x90 [ 3.294712][ T72] ? __lock_acquire+0x518/0xc20 [ 3.294716][ T1] virtme-ng-init: Failed to read '/usr/lib/tmpfiles.d/audit.conf': Permission denied [ 3.294716][ T1] Failed to create directory or subvolume "/var/spool/at/spool": Permission denied [ 3.294716][ T1] Failed to create file /var/spool/at/.SEQ: Permission denied [ 3.294716][ T1] Failed to opendir() '/proc/self/fd/6': Permission denied [ 3.294716][ T72] _printk+0xc7/0x100 [ 3.294719][ T72] ? snapshot_read.cold+0x21/0x21 [ 3.294722][ T72] ? do_raw_spin_lock+0x131/0x280 [ 3.294724][ T72] ? __rwlock_init+0x150/0x150 [ 3.294728][ T72] ? do_raw_spin_lock+0x131/0x280 [ 3.294731][ T72] do_exit.cold+0x82/0x9c [ 3.294734][ T72] ? exit_notify+0x890/0x890 [ 3.294735][ T72] ? __lock_release.isra.0+0x69/0x1a0 [ 3.294738][ T72] ? rcu_is_watching+0x16/0xd0 [ 3.294742][ T72] do_group_exit+0xb8/0x370 [ 3.294745][ T72] __x64_sys_exit_group+0x3c/0x50 [ 3.294746][ T72] x64_sys_call+0x1567/0x1570 [ 3.294749][ T72] do_syscall_64+0xff/0x530 [ 3.294753][ T72] ? exc_page_fault+0xee/0x100 [ 3.294755][ T72] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 3.294757][ T72] RIP: 0033:0x7fb4a2c471b8 [ 3.294760][ T72] Code: Unable to access opcode bytes at 0x7fb4a2c4718e. [ 3.294761][ T72] RSP: 002b:00007fffb20c4678 EFLAGS: 00000246 ORIG_RAX: 00000000000000e7 [ 3.294763][ T72] RAX: ffffffffffffffda RBX: 00007fb4a2d77f88 RCX: 00007fb4a2c471b8 [ 3.294765][ T72] RDX: 00007fb4a24a54c8 RSI: fffffffffffffe90 RDI: 0000000000000049 [ 3.294765][ T72] RBP: 00007fffb20c46d0 R08: 0000000000000000 R09: 0000000000001000 [ 3.294766][ T72] R10: 00007fffb20c4490 R11: 0000000000000246 R12: 0000000000000001 [ 3.294767][ T72] R13: 0000000000000049 R14: 00007fb4a2d76680 R15: 00007fb4a2d77fa0 [ 3.294774][ T72] [ 3.315107][ T1] virtme-ng-init: basic initialization done [ 3.347511][ T80] ip (80) used greatest stack depth: 23912 bytes left [ 3.369224][ T76] virtme-ng-init: Starting systemd-udevd version 259.8-1.fc44 [ 3.369584][ T76] virtme-ng-init: triggering udev coldplug [ 5.383302][ T76] virtme-ng-init: waiting for udev to settle [ 5.383316][ T76] BUG: sleeping function called from invalid context at ./include/linux/sched/mm.h:322 [ 5.383318][ T76] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 76, name: virtme-ng-init [ 5.383320][ T76] preempt_count: 1, expected: 0 [ 5.383321][ T76] RCU nest depth: 0, expected: 0 [ 5.383322][ T76] locks held by virtme-ng-init/76: 4, last CPU#1: [ 5.383324][ T76] #0: ffffffffa6b79cc0 (console_lock){+.+.}-{0:0}, at: vprintk_emit+0x320/0x3e0 [ 5.383335][ T76] #1: ffffffffa6b79d38 (console_srcu){....}-{0:0}, at: console_flush_one_record+0x106/0x710 [ 5.383340][ T76] #2: ffffffffa6a99660 (console_owner){....}-{0:0}, at: console_lock_spinning_enable+0x40/0x60 [ 5.383344][ T76] #3: ffffffffa6a99560 (printk_legacy_map-wait-type-override){....}-{3:3}, at: console_emit_next_record+0x1df/0x4c0 [ 5.383348][ T76] irq event stamp: 2906 [ 5.383348][ T76] hardirqs last enabled at (2905): [] __down_trylock_console_sem+0x86/0xa0 [ 5.383351][ T76] hardirqs last disabled at (2906): [] console_emit_next_record+0x3d4/0x4c0 [ 5.383353][ T76] softirqs last enabled at (2762): [] handle_softirqs+0x67c/0x900 [ 5.383356][ T76] softirqs last disabled at (2757): [] __irq_exit_rcu+0x145/0x1c0 [ 5.383358][ T76] Preemption disabled at: [ 5.383359][ T76] [] vprintk_emit+0x31b/0x3e0 [ 5.383365][ T76] CPU: 1 UID: 0 PID: 76 Comm: virtme-ng-init Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 5.383368][ T76] Tainted: [W]=WARN [ 5.383369][ T76] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 5.383370][ T76] Call Trace: [ 5.383372][ T76] [ 5.383373][ T76] dump_stack_lvl+0x6f/0xa0 [ 5.383379][ T76] ? vprintk_emit+0x31b/0x3e0 [ 5.383381][ T76] __might_resched.cold+0x1fe/0x2c1 [ 5.383385][ T76] ? perf_trace_sched_switch+0x7c0/0x7c0 [ 5.383389][ T76] ? __kmalloc_noprof+0xdb/0x760 [ 5.383394][ T76] __kmalloc_noprof+0x443/0x760 [ 5.383396][ T76] ? alloc_buf.isra.0+0x4b/0x260 [ 5.383402][ T76] ? do_raw_spin_unlock+0x59/0x250 [ 5.383404][ T76] alloc_buf.isra.0+0x4b/0x260 [ 5.383407][ T76] put_chars+0x1e1/0x2f0 [ 5.383410][ T76] ? __send_to_port+0x420/0x420 [ 5.383412][ T76] ? rcu_lockdep_current_cpu_online+0x3f/0x1b0 [ 5.383416][ T76] ? validate_chain+0x38b/0xc20 [ 5.383421][ T76] hvc_console_print+0x292/0x780 [ 5.383428][ T76] ? hvc_write+0x3a0/0x3a0 [ 5.383430][ T76] ? rcu_is_watching+0x16/0xd0 [ 5.383432][ T76] ? lock_acquire+0x13c/0x160 [ 5.383436][ T76] console_emit_next_record+0x22f/0x4c0 [ 5.383440][ T76] ? devkmsg_read+0x4b0/0x4b0 [ 5.383441][ T76] ? console_flush_one_record+0x106/0x710 [ 5.383444][ T76] ? rcu_is_watching+0x16/0xd0 [ 5.383447][ T76] ? lock_acquire+0x13c/0x160 [ 5.383450][ T76] console_flush_one_record+0x46f/0x710 [ 5.383454][ T76] ? console_emit_next_record+0x4c0/0x4c0 [ 5.383456][ T76] ? __lock_acquire+0x518/0xc20 [ 5.383461][ T76] console_unlock+0xee/0x1f0 [ 5.383463][ T76] ? console_flush_one_record+0x710/0x710 [ 5.383465][ T76] ? rcu_is_watching+0x16/0xd0 [ 5.383467][ T76] ? lock_acquire+0x60/0x160 [ 5.383471][ T76] ? __down_trylock_console_sem+0x5e/0xa0 [ 5.383472][ T76] ? vprintk_emit+0x320/0x3e0 [ 5.383476][ T76] vprintk_emit+0x37c/0x3e0 [ 5.383479][ T76] ? wake_up_klogd_work_func+0x90/0x90 [ 5.383482][ T76] ? _copy_from_iter+0x1bb/0x1810 [ 5.383488][ T76] devkmsg_emit.constprop.0+0xbc/0xf1 [ 5.383491][ T76] ? vprintk_emit.cold+0x107/0x107 [ 5.383493][ T76] ? simple_strntoull+0x10f/0x140 [ 5.383497][ T76] ? date_str+0x1e0/0x1e0 [ 5.383501][ T76] ? devkmsg_write+0xd1/0x2c0 [ 5.383505][ T76] devkmsg_write.cold+0x5a/0x8b [ 5.383507][ T76] ? vprintk_default+0x20/0x20 [ 5.383512][ T76] ? vprintk_default+0x20/0x20 [ 5.383514][ T76] new_sync_write+0x33e/0x760 [ 5.383517][ T76] ? kasan_quarantine_put+0x42/0x2b0 [ 5.383521][ T76] ? new_sync_read+0x750/0x750 [ 5.383525][ T76] ? __lock_release.isra.0+0x69/0x1a0 [ 5.383529][ T76] ? __fget_files+0x1e3/0x460 [ 5.383532][ T76] vfs_write+0x6a2/0xbd0 [ 5.383536][ T76] ksys_write+0x116/0x250 [ 5.383539][ T76] ? __ia32_sys_read+0xc0/0xc0 [ 5.383542][ T76] ? rcu_is_watching+0x16/0xd0 [ 5.383546][ T76] do_syscall_64+0xff/0x530 [ 5.383548][ T76] ? exc_page_fault+0xee/0x100 [ 5.383551][ T76] entry_SYSCALL_64_after_hwframe+0x4b/0x53 [ 5.383553][ T76] RIP: 0033:0x7efda3019ed2 [ 5.383557][ T76] Code: 08 0f 85 51 ec ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 00 f3 0f 1e fa 55 48 89 e5 [ 5.383559][ T76] RSP: 002b:00007efda2f60c68 EFLAGS: 00000246 ORIG_RAX: 0000000000000001 [ 5.383561][ T76] RAX: ffffffffffffffda RBX: 000000000000002e RCX: 00007efda3019ed2 [ 5.383563][ T76] RDX: 000000000000002e RSI: 00007efd9c0012c0 RDI: 0000000000000003 [ 5.383563][ T76] RBP: 00007efda2f60c90 R08: 0000000000000000 R09: 0000000000000000 [ 5.383564][ T76] R10: 0000000000000000 R11: 0000000000000246 R12: 00007efda30a40a0 [ 5.383565][ T76] R13: 00007efda2fa23e0 R14: 00007efd9c0012c0 R15: 00007efda2f60da8 [ 5.383571][ T76] [ 5.404281][ C0] clocksource: Watchdog remote CPU 1 read timed out [ 5.404307][ C0] [ 5.404308][ C0] ======================================================== [ 5.404308][ C0] WARNING: possible irq lock inversion dependency detected [ 5.404310][ C0] 7.2.0-virtme #1 Tainted: G W [ 5.404312][ C0] -------------------------------------------------------- [ 5.404312][ C0] swapper/0/0 just changed the state of lock: [ 5.404313][ C0] ffffffffa6a99660 (console_owner){..-.}-{0:0}, at: console_trylock_spinning+0xa4/0x1e0 [ 5.404322][ C0] but this lock took another, SOFTIRQ-unsafe lock in the past: [ 5.404323][ C0] (fs_reclaim){+.+.}-{0:0} [ 5.404324][ C0] [ 5.404324][ C0] [ 5.404324][ C0] and interrupts could create inverse lock ordering between them. [ 5.404324][ C0] [ 5.404325][ C0] [ 5.404325][ C0] other info that might help us debug this: [ 5.404326][ C0] Possible interrupt unsafe locking scenario: [ 5.404326][ C0] [ 5.404326][ C0] CPU0 CPU1 [ 5.404327][ C0] ---- ---- [ 5.404327][ C0] lock(fs_reclaim); [ 5.404328][ C0] local_irq_disable(); [ 5.404328][ C0] lock(console_owner); [ 5.404329][ C0] lock(fs_reclaim); [ 5.404330][ C0] [ 5.404330][ C0] lock(console_owner); [ 5.404331][ C0] [ 5.404331][ C0] *** DEADLOCK *** [ 5.404331][ C0] [ 5.404332][ C0] locks held by swapper/0/0: 2, last CPU#0: [ 5.404333][ C0] #0: ffa0000000007c90 ((&watchdog_timer)){+.-.}-{0:0}, at: call_timer_fn+0x110/0x4d0 [ 5.404338][ C0] #1: ffffffffa6bde8b8 (watchdog_lock){+.-.}-{3:3}, at: clocksource_watchdog+0x15/0x30 [ 5.404342][ C0] [ 5.404342][ C0] the shortest dependencies between 2nd lock and 1st lock: [ 5.404346][ C0] -> (fs_reclaim){+.+.}-{0:0} { [ 5.404348][ C0] HARDIRQ-ON-W at: [ 5.404349][ C0] __lock_acquire+0x388/0xc20 [ 5.404352][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.404354][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.404356][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 5.404358][ C0] kthread_create_worker_on_node+0xea/0x210 [ 5.404361][ C0] workqueue_init+0x2a/0x680 [ 5.404364][ C0] kernel_init_freeable+0x2fe/0x630 [ 5.404367][ C0] kernel_init+0x21/0x150 [ 5.404370][ C0] ret_from_fork+0x474/0x6b0 [ 5.404373][ C0] ret_from_fork_asm+0x11/0x20 [ 5.404376][ C0] SOFTIRQ-ON-W at: [ 5.404376][ C0] __lock_acquire+0x388/0xc20 [ 5.404378][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.404379][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.404380][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 5.404381][ C0] kthread_create_worker_on_node+0xea/0x210 [ 5.404383][ C0] workqueue_init+0x2a/0x680 [ 5.404384][ C0] kernel_init_freeable+0x2fe/0x630 [ 5.404385][ C0] kernel_init+0x21/0x150 [ 5.404387][ C0] ret_from_fork+0x474/0x6b0 [ 5.404388][ C0] ret_from_fork_asm+0x11/0x20 [ 5.404389][ C0] INITIAL USE at: [ 5.404390][ C0] __lock_acquire+0x388/0xc20 [ 5.404391][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.404392][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.404393][ C0] __kmalloc_cache_noprof+0x6e/0x620 [ 5.404395][ C0] kthread_create_worker_on_node+0xea/0x210 [ 5.404396][ C0] workqueue_init+0x2a/0x680 [ 5.404397][ C0] kernel_init_freeable+0x2fe/0x630 [ 5.404399][ C0] kernel_init+0x21/0x150 [ 5.404400][ C0] ret_from_fork+0x474/0x6b0 [ 5.404401][ C0] ret_from_fork_asm+0x11/0x20 [ 5.404402][ C0] } [ 5.404402][ C0] ... key at: [] __fs_reclaim_map+0x0/0xbe0 [ 5.404406][ C0] ... acquired at: [ 5.404407][ C0] __lock_acquire+0x518/0xc20 [ 5.404408][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.404409][ C0] fs_reclaim_acquire+0xd5/0x120 [ 5.404410][ C0] __kmalloc_noprof+0xd3/0x760 [ 5.404411][ C0] alloc_buf.isra.0+0x4b/0x260 [ 5.404414][ C0] put_chars+0x1e1/0x2f0 [ 5.404416][ C0] hvc_console_print+0x292/0x780 [ 5.404418][ C0] console_emit_next_record+0x22f/0x4c0 [ 5.404420][ C0] console_flush_one_record+0x46f/0x710 [ 5.404421][ C0] console_unlock+0xee/0x1f0 [ 5.404423][ C0] vprintk_emit+0x37c/0x3e0 [ 5.404424][ C0] _printk+0xc7/0x100 [ 5.404427][ C0] dm_interface_init+0x50/0x60 [ 5.404429][ C0] dm_init+0x51/0xd0 [ 5.404431][ C0] do_one_initcall+0x124/0x4f0 [ 5.404432][ C0] kernel_init_freeable+0x596/0x630 [ 5.404434][ C0] kernel_init+0x21/0x150 [ 5.404435][ C0] ret_from_fork+0x474/0x6b0 [ 5.404436][ C0] ret_from_fork_asm+0x11/0x20 [ 5.404437][ C0] [ 5.404438][ C0] -> (console_owner){..-.}-{0:0} { [ 5.404439][ C0] IN-SOFTIRQ-W at: [ 5.404440][ C0] __lock_acquire+0x388/0xc20 [ 5.404441][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.404443][ C0] console_trylock_spinning+0xb5/0x1e0 [ 5.404444][ C0] vprintk_emit+0x320/0x3e0 [ 5.404446][ C0] _printk+0xc7/0x100 [ 5.404447][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 5.404449][ C0] call_timer_fn+0x160/0x4d0 [ 5.404451][ C0] __run_timers+0x68f/0xaa0 [ 5.404452][ C0] run_timer_softirq+0xf0/0x160 [ 5.404454][ C0] handle_softirqs+0x1d3/0x900 [ 5.404456][ C0] __irq_exit_rcu+0x145/0x1c0 [ 5.404457][ C0] irq_exit_rcu+0xe/0x30 [ 5.404459][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 5.404460][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5.404462][ C0] finish_task_switch.isra.0+0x214/0xa70 [ 5.404464][ C0] __schedule+0xf9b/0x20e0 [ 5.404465][ C0] schedule_idle+0x59/0x90 [ 5.404467][ C0] cpu_startup_entry+0x53/0x70 [ 5.404469][ C0] rest_init+0x279/0x280 [ 5.404470][ C0] start_kernel+0x3af/0x3b0 [ 5.404472][ C0] x86_64_start_reservations+0x24/0x30 [ 5.404474][ C0] x86_64_start_kernel+0x12b/0x130 [ 5.404475][ C0] common_startup_64+0x13e/0x148 [ 5.404478][ C0] INITIAL USE at: [ 5.404479][ C0] } [ 5.404479][ C0] ... key at: [] console_owner_dep_map+0x0/0x60 [ 5.404482][ C0] ... acquired at: [ 5.404483][ C0] mark_lock+0x1d7/0xa00 [ 5.404484][ C0] mark_usage+0x42/0x170 [ 5.404485][ C0] __lock_acquire+0x388/0xc20 [ 5.404487][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.404488][ C0] console_trylock_spinning+0xb5/0x1e0 [ 5.404489][ C0] vprintk_emit+0x320/0x3e0 [ 5.404491][ C0] _printk+0xc7/0x100 [ 5.404492][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 5.404493][ C0] call_timer_fn+0x160/0x4d0 [ 5.404495][ C0] __run_timers+0x68f/0xaa0 [ 5.404496][ C0] run_timer_softirq+0xf0/0x160 [ 5.404498][ C0] handle_softirqs+0x1d3/0x900 [ 5.404499][ C0] __irq_exit_rcu+0x145/0x1c0 [ 5.404500][ C0] irq_exit_rcu+0xe/0x30 [ 5.404501][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 5.404502][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5.404503][ C0] finish_task_switch.isra.0+0x214/0xa70 [ 5.404504][ C0] __schedule+0xf9b/0x20e0 [ 5.404506][ C0] schedule_idle+0x59/0x90 [ 5.404507][ C0] cpu_startup_entry+0x53/0x70 [ 5.404508][ C0] rest_init+0x279/0x280 [ 5.404509][ C0] start_kernel+0x3af/0x3b0 [ 5.404511][ C0] x86_64_start_reservations+0x24/0x30 [ 5.404512][ C0] x86_64_start_kernel+0x12b/0x130 [ 5.404514][ C0] common_startup_64+0x13e/0x148 [ 5.404515][ C0] [ 5.404515][ C0] [ 5.404515][ C0] stack backtrace: [ 5.404517][ C0] CPU: 0 UID: 0 PID: 0 Comm: swapper/0 Tainted: G W 7.2.0-virtme #1 PREEMPT(full) [ 5.404520][ C0] Tainted: [W]=WARN [ 5.404520][ C0] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [ 5.404521][ C0] Call Trace: [ 5.404522][ C0] [ 5.404523][ C0] dump_stack_lvl+0x6f/0xa0 [ 5.404527][ C0] print_irq_inversion_bug.part.0.cold+0xe6/0x143 [ 5.404529][ C0] mark_lock_irq+0x989/0x9c0 [ 5.404531][ C0] ? add_lock_to_list+0x2c/0x1a0 [ 5.404534][ C0] mark_lock+0x1d7/0xa00 [ 5.404536][ C0] mark_usage+0x42/0x170 [ 5.404537][ C0] __lock_acquire+0x388/0xc20 [ 5.404539][ C0] lock_acquire.part.0+0xd4/0x280 [ 5.404541][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 5.404543][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.404546][ C0] ? lock_acquire+0x13c/0x160 [ 5.404548][ C0] console_trylock_spinning+0xb5/0x1e0 [ 5.404550][ C0] ? console_trylock_spinning+0xa4/0x1e0 [ 5.404551][ C0] vprintk_emit+0x320/0x3e0 [ 5.404553][ C0] ? wake_up_klogd_work_func+0x90/0x90 [ 5.404556][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 5.404558][ C0] _printk+0xc7/0x100 [ 5.404559][ C0] ? snapshot_read.cold+0x21/0x21 [ 5.404561][ C0] ? clocksource_watchdog.part.0+0x450/0x540 [ 5.404563][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 5.404565][ C0] clocksource_watchdog.part.0.cold+0x105/0x1dd [ 5.404567][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 5.404568][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 5.404570][ C0] call_timer_fn+0x160/0x4d0 [ 5.404572][ C0] ? detach_if_pending+0x1d0/0x1d0 [ 5.404574][ C0] ? debug_object_active_state+0x430/0x430 [ 5.404577][ C0] ? find_held_lock+0x2b/0x80 [ 5.404579][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 5.404581][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.404583][ C0] __run_timers+0x68f/0xaa0 [ 5.404585][ C0] ? clocksource_watchdog.part.0+0x540/0x540 [ 5.404587][ C0] ? __bpf_trace_itimer_expire+0x10/0x10 [ 5.404588][ C0] ? __lock_acquire+0x518/0xc20 [ 5.404591][ C0] ? __rwlock_init+0x150/0x150 [ 5.404593][ C0] run_timer_softirq+0xf0/0x160 [ 5.404595][ C0] ? __run_timers+0xaa0/0xaa0 [ 5.404597][ C0] ? trace_irq_enable.constprop.0+0x9b/0x160 [ 5.404599][ C0] ? rcu_is_watching+0x16/0xd0 [ 5.404601][ C0] handle_softirqs+0x1d3/0x900 [ 5.404603][ C0] ? __lock_release.isra.0+0x69/0x1a0 [ 5.404605][ C0] ? _local_bh_enable+0xc0/0xc0 [ 5.404607][ C0] __irq_exit_rcu+0x145/0x1c0 [ 5.404608][ C0] irq_exit_rcu+0xe/0x30 [ 5.404609][ C0] sysvec_apic_timer_interrupt+0x9d/0xe0 [ 5.404611][ C0] [ 5.404611][ C0] [ 5.404612][ C0] asm_sysvec_apic_timer_interrupt+0x1a/0x20 [ 5.404614][ C0] RIP: 0010:finish_task_switch.isra.0+0x214/0xa70 [ 5.404616][ C0] Code: 03 0f 8e 74 06 00 00 c7 83 40 0d 00 00 00 00 00 00 48 8d 7b 48 e8 7c e3 6a 02 e8 a7 7c 34 00 fb 48 b8 00 00 00 00 00 fc ff df <49> 8d 7c 24 2c 48 89 fa 48 c1 ea 03 0f b6 14 02 48 89 f8 83 e0 07 [ 5.404617][ C0] RSP: 0018:ffffffffa6807c48 EFLAGS: 00000292 [ 5.404619][ C0] RAX: dffffc0000000000 RBX: ff1100002e638180 RCX: ffffffffa3698f49 [ 5.404620][ C0] RDX: ffffffffa682c600 RSI: ffffffffa6678e68 RDI: ffffffffa608dce0 [ 5.404621][ C0] RBP: ffffffffa6807c88 R08: 0000000000000000 R09: 0000000000000000 [ 5.404622][ C0] R10: 0000000000000000 R11: 0000000000000001 R12: ffffffffa682c600 [ 5.404623][ C0] R13: ff1100000a6c2380 R14: 0000000000000000 R15: ff1100002e638ec0 [ 5.404624][ C0] ? finish_task_switch.isra.0+0x209/0xa70 [ 5.404626][ C0] ? finish_task_switch.isra.0+0x209/0xa70 [ 5.404628][ C0] ? __switch_to+0x5a3/0xe00 [ 5.404630][ C0] __schedule+0xf9b/0x20e0 [ 5.404632][ C0] ? io_schedule_timeout+0x140/0x140 [ 5.404634][ C0] ? default_idle_call+0x98/0xb0 [ 5.404635][ C0] ? arch_cpu_idle_exit+0x40/0x40 [ 5.404637][ C0] ? mark_tsc_async_resets+0x30/0x30 [ 5.404640][ C0] schedule_idle+0x59/0x90 [ 5.404642][ C0] cpu_startup_entry+0x53/0x70 [ 5.404643][ C0] rest_init+0x279/0x280 [ 5.404645][ C0] ? __cpuidle_text_end+0x3b/0x3b [ 5.404647][ C0] ? rest_init+0x280/0x280 [ 5.404648][ C0] ? acpi_hw_set_mode+0x4a0/0x4a0 [ 5.404651][ C0] ? cpus_read_unlock+0x4f/0xc0 [ 5.404654][ C0] ? acpi_enable+0x1e4/0x330 [ 5.404657][ C0] start_kernel+0x3af/0x3b0 [ 5.404659][ C0] x86_64_start_reservations+0x24/0x30 [ 5.404661][ C0] x86_64_start_kernel+0x12b/0x130 [ 5.404662][ C0] common_startup_64+0x13e/0x148 [ 5.404665][ C0] [ 5.747770][ T76] virtme-ng-init: udev is done [ 5.749622][ T1] virtme-ng-init: initialization done