flashbots / flashbots/yocto-manifests
Error when booting with qemu on bare metal TDX
- Dominant language
- Shell
- Stars
- 11
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Description
Im not sure if this is the right place to put this issue, maybe its more relevant to [meta-confidential-compute](https://github.com/flashbots/meta-confidential-compute) repo, or maybe it is a problem my end.
I can successfully build images made using the instructions in this repo.
When booting on a TDX machine which is set up using the [canonical/tdx](https://github.com/canonical/tdx) scripts and run with qemu using their [guest-tools/run_td.sh](https://github.com/canonical/tdx/blob/main/guest-tools/run_td.sh) script, the boot does not complete, but hangs with the following output:
`note: cryptomgr_test[152] exited with preempt_count 1` (click to see full output with call trace)
```
$ sudo TD_IMG=../../cvm-image-azure-tdx.rootfs.wic.qcow2 ./run_td.sh
Using TD image ../../cvm-image-azure-tdx.rootfs.wic.qcow2
BdsDxe: loading Boot0001 "UEFI Misc Device" from PciRoot(0x0)/Pci(0x2,0x0)
BdsDxe: starting Boot0001 "UEFI Misc Device" from PciRoot(0x0)/Pci(0x2,0x0)
EFI stub: Loaded initrd from LINUX_EFI_INITRD_MEDIA_GUID device path
[ 0.000000] tdx: Guest detected
[ 0.000000] Linux version 6.6.35-yocto-tiny (oe-user@oe-host) (x86_64-poky-linux-gcc (GCC) 13.3.0, GNU ld (GNU Binutils) 2.42.0.20240716) #1 SMP PREEMPT Fri Jun 28 17:07:28 UTC 2024
[ 0.000000] Command line: root=None console=ttyS0,115200 console=tty0 ramdisk_size=402653184
[ 0.000000] x86/split lock detection: #DB: warning on user-space bus_locks
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000080bfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000080c000-0x000000000080cfff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000000080d000-0x000000000081ffff] usable
[ 0.000000] BIOS-e820: [mem 0x0000000000820000-0x00000000008fffff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x0000000000900000-0x000000007ee14fff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007ee15000-0x000000007eed5fff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000007eed6000-0x000000007f8ecfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007f8ed000-0x000000007fb6cfff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000007fb6d000-0x000000007fb7efff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000007fb7f000-0x000000007fbfefff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000007fbff000-0x000000007fe7bfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007fe7c000-0x000000007fefffff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000007ff00000-0x000000007fffffff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] APIC: Static calls initialized
[ 0.000000] efi: EFI v2.7 by Ubuntu distribution of EDK II
[ 0.000000] efi: ACPI=0x7fb7e000 ACPI 2.0=0x7fb7e014 SMBIOS=0x7f988000 SMBIOS 3.0=0x7f986000 MEMATTR=0x7d913018 INITRD=0x7d915d18
[ 0.000000] SMBIOS 3.0.0 present.
[ 0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 2024.02-3+tdx1.0 07/03/2024
[ 0.000000] Hypervisor detected: KVM
[ 0.000000] tsc: Detected 3200.000 MHz processor
[ 0.000012] last_pfn = 0x80000 max_arch_pfn = 0x400000000
[ 0.000038] MTRRs disabled by BIOS
[ 0.000039] x86/PAT: Configuration [0-7]: WB WT UC- UC WB WT UC- UC
[ 0.000047] x2apic: enabled by BIOS, switching to x2apic ops
[ 0.000078] Using GB pages for direct mapping
[ 0.000579] Secure boot disabled
[ 0.000579] RAMDISK: [mem 0x7b861000-0x7be7efff]
[ 0.000581] ACPI: Early table checksum verification disabled
[ 0.000583] ACPI: RSDP 0x000000007FB7E014 000024 (v02 BOCHS )
[ 0.000587] ACPI: XSDT 0x000000007FB7D0E8 00004C (v01 BOCHS BXPC 00000001 01000013)
[ 0.000591] ACPI: FACP 0x000000007FB78000 0000F4 (v03 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.000595] ACPI: DSDT 0x000000007FB79000 0024F0 (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.000598] ACPI: FACS 0x000000007FBC5000 000040
[ 0.000599] ACPI: CCEL 0x000000007FB7C000 000038 (v01 INTEL EDK2 00000002 01000013)
[ 0.000602] ACPI: MCFG 0x000000007FB76000 00003C (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.000604] ACPI: WAET 0x000000007FB75000 000028 (v01 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.000606] ACPI: APIC 0x000000007FB74000 00016E (v03 BOCHS BXPC 00000001 BXPC 00000001)
[ 0.000608] ACPI: Reserving FACP table memory at [mem 0x7fb78000-0x7fb780f3]
[ 0.000609] ACPI: Reserving DSDT table memory at [mem 0x7fb79000-0x7fb7b4ef]
[ 0.000610] ACPI: Reserving FACS table memory at [mem 0x7fbc5000-0x7fbc503f]
[ 0.000610] ACPI: Reserving CCEL table memory at [mem 0x7fb7c000-0x7fb7c037]
[ 0.000611] ACPI: Reserving MCFG table memory at [mem 0x7fb76000-0x7fb7603b]
[ 0.000612] ACPI: Reserving WAET table memory at [mem 0x7fb75000-0x7fb75027]
[ 0.000612] ACPI: Reserving APIC table memory at [mem 0x7fb74000-0x7fb7416d]
[ 0.000693] APIC: Switched APIC routing to: cluster x2apic
[ 0.000700] Zone ranges:
[ 0.000701] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000703] DMA32 [mem 0x0000000001000000-0x000000007fffffff]
[ 0.000704] Normal empty
[ 0.000705] Movable zone start for each node
[ 0.000705] Early memory node ranges
[ 0.000705] node 0: [mem 0x0000000000001000-0x000000000009ffff]
[ 0.000707] node 0: [mem 0x0000000000100000-0x000000000080bfff]
[ 0.000707] node 0: [mem 0x000000000080d000-0x000000000081ffff]
[ 0.000708] node 0: [mem 0x0000000000900000-0x000000007ee14fff]
[ 0.000709] node 0: [mem 0x000000007eed6000-0x000000007f8ecfff]
[ 0.000709] node 0: [mem 0x000000007fbff000-0x000000007fe7bfff]
[ 0.000710] node 0: [mem 0x000000007ff00000-0x000000007fffffff]
[ 0.000711] Initmem setup node 0 [mem 0x0000000000001000-0x000000007fffffff]
[ 0.000716] On node 0, zone DMA: 1 pages in unavailable ranges
[ 0.000735] On node 0, zone DMA: 96 pages in unavailable ranges
[ 0.000736] On node 0, zone DMA: 1 pages in unavailable ranges
[ 0.000755] On node 0, zone DMA: 224 pages in unavailable ranges
[ 0.004988] On node 0, zone DMA32: 193 pages in unavailable ranges
[ 0.005003] On node 0, zone DMA32: 786 pages in unavailable ranges
[ 0.005008] On node 0, zone DMA32: 132 pages in unavailable ranges
[ 0.005897] ACPI: PM-Timer IO Port: 0x608
[ 0.005919] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[ 0.006023] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[ 0.006025] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
[ 0.006027] ACPI: INT_SRC_OVR (bus 0 bus_irq 1 global_irq 1 high edge)
[ 0.006028] ACPI: INT_SRC_OVR (bus 0 bus_irq 2 global_irq 2 high edge)
[ 0.006029] ACPI: INT_SRC_OVR (bus 0 bus_irq 3 global_irq 3 high edge)
[ 0.006029] ACPI: INT_SRC_OVR (bus 0 bus_irq 4 global_irq 4 high edge)
[ 0.006030] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high edge)
[ 0.006031] ACPI: INT_SRC_OVR (bus 0 bus_irq 6 global_irq 6 high edge)
[ 0.006032] ACPI: INT_SRC_OVR (bus 0 bus_irq 7 global_irq 7 high edge)
[ 0.006032] ACPI: INT_SRC_OVR (bus 0 bus_irq 8 global_irq 8 high edge)
[ 0.006033] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high edge)
[ 0.006034] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high edge)
[ 0.006035] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high edge)
[ 0.006036] ACPI: INT_SRC_OVR (bus 0 bus_irq 12 global_irq 12 high edge)
[ 0.006036] ACPI: INT_SRC_OVR (bus 0 bus_irq 13 global_irq 13 high edge)
[ 0.006037] ACPI: INT_SRC_OVR (bus 0 bus_irq 14 global_irq 14 high edge)
[ 0.006038] ACPI: INT_SRC_OVR (bus 0 bus_irq 15 global_irq 15 high edge)
[ 0.006040] ACPI: Found unsupported MADT entry (type = 0x10)
[ 0.006042] ACPI: APIC: wakeup_secondary_cpu_64() replaced with acpi_wakeup_cpu()
[ 0.006045] ACPI: Using ACPI (MADT) for SMP configuration information
[ 0.006046] smpboot: Allowing 16 CPUs, 0 hotplug CPUs
[ 0.006131] [mem 0x80000000-0xdfffffff] available for PCI devices
[ 0.006133] Booting paravirtualized kernel on KVM
[ 0.006135] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[ 0.006139] setup_percpu: NR_CPUS:64 nr_cpumask_bits:16 nr_cpu_ids:16 nr_node_ids:1
[ 0.006591] percpu: Embedded 44 pages/cpu s141736 r8192 d30296 u262144
[ 0.006647] kvm-guest: PV spinlocks enabled
[ 0.006648] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes, linear)
[ 0.006650] Kernel command line: root=None console=ttyS0,115200 console=tty0 ramdisk_size=402653184
[ 0.006691] random: crng init done
[ 0.006837] Dentry cache hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[ 0.006912] Inode-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear)
[ 0.007015] Built 1 zonelists, mobility grouping on. Total pages: 512716
[ 0.007017] mem auto-init: stack:all(zero), heap alloc:off, heap free:off
[ 0.007019] software IO TLB: area num 16.
[ 0.023477] Memory: 1911444K/2091420K available (10240K kernel code, 902K rwdata, 2920K rodata, 1000K init, 2100K bss, 179720K reserved, 0K cma-reserved)
[ 0.023512] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=16, Nodes=1
[ 0.023604] rcu: Preemptible hierarchical RCU implementation.
[ 0.023605] rcu: RCU restricting CPUs from NR_CPUS=64 to nr_cpu_ids=16.
[ 0.023607] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[ 0.023607] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=16
[ 0.023621] NR_IRQS: 4352, nr_irqs: 552, preallocated irqs: 16
[ 0.023894] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[ 0.024140] Console: colour dummy device 80x25
[ 0.024142] printk: console [tty0] enabled
[ 0.024337] printk: console [ttyS0] enabled
[ 0.240509] ACPI: Core revision 20230628
[ 0.241716] APIC: Switch to symmetric I/O mode setup
[ 0.249056] APIC: Switched APIC routing to: physical x2apic
[ 0.250629] kvm-guest: APIC: send_IPI_mask() replaced with kvm_send_ipi_mask()
[ 0.252953] kvm-guest: APIC: send_IPI_mask_allbutself() replaced with kvm_send_ipi_mask_allbutself()
[ 0.256037] kvm-guest: setup PV IPIs
[ 0.266543] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.268766] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2e204a37a46, max_idle_ns: 440795338293 ns
[ 0.272264] Calibrating delay loop (skipped), value calculated using timer frequency.. 6400.00 BogoMIPS (lpj=3200000)
[ 0.273907] process: using TDX aware idle routine
[ 0.274269] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[ 0.275264] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[ 0.276267] Spectre V2 : User space: Vulnerable
[ 0.277264] Speculative Store Bypass: Vulnerable
[ 0.278288] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.279264] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.280264] x86/fpu: Supporting XSAVE feature 0x20000: 'AMX Tile config'
[ 0.281264] x86/fpu: Supporting XSAVE feature 0x40000: 'AMX Tile data'
[ 0.282264] x86/fpu: xstate_offset[17]: 576, xstate_sizes[17]: 64
[ 0.283264] x86/fpu: xstate_offset[18]: 640, xstate_sizes[18]: 8192
[ 0.284264] x86/fpu: Enabled xstate features 0x60003, context size is 8832 bytes, using 'compacted' format.
[ 0.286425] Freeing SMP alternatives memory: 24K
[ 0.290265] Memory Encryption Features active: Intel TDX
[ 0.291264] pid_max: default: 32768 minimum: 301
[ 0.294733] Mount-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
[ 0.295272] Mountpoint-cache hash table entries: 4096 (order: 3, 32768 bytes, linear)
[ 0.297404] smpboot: CPU0: Intel 06/cf (family: 0x6, model: 0xcf, stepping: 0x2)
[ 0.298353] Performance Events: unsupported p6 CPU model 207 no PMU driver, software events only.
[ 0.299277] signal: max sigframe size: 11952
[ 0.300285] rcu: Hierarchical SRCU implementation.
[ 0.301264] rcu: Max phase no-delay instances is 400.
[ 0.303349] smp: Bringing up secondary CPUs ...
[ 0.304264] smpboot: Parallel CPU startup disabled by the platform
[ 0.305317] smpboot: x86: Booting SMP configuration:
[ 0.306267] .... node #0, CPUs: #1
[ 0.248156] smpboot: CPU 1 Converting physical 0 to logical die 1
[ 0.326316] #2
[ 0.248156] smpboot: CPU 2 Converting physical 0 to logical die 2
[ 0.344311] #3
[ 0.248156] smpboot: CPU 3 Converting physical 0 to logical die 3
[ 0.361310] #4
[ 0.248156] smpboot: CPU 4 Converting physical 0 to logical die 4
[ 0.378310] #5
[ 0.248156] smpboot: CPU 5 Converting physical 0 to logical die 5
[ 0.396306] #6
[ 0.248156] smpboot: CPU 6 Converting physical 0 to logical die 6
[ 0.413314] #7
[ 0.248156] smpboot: CPU 7 Converting physical 0 to logical die 7
[ 0.431304] #8
[ 0.248156] smpboot: CPU 8 Converting physical 0 to logical die 8
[ 0.449307] #9
[ 0.248156] smpboot: CPU 9 Converting physical 0 to logical die 9
[ 0.467309] #10
[ 0.248156] smpboot: CPU 10 Converting physical 0 to logical die 10
[ 0.485304] #11
[ 0.248156] smpboot: CPU 11 Converting physical 0 to logical die 11
[ 0.506297] #12
[ 0.248156] smpboot: CPU 12 Converting physical 0 to logical die 12
[ 0.525308] #13
[ 0.248156] smpboot: CPU 13 Converting physical 0 to logical die 13
[ 0.542304] #14
[ 0.248156] smpboot: CPU 14 Converting physical 0 to logical die 14
[ 0.562317] #15
[ 0.248156] smpboot: CPU 15 Converting physical 0 to logical die 15
[ 0.581304] smp: Brought up 1 node, 16 CPUs
[ 0.582267] smpboot: Max logical packages: 16
[ 0.583265] smpboot: Total of 16 processors activated (102400.00 BogoMIPS)
[ 0.590269] devtmpfs: initialized
[ 0.592315] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[ 0.593265] futex hash table entries: 4096 (order: 6, 262144 bytes, linear)
[ 0.595295] pinctrl core: initialized pinctrl subsystem
[ 0.597268] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[ 0.598383] thermal_sys: Registered thermal governor 'step_wise'
[ 0.598392] cpuidle: using governor menu
[ 0.601265] PCI: Using configuration type 1 for base access
[ 0.605328] cryptd: max_cpu_qlen set to 1000
[ 0.607311] ACPI: Added _OSI(Module Device)
[ 0.608264] ACPI: Added _OSI(Processor Device)
[ 0.609264] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.610264] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.614442] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 0.619327] ACPI: _OSC evaluation for CPUs failed, trying _PDC
[ 0.621381] ACPI: Interpreter enabled
[ 0.622267] ACPI: PM: (supports S0 S5)
[ 0.623264] ACPI: Using IOAPIC for interrupt routing
[ 0.624281] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.625264] PCI: Ignoring E820 reservations for host bridge windows
[ 0.627353] ACPI: Enabled 2 GPEs in block 00 to 3F
[ 0.640305] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.641266] acpi PNP0A08:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3]
[ 0.642264] acpi PNP0A08:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 0.643324] PCI host bridge to bus 0000:00
[ 0.644264] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 0.645264] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 0.646264] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 0.647264] pci_bus 0000:00: root bus resource [mem 0x80000000-0xdfffffff window]
[ 0.648264] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfebfffff window]
[ 0.649264] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x3807ffffffff window]
[ 0.650264] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.652334] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000
[ 0.661335] pci 0000:00:01.0: [1af4:1041] type 00 class 0x020000
[ 0.668264] pci 0000:00:01.0: reg 0x14: [mem 0x80003000-0x80003fff]
[ 0.677264] pci 0000:00:01.0: reg 0x20: [mem 0x380000000000-0x380000003fff 64bit pref]
[ 0.680439] pci 0000:00:01.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[ 0.694334] pci 0000:00:02.0: [1af4:1042] type 00 class 0x010000
[ 0.700264] pci 0000:00:02.0: reg 0x14: [mem 0x80002000-0x80002fff]
[ 0.707264] pci 0000:00:02.0: reg 0x20: [mem 0x380000004000-0x380000007fff 64bit pref]
[ 0.720308] pci 0000:00:03.0: [1af4:1053] type 00 class 0x078000
[ 0.725409] pci 0000:00:03.0: reg 0x14: [mem 0x80001000-0x80001fff]
[ 0.732264] pci 0000:00:03.0: reg 0x20: [mem 0x380000008000-0x38000000bfff 64bit pref]
[ 0.747317] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100
[ 0.755334] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO
[ 0.759428] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601
[ 0.770264] pci 0000:00:1f.2: reg 0x20: [io 0x6040-0x605f]
[ 0.774264] pci 0000:00:1f.2: reg 0x24: [mem 0x80000000-0x80000fff]
[ 0.783287] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500
[ 0.791420] pci 0000:00:1f.3: reg 0x20: [io 0x6000-0x603f]
[ 0.798308] ACPI: PCI: Interrupt link LNKA configured for IRQ 10
[ 0.801299] ACPI: PCI: Interrupt link LNKB configured for IRQ 10
[ 0.802383] ACPI: PCI: Interrupt link LNKC configured for IRQ 11
[ 0.803380] ACPI: PCI: Interrupt link LNKD configured for IRQ 11
[ 0.805271] ACPI: PCI: Interrupt link LNKE configured for IRQ 10
[ 0.806378] ACPI: PCI: Interrupt link LNKF configured for IRQ 10
[ 0.808405] ACPI: PCI: Interrupt link LNKG configured for IRQ 11
[ 0.810303] ACPI: PCI: Interrupt link LNKH configured for IRQ 11
[ 0.811315] ACPI: PCI: Interrupt link GSIA configured for IRQ 16
[ 0.812269] ACPI: PCI: Interrupt link GSIB configured for IRQ 17
[ 0.813269] ACPI: PCI: Interrupt link GSIC configured for IRQ 18
[ 0.814268] ACPI: PCI: Interrupt link GSID configured for IRQ 19
[ 0.815269] ACPI: PCI: Interrupt link GSIE configured for IRQ 20
[ 0.816268] ACPI: PCI: Interrupt link GSIF configured for IRQ 21
[ 0.817269] ACPI: PCI: Interrupt link GSIG configured for IRQ 22
[ 0.818269] ACPI: PCI: Interrupt link GSIH configured for IRQ 23
[ 0.824307] iommu: Default domain type: Translated
[ 0.825265] iommu: DMA domain TLB invalidation policy: lazy mode
[ 0.827316] SCSI subsystem initialized
[ 0.828292] ACPI: bus type USB registered
[ 0.829273] usbcore: registered new interface driver usbfs
[ 0.830267] usbcore: registered new interface driver hub
[ 0.831271] usbcore: registered new device driver usb
[ 0.833320] efivars: Registered efivars operations
[ 0.835340] Bluetooth: Core ver 2.22
[ 0.836265] NET: Registered PF_BLUETOOTH protocol family
[ 0.837264] Bluetooth: HCI device and connection manager initialized
[ 0.838265] Bluetooth: HCI socket layer initialized
[ 0.839266] Bluetooth: L2CAP socket layer initialized
[ 0.840265] Bluetooth: SCO socket layer initialized
[ 0.841265] PCI: Using ACPI for IRQ routing
[ 0.844295] vgaarb: loaded
[ 0.846363] clocksource: Switched to clocksource tsc-early
[ 0.848195] pnp: PnP ACPI init
[ 0.849263] system 00:04: [mem 0xe0000000-0xefffffff window] has been reserved
[ 0.851936] pnp: PnP ACPI: found 5 devices
[ 0.861249] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 0.864285] NET: Registered PF_INET protocol family
[ 0.865945] IP idents hash table entries: 32768 (order: 6, 262144 bytes, linear)
[ 0.868632] tcp_listen_portaddr_hash hash table entries: 1024 (order: 2, 16384 bytes, linear)
[ 0.871437] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[ 0.873851] TCP established hash table entries: 16384 (order: 5, 131072 bytes, linear)
[ 0.876470] TCP bind hash table entries: 16384 (order: 7, 524288 bytes, linear)
[ 0.878868] TCP: Hash tables configured (established 16384 bind 16384)
[ 0.880992] UDP hash table entries: 1024 (order: 3, 32768 bytes, linear)
[ 0.883123] UDP-Lite hash table entries: 1024 (order: 3, 32768 bytes, linear)
[ 0.885491] NET: Registered PF_UNIX/PF_LOCAL protocol family
[ 0.887577] RPC: Registered named UNIX socket transport module.
[ 0.889508] RPC: Registered udp transport module.
[ 0.891083] RPC: Registered tcp transport module.
[ 0.892712] RPC: Registered tcp-with-tls transport module.
[ 0.894632] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 0.896847] pci 0000:00:01.0: BAR 6: assigned [mem 0x80080000-0x800fffff pref]
[ 0.899236] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 0.901159] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]
[ 0.903154] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 0.905457] pci_bus 0000:00: resource 7 [mem 0x80000000-0xdfffffff window]
[ 0.907853] pci_bus 0000:00: resource 8 [mem 0xf0000000-0xfebfffff window]
[ 0.910113] pci_bus 0000:00: resource 9 [mem 0x380000000000-0x3807ffffffff window]
[ 0.912838] PCI: CLS 0 bytes, default 64
[ 0.914153] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 0.916248] software IO TLB: mapped [mem 0x0000000075800000-0x0000000079800000] (64MB)
[ 0.918993] Trying to unpack rootfs image as initramfs...
[ 0.921018] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2e204a37a46, max_idle_ns: 440795338293 ns
[ 0.924591] clocksource: Switched to clocksource tsc
[ 0.932900] Initialise system trusted keyrings
[ 0.934112] workingset: timestamp_bits=62 max_order=19 bucket_order=0
[ 0.935985] NFS: Registering the id_resolver key type
[ 0.937290] Key type id_resolver registered
[ 0.938372] Key type id_legacy registered
[ 0.947284] Key type asymmetric registered
[ 0.948318] Asymmetric key parser 'x509' registered
[ 0.949583] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[ 0.964399] hv_vmbus: registering driver hyperv_fb
[ 0.967182] ACPI: \_SB_.GSIF: Enabled at IRQ 21
[ 0.971522] ACPI: \_SB_.GSIG: Enabled at IRQ 22
[ 0.975776] ACPI: \_SB_.GSIH: Enabled at IRQ 23
[ 0.980208] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[ 0.982166] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 0.984668] Linux agpgart interface v0.103
[ 0.985751] ACPI: bus type drm_connector registered
[ 1.081211] brd: module loaded
[ 1.091315] virtio_blk virtio1: 16/0/0 default/read/poll queues
[ 1.176365] virtio_blk virtio1: [vda] 57344 512-byte logical blocks (29.4 MB/28.0 MiB)
[ 1.181616] Freeing initrd memory: 6264K
[ 1.184595] software IO TLB: Memory encryption is active and system is using DMA bounce buffers
[ 1.195243] GPT:Primary header thinks Alt. header is not at the end of the disk.
[ 1.199278] GPT:56641 != 57343
[ 1.201227] GPT:Alternate GPT header not at the end of the disk.
[ 1.204609] GPT:56641 != 57343
[ 1.206427] GPT: Use GNU Parted to correct GPT errors.
[ 1.209260] vda: vda1
[ 1.211515] hv_vmbus: registering driver hv_storvsc
[ 1.229215] ACPI: \_SB_.GSIA: Enabled at IRQ 16
[ 1.244650] ahci 0000:00:1f.2: AHCI 0001.0000 32 slots 6 ports 1.5 Gbps 0x3f impl SATA mode
[ 1.250213] ahci 0000:00:1f.2: flags: 64bit ncq only
[ 1.289443] scsi host0: ahci
[ 1.296580] scsi host1: ahci
[ 1.306362] scsi host2: ahci
[ 1.324220] scsi host3: ahci
[ 1.340219] scsi host4: ahci
[ 1.358281] scsi host5: ahci
[ 1.366527] ata1: SATA max UDMA/133 abar m4096@0x80000000 port 0x80000100 irq 41
[ 1.375289] ata2: SATA max UDMA/133 abar m4096@0x80000000 port 0x80000180 irq 41
[ 1.382447] ata3: SATA max UDMA/133 abar m4096@0x80000000 port 0x80000200 irq 41
[ 1.389299] ata4: SATA max UDMA/133 abar m4096@0x80000000 port 0x80000280 irq 41
[ 1.395716] ata5: SATA max UDMA/133 abar m4096@0x80000000 port 0x80000300 irq 41
[ 1.402264] ata6: SATA max UDMA/133 abar m4096@0x80000000 port 0x80000380 irq 41
[ 1.434436] e100: Intel(R) PRO/100 Network Driver
[ 1.438257] e100: Copyright(c) 1999-2006 Intel Corporation
[ 1.442325] e1000: Intel(R) PRO/1000 Network Driver
[ 1.445690] e1000: Copyright (c) 1999-2006 Intel Corporation.
[ 1.449594] e1000e: Intel(R) PRO/1000 Network Driver
[ 1.453240] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[ 1.457209] igb: Intel(R) Gigabit Ethernet Network Driver
[ 1.460663] igb: Copyright (c) 2007-2014 Intel Corporation.
[ 1.464205] hv_vmbus: registering driver hv_netvsc
[ 1.467344] usbcore: registered new interface driver usbserial_generic
[ 1.471189] usbserial: USB Serial support registered for generic
[ 1.474375] usbcore: registered new interface driver ftdi_sio
[ 1.477256] usbserial: USB Serial support registered for FTDI USB Serial Device
[ 1.481204] usbcore: registered new interface driver pl2303
[ 1.484183] usbserial: USB Serial support registered for pl2303
[ 1.487453] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[ 1.499286] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 1.502264] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 1.504538] hv_vmbus: registering driver hyperv_keyboard
[ 1.507426] mousedev: PS/2 mouse device common for all mice
[ 1.511406] rtc_cmos 00:03: RTC can wake from S4
[ 1.518277] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0
[ 1.522559] rtc_cmos 00:03: registered as rtc0
[ 1.525193] rtc_cmos 00:03: alarms up to one day, y3k, 242 bytes nvram
[ 1.529320] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@redhat.com
[ 1.534423] intel_pstate: CPU model not supported
[ 1.536827] sdhci: Secure Digital Host Controller Interface driver
[ 1.539808] sdhci: Copyright(c) Pierre Ossman
[ 1.542369] sdhci-pltfm: SDHCI platform and OF driver helper
[ 1.545375] hv_vmbus: registering driver hid_hyperv
[ 1.548305] usbcore: registered new interface driver usbhid
[ 1.550713] usbhid: USB HID core driver
[ 1.553299] hv_utils: Registering HyperV Utility Driver
[ 1.555587] hv_vmbus: registering driver hv_utils
[ 1.557763] hv_vmbus: registering driver hv_balloon
[ 1.560671] NET: Registered PF_INET6 protocol family
[ 1.570500] i801_smbus 0000:00:1f.3: Enabling SMBus device
[ 1.571328] Segment Routing with IPv6
[ 1.578745] In-situ OAM (IOAM) with IPv6
[ 1.579300] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[ 1.580582] NET: Registered PF_PACKET protocol family
[ 1.587668] Key type dns_resolver registered
[ 1.589223] i2c i2c-0: 1/1 memory slots populated (from DMI)
[ 1.590361] NET: Registered PF_VSOCK protocol family
[ 1.594265] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD
[ 1.738668] ata1: SATA link down (SStatus 0 SControl 300)
[ 1.762462] ata2: SATA link down (SStatus 0 SControl 300)
[ 1.765237] IPI shorthand broadcast: enabled
[ 1.776457] AVX2 version of gcm_enc/dec engaged.
[ 1.779278] ata5: SATA link down (SStatus 0 SControl 300)
[ 1.793462] ata3: SATA link down (SStatus 0 SControl 300)
[ 1.797599] ata4: SATA link down (SStatus 0 SControl 300)
[ 1.801286] ata6: SATA link down (SStatus 0 SControl 300)
[ 1.822198] sched_clock: Marking stable (1575025484, 247156914)->(2157590375, -335407977)
[ 1.826581] Loading compiled-in X.509 certificates
[ 1.885279] traps: modprobe[154] trap invalid opcode ip:7f9339ac0a22 sp:7ffd83c9c8b0 error:0 in ld-linux-x86-64.so.2[7f9339abb000+1f000]
[ 1.915292] traps: modprobe[155] trap invalid opcode ip:7fe2e15a9a22 sp:7ffc735a3f00 error:0 in ld-linux-x86-64.so.2[7fe2e15a4000+1f000]
[ 1.936632] invalid opcode: 0000 [#1] PREEMPT SMP
[ 1.940282] CPU: 6 PID: 152 Comm: cryptomgr_test Not tainted 6.6.35-yocto-tiny #1
[ 1.947955] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS 2024.02-3+tdx1.0 07/03/2024
[ 1.956789] RIP: 0010:aesni_gcm_init_avx_gen2+0x37/0x6e0
[ 1.962172] Code: 80 00 00 00 48 83 e4 c0 4d 89 cb 4c 89 5e 10 45 31 db 4c 89 5e 18 4c 89 5e 50 4c 89 5e 20 48 89 d0 f3 0f 6f 00 f3 0f 7f 46 30 e2 79 00 05 a0 ef c2 00 f3 0f 7f 46 40 c5 fa 6f 31 c4 e2 49 00
[ 1.978650] RSP: 0000:ffff888005ffb6c0 EFLAGS: 00010246
[ 1.982925] RAX: ffff888005ffba50 RBX: 0000000000000000 RCX: ffff888003d02030
[ 1.988418] RDX: ffff888005ffba50 RSI: ffff888005ffb860 RDI: ffff888003d02040
[ 1.993823] RBP: ffff888005ffb758 R08: ffff888003d44000 R09: 0000000000000000
[ 1.998813] R10: ffff888005ffba50 R11: 0000000000000000 R12: 00000000000002cf
[ 2.003764] R13: ffff888003d74850 R14: 0000000000000000 R15: ffffffff81a4a901
[ 2.008516] FS: 0000000000000000(0000) GS:ffff88807d180000(0000) knlGS:0000000000000000
[ 2.013725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2.017326] CR2: 00007f93399f8270 CR3: 0000000002614001 CR4: 00000000003706e0
[ 2.021671] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 2.025955] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
[ 2.030061] Call Trace:
[ 2.031526]
[ 2.032795] ? show_regs+0x58/0x5b
[ 2.034790] ? __die_body+0x1a/0x5a
[ 2.036850] ? __die+0x2a/0x2c
[ 2.038607] ? die+0x2e/0x48
[ 2.040259] ? do_trap+0x6d/0xcd
[ 2.042133] ? do_error_trap+0x67/0x83
[ 2.044349] ? aesni_gcm_init_avx_gen2+0x37/0x6e0
[ 2.046958] ? exc_invalid_op+0x4f/0x64
[ 2.050667] ? aesni_gcm_init_avx_gen2+0x37/0x6e0
[ 2.055306] ? asm_exc_invalid_op+0x1b/0x20
[ 2.059579] ? aesni_gcm_init_avx_gen2+0x37/0x6e0
[ 2.064236] ? skcipher_walk_next+0x368/0x447
[ 2.068664] ? scatterwalk_map+0x2f/0x55
[ 2.072667] ? skcipher_walk_next+0x368/0x447
[ 2.076948] ? skcipher_walk_done+0xe7/0x150
[ 2.080867] ? kernel_fpu_begin_mask+0x14/0x79
[ 2.084903] ? gcmaes_crypt_by_sg+0x1c1/0x312
[ 2.088785] ? gcmaes_encrypt+0x49/0x7b
[ 2.091946] ? generic_gcmaes_encrypt+0x56/0x58
[ 2.095671] ? crypto_aead_encrypt+0x15/0x1d
[ 2.099058] ? simd_aead_encrypt+0x64/0x6b
[ 2.102156] ? crypto_aead_encrypt+0x15/0x1d
[ 2.105371] ? test_aead_vec_cfg+0x3ff/0x7df
[ 2.108524] ? test_aead+0x84/0xab
[ 2.111415] ? test_aead+0x84/0xab
[ 2.113815] ? alg_test_aead+0xd7/0x115
[ 2.116530] ? alg_test+0x281/0x383
[ 2.118891] ? queued_spin_unlock+0x9/0xc
[ 2.121511] ? _raw_spin_unlock+0x9/0x19
[ 2.124053] ? __schedule+0x3bc/0x3cc
[ 2.126488] ? _raw_spin_unlock_irqrestore+0x17/0x20
[ 2.129607] ? crypto_acomp_scomp_free_ctx+0x1f/0x1f
[ 2.132627] ? cryptomgr_test+0x1f/0x3a
[ 2.134969] ? kthread+0xd2/0xda
[ 2.136961] ? kthread_complete_and_exit+0x1a/0x1a
[ 2.139811] ? ret_from_fork+0x22/0x37
[ 2.141965] ? kthread_complete_and_exit+0x1a/0x1a
[ 2.144727] ? ret_from_fork_asm+0x11/0x20
[ 2.147077]
[ 2.148361] Modules linked in:
[ 2.150224] ---[ end trace 0000000000000000 ]---
[ 2.153251] RIP: 0010:aesni_gcm_init_avx_gen2+0x37/0x6e0
[ 2.156354] Code: 80 00 00 00 48 83 e4 c0 4d 89 cb 4c 89 5e 10 45 31 db 4c 89 5e 18 4c 89 5e 50 4c 89 5e 20 48 89 d0 f3 0f 6f 00 f3 0f 7f 46 30 e2 79 00 05 a0 ef c2 00 f3 0f 7f 46 40 c5 fa 6f 31 c4 e2 49 00
[ 2.166278] RSP: 0000:ffff888005ffb6c0 EFLAGS: 00010246
[ 2.169232] RAX: ffff888005ffba50 RBX: 0000000000000000 RCX: ffff888003d02030
[ 2.173189] RDX: ffff888005ffba50 RSI: ffff888005ffb860 RDI: ffff888003d02040
[ 2.177223] RBP: ffff888005ffb758 R08: ffff888003d44000 R09: 0000000000000000
[ 2.180819] R10: ffff888005ffba50 R11: 0000000000000000 R12: 00000000000002cf
[ 2.184701] R13: ffff888003d74850 R14: 0000000000000000 R15: ffffffff81a4a901
[ 2.188219] FS: 0000000000000000(0000) GS:ffff88807d180000(0000) knlGS:0000000000000000
[ 2.192230] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 2.195197] CR2: 00007f93399f8270 CR3: 0000000002614001 CR4: 00000000003706e0
[ 2.198535] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 2.201825] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
[ 2.205374] note: cryptomgr_test[152] exited with preempt_count 1
[ 2.229179] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input2
```
(i added `-serial stdio` to the qemu command so i am able to see console messages when booting)
It appears this issue is specifically related to TDX, because if i remove the qemu option `confidential-guest-support=tdx` (a sub-option to `-machine`), the image boots successfully. It also boots successfully using `runqemu` command from within this repo on the same machine (but again, without TDX guest). I am also able to boot the ubuntu TDX images as described in the canonical tutorial and am able to generate TDX quotes etc.
I found a [similar error reported on the tiny core linux forum](https://forum.tinycorelinux.net/index.php/topic,2671.0.html) where the solution was to remove the `CONFIG_CRYPTO_CRC32C_INTEL` kernel config option. But i cannot see that option being specifically turned on anywhere in these scripts.
This happens on both the main branch of this repo, and when using the v3 branch following [the instructions in the PR notes](https://github.com/flashbots/yocto-manifests/pull/20#issue-2787306551) (which i understand uses a newer kernel version).
Output of lscpu on the host machine
```
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 57 bits virtual
Byte Order: Little Endian
CPU(s): 32
On-line CPU(s) list: 0-31
Vendor ID: GenuineIntel
Model name: INTEL(R) XEON(R) GOLD 5515+
CPU family: 6
Model: 207
Thread(s) per core: 2
Core(s) per socket: 8
Socket(s): 2
Stepping: 2
CPU(s) scaling MHz: 20%
CPU max MHz: 4100.0000
CPU min MHz: 800.0000
BogoMIPS: 6400.00
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc art
arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf tsc_known_freq pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xt
pr pdcm pcid dca sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault epb cat_l3 cat_l2 cdp_l3 tdx_ho
st_platform intel_ppin cdp_l2 ssbd mba ibrs ibpb stibp ibrs_enhanced tpr_shadow flexpriority ept vpid ept_ad fsgsbase tsc_adjust sgx bmi1 avx2 smep bmi2 erms invpcid
cqm rdt_a avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb intel_pt avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves cqm_llc cqm_occup_ll
c cqm_mbm_total cqm_mbm_local split_lock_detect user_shstk avx_vnni avx512_bf16 wbnoinvd dtherm ida arat pln pts hwp hwp_act_window hwp_epp hwp_pkg_req vnmi avx512vb
mi umip pku ospke waitpkg avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg tme avx512_vpopcntdq la57 rdpid bus_lock_detect cldemote movdiri movdir64b enqc
md sgx_lc fsrm md_clear serialize tsxldtrk pconfig arch_lbr ibt amx_bf16 avx512_fp16 amx_tile amx_int8 flush_l1d arch_capabilities
Virtualization features:
Virtualization: VT-x
Caches (sum of all):
L1d: 768 KiB (16 instances)
L1i: 512 KiB (16 instances)
L2: 32 MiB (16 instances)
L3: 45 MiB (2 instances)
NUMA:
NUMA node(s): 4
NUMA node0 CPU(s): 0-3,16-19
NUMA node1 CPU(s): 4-7,20-23
NUMA node2 CPU(s): 8-11,24-27
NUMA node3 CPU(s): 12-15,28-31
Vulnerabilities:
Gather data sampling: Not affected
Itlb multihit: Not affected
L1tf: Not affected
Mds: Not affected
Meltdown: Not affected
Mmio stale data: Not affected
Reg file data sampling: Not affected
Retbleed: Not affected
Spec rstack overflow: Not affected
Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl
Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization
Spectre v2: Mitigation; Enhanced / Automatic IBRS; IBPB conditional; RSB filling; PBRSB-eIBRS SW sequence; BHI BHI_DIS_S
Srbds: Not affected
Tsx async abort: Not affected
```
Has anyone else seen this problem? Thanks.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.