Propolis panic during attestation::server::AttestationSockInit::run

BRM13250012 # mdb /pool/ext/5c1cf4d3-af0c-48c2-92d0-1308a8dd9787/crypt/debug/core.oxz_propolis-server_81324c5c-2195-4dbb-a378-d80260096d3a.propolis-server.20163.1786740365
Loading modules: [ libumem.so.1 libnvpair.so.1 libc.so.1 ld.so.1 ]
> ::status
debugging core file of propolis-server (64-bit) from oxz_propolis-server_81324c5c-2195-4dbb-a378-d80260096d3a
initial argv: /opt/oxide/propolis-server/bin/propolis-server run /opt/oxide/propolis-server/b
threading model: native threads
status: process terminated by SIGABRT (Abort), pid=20163 uid=0 code=-1
> $C ! demangle
fffffc7febfff510 libc.so.1`_lwp_kill+0xa()
fffffc7febfff540 libc.so.1`raise+0x22(6)
fffffc7febfff590 libc.so.1`abort+0x58()
fffffc7febfff5a0 ~std::sys::pal::unix::abort_internal::h515b31030a784ec5+8()
fffffc7febfff5b0 ~std::process::abort::h263ae6dd5f7f06e2+8()
fffffc7febfff5c0 ~__rustc::__rust_abort+8()
fffffc7febfff5d0 ~__rustc::__rust_start_panic+8()
fffffc7febfff630 __rustc::rust_panic+0xd()
fffffc7febfff6f0 std::panicking::rust_panic_with_hook::h24c1a837a734501c+0x224()
fffffc7febfff730 std::panicking::begin_panic_handler::{{closure}}::hebb980b0c684b90d+0x98()
fffffc7febfff740 ~std::sys::backtrace::__rust_end_short_backtrace::h4b651dba38b6cba9+8()
fffffc7febfff770 ~__rustc::rust_begin_unwind+0x1b()
fffffc7febfff7a0 ~core::panicking::panic_fmt::h717aa56ae600c892+0x1e()
fffffc7febfffa00 propolis::attestation::server::AttestationSockInit::run::_$u7b$$u7b$closure$u7d$$u7d$::hb1189cc8c324654a (.llvm.13310387864569553353)+0x1170()
fffffc7febfffa60 tokio::runtime::task::core::Core<T,S>::poll::hae3228d446fe73c1+0x3b()
fffffc7febfffac0 tokio::runtime::task::harness::Harness<T,S>::poll::h0ab8dca06a61406c+0x5d()
fffffc7febfffb30 tokio::runtime::scheduler::multi_thread::worker::Context::run_task::h67382f17581679ef+0x13f()
fffffc7febfffbe0 tokio::runtime::scheduler::multi_thread::worker::Context::run::h335ce8d4e7a8b739+0xd4e()
fffffc7febfffc40 tokio::runtime::context::scoped::Scoped<T>::set::h2e97d4023e4a9c76+0x2a()
fffffc7febfffd00 tokio::runtime::context::runtime::enter_runtime::hf0a1384b6ad372b4+0x1d3()
fffffc7febfffd40 tokio::runtime::scheduler::multi_thread::worker::run::h5df183d7b15078b3+0xa0()
fffffc7febfffda0 tokio::runtime::task::core::Core<T,S>::poll::h02602221e7261b24+0x70()
fffffc7febfffe00 tokio::runtime::task::harness::Harness<T,S>::poll::hafa3514f905b5d5e+0xad()
fffffc7febfffee0 std::sys::backtrace::__rust_begin_short_backtrace::ha71a0bd7be9cc4f4+0x166()
fffffc7febffff80 core::ops::function::FnOnce::call_once{{vtable.shim}}::hfe3008b97a8d8f16+0xa8()
fffffc7febffffb0 std::sys::pal::unix::thread::Thread::new::thread_start::h128a92fdf19e3e8a+0x2f()
fffffc7febffffe0 libc.so.1`_thrp_setup+0x77(fffffc7fee414240)
fffffc7febfffff0 libc.so.1`_lwp_start()

The core file is in /staff/core/propolis-1203.

Start by loading /staff/core/propolis-1203 with mdb and inspect the AttestationSockInit::run frame shown in the backtrace. Trace the attestation server path leading to the panic and use the available core evidence to identify the triggering condition. Done means the cause is understood and the panic is resolved or handled without aborting propolis-server.