oxidecomputer / oxidecomputer/omicron

test failed in CI: test_cannot_finalize_attached_disk

Open
#7,696 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Test Flake
Dominant language
Rust
Stars
572
Forks
97
Avg merge
2d 12h
Merged PRs (30d)
96

Description

This test failed on a CI run on #7694:

https://github.com/oxidecomputer/omicron/pull/7694/checks?check_run_id=38012271038

Log showing the specific test failure:

https://buildomat.eng.oxide.computer/wg/0/details/01JN734YVEZME1PNMATCXRRQXD/3erHfmTYwkofsk15ME3OjiKsWt5oxg6uduuOlF94xnJSt0MD/01JN735NMSHHD9ZA8SVFWSVV3V

Excerpt from the log showing the failure:

7015	2025-02-28T21:18:19.247Z	running 1 test
7016	2025-02-28T21:18:19.247Z	sled b6d65341-167c-41df-9b5c-41cded99c229 successfully installed routes ResolvedVpcRouteSet { id: RouterId { vni: Vni(15600428), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }, version: None, routes: {} }
7017	2025-02-28T21:18:19.247Z	sled b6d65341-167c-41df-9b5c-41cded99c229 successfully installed routes ResolvedVpcRouteSet { id: RouterId { vni: Vni(15600428), kind: System }, version: Some(RouterVersion { router_id: 9626c381-85e4-4148-8ec0-7b3feee129c4, version: 3 }), routes: {ResolvedVpcRoute { dest: V6(Ipv6Net { addr: fdc8:9fc9:4af8::, width: 64 }), target: VpcSubnet(V6(Ipv6Net { addr: fdc8:9fc9:4af8::, width: 64 })) }, ResolvedVpcRoute { dest: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), target: VpcSubnet(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }, ResolvedVpcRoute { dest: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), target: InternetGateway(Instance(2e7d5fce-108d-4db9-81b2-8352b97a4a43)) }, ResolvedVpcRoute { dest: V6(Ipv6Net { addr: ::, width: 0 }), target: InternetGateway(Instance(2e7d5fce-108d-4db9-81b2-8352b97a4a43)) }} }
7018	2025-02-28T21:18:19.247Z	test integration_tests::pantry::test_cannot_finalize_attached_disk ... FAILED
7019	2025-02-28T21:18:19.247Z	
7020	2025-02-28T21:18:19.247Z	failures:
7021	2025-02-28T21:18:19.247Z	
7022	2025-02-28T21:18:19.247Z	failures:
7023	2025-02-28T21:18:19.247Z	    integration_tests::pantry::test_cannot_finalize_attached_disk
7024	2025-02-28T21:18:19.247Z	
7025	2025-02-28T21:18:19.248Z	test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 425 filtered out; finished in 37.90s
7026	2025-02-28T21:18:19.248Z	
7027	2025-02-28T21:18:19.248Z	──── STDERR:             omicron-nexus::test_all integration_tests::pantry::test_cannot_finalize_attached_disk
7028	2025-02-28T21:18:19.248Z	log file: /var/tmp/omicron_tmp/test_all-e287ef60b0239288-test_cannot_finalize_attached_disk.24248.0.log
7029	2025-02-28T21:18:19.248Z	note: configured to log to "/var/tmp/omicron_tmp/test_all-e287ef60b0239288-test_cannot_finalize_attached_disk.24248.0.log"
7030	2025-02-28T21:18:19.248Z	DB URL: postgresql://root@[::1]:35460/omicron?sslmode=disable
7031	2025-02-28T21:18:19.248Z	DB address: [::1]:35460
7032	2025-02-28T21:18:19.248Z	log file: /var/tmp/omicron_tmp/test_all-e287ef60b0239288-test_cannot_finalize_attached_disk.24248.2.log
7033	2025-02-28T21:18:19.248Z	note: configured to log to "/var/tmp/omicron_tmp/test_all-e287ef60b0239288-test_cannot_finalize_attached_disk.24248.2.log"
7034	2025-02-28T21:18:19.248Z	
7035	2025-02-28T21:18:19.248Z	thread 'integration_tests::pantry::test_cannot_finalize_attached_disk' panicked at sled-agent/src/sim/collection.rs:274:65:
7036	2025-02-28T21:18:19.248Z	called `Result::unwrap()` on an `Err` value: InternalError { internal_message: "Communication Error: error sending request for url (http://127.0.0.1:53359/vmms/66f85e20-04e6-4bcc-a690-b1171ee62c8b)" }
7037	2025-02-28T21:18:19.248Z	stack backtrace:
7038	2025-02-28T21:18:19.248Z	   0: rust_begin_unwind
7039	2025-02-28T21:18:19.248Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/std/src/panicking.rs:692:5
7040	2025-02-28T21:18:19.249Z	   1: core::panicking::panic_fmt
7041	2025-02-28T21:18:19.249Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/panicking.rs:75:14
7042	2025-02-28T21:18:19.249Z	   2: core::result::unwrap_failed
7043	2025-02-28T21:18:19.249Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/result.rs:1704:5
7044	2025-02-28T21:18:19.249Z	   3: unwrap<(), omicron_common::api::external::error::Error>
7045	2025-02-28T21:18:19.249Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/result.rs:1109:23
7046	2025-02-28T21:18:19.249Z	   4: {async_fn#0}<omicron_sled_agent::sim::instance::SimInstance>
7047	2025-02-28T21:18:19.249Z	             at /work/oxidecomputer/omicron/sled-agent/src/sim/collection.rs:274:13
7048	2025-02-28T21:18:19.249Z	   5: {async_fn#0}
7049	2025-02-28T21:18:19.249Z	             at /work/oxidecomputer/omicron/sled-agent/src/sim/sled_agent.rs:528:58
7050	2025-02-28T21:18:19.249Z	   6: {async_fn#0}
7051	2025-02-28T21:18:19.249Z	             at /work/oxidecomputer/omicron/sled-agent/src/sim/http_entrypoints.rs:773:38
7052	2025-02-28T21:18:19.249Z	   7: {async_block#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>, fn(dropshot::handler::RequestContext<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, dropshot::extractor::path::Path<sled_agent_api::VmmPathParam>) -> omicron_sled_agent::sim::http_entrypoints::{impl#1}::from::instance_poke_post::{async_fn_env#0}, omicron_sled_agent::sim::http_entrypoints::{impl#1}::from::instance_poke_post::{async_fn_env#0}, dropshot::handler::HttpResponseUpdatedNoContent, dropshot::error::HttpError, dropshot::extractor::path::Path<sled_agent_api::VmmPathParam>>
7053	2025-02-28T21:18:19.249Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/handler.rs:664:78
7054	2025-02-28T21:18:19.249Z	   8: poll<alloc::boxed::Box<(dyn core::future::future::Future<Output=core::result::Result<http::response::Response<dropshot::body::Body>, dropshot::handler::HandlerError>> + core::marker::Send), alloc::alloc::Global>>
7055	2025-02-28T21:18:19.249Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/future/future.rs:124:9
7056	2025-02-28T21:18:19.249Z	   9: {async_block#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>, fn(dropshot::handler::RequestContext<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, dropshot::extractor::path::Path<sled_agent_api::VmmPathParam>) -> omicron_sled_agent::sim::http_entrypoints::{impl#1}::from::instance_poke_post::{async_fn_env#0}, (dropshot::extractor::path::Path<sled_agent_api::VmmPathParam>), dropshot::handler::HttpResponseUpdatedNoContent>
7057	2025-02-28T21:18:19.250Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/handler.rs:785:16
7058	2025-02-28T21:18:19.250Z	  10: poll<alloc::boxed::Box<(dyn core::future::future::Future<Output=core::result::Result<http::response::Response<dropshot::body::Body>, dropshot::handler::HandlerError>> + core::marker::Send), alloc::alloc::Global>>
7059	2025-02-28T21:18:19.250Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/future/future.rs:124:9
7060	2025-02-28T21:18:19.250Z	  11: {async_block#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>
7061	2025-02-28T21:18:19.250Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:937:69
7062	2025-02-28T21:18:19.257Z	  12: tokio::runtime::task::core::Core<T,S>::poll::{{closure}}
7063	2025-02-28T21:18:19.258Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/task/core.rs:331:17
7064	2025-02-28T21:18:19.258Z	  13: with_mut<tokio::runtime::task::core::Stage<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>>, core::task::poll::Poll<()>, tokio::runtime::task::core::{impl#6}::poll::{closure_env#0}<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, alloc::sync::Arc<tokio::runtime::scheduler::current_thread::Handle, alloc::alloc::Global>>>
7065	2025-02-28T21:18:19.258Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/loom/std/unsafe_cell.rs:16:9
7066	2025-02-28T21:18:19.258Z	  14: poll<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, alloc::sync::Arc<tokio::runtime::scheduler::current_thread::Handle, alloc::alloc::Global>>
7067	2025-02-28T21:18:19.258Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/task/core.rs:320:13
7068	2025-02-28T21:18:19.258Z	  15: tokio::runtime::task::harness::poll_future::{{closure}}
7069	2025-02-28T21:18:19.258Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/task/harness.rs:532:19
7070	2025-02-28T21:18:19.258Z	  16: <core::panic::unwind_safe::AssertUnwindSafe<F> as core::ops::function::FnOnce<()>>::call_once
7071	2025-02-28T21:18:19.258Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/panic/unwind_safe.rs:272:9
7072	2025-02-28T21:18:19.259Z	  17: do_call<core::panic::unwind_safe::AssertUnwindSafe<tokio::runtime::task::harness::poll_future::{closure_env#0}<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, alloc::sync::Arc<tokio::runtime::scheduler::current_thread::Handle, alloc::alloc::Global>>>, core::task::poll::Poll<()>>
7073	2025-02-28T21:18:19.259Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/std/src/panicking.rs:584:40
7074	2025-02-28T21:18:19.259Z	  18: __rust_try
7075	2025-02-28T21:18:19.259Z	  19: try<core::task::poll::Poll<()>, core::panic::unwind_safe::AssertUnwindSafe<tokio::runtime::task::harness::poll_future::{closure_env#0}<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, alloc::sync::Arc<tokio::runtime::scheduler::current_thread::Handle, alloc::alloc::Global>>>>
7076	2025-02-28T21:18:19.259Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/std/src/panicking.rs:547:19
7077	2025-02-28T21:18:19.259Z	  20: catch_unwind<core::panic::unwind_safe::AssertUnwindSafe<tokio::runtime::task::harness::poll_future::{closure_env#0}<dropshot::server::http_request_handle::{async_fn#0}::{async_block_env#0}<alloc::sync::Arc<omicron_sled_agent::sim::sled_agent::SledAgent, alloc::alloc::Global>>, alloc::sync::Arc<tokio::runtime::scheduler::current_thread::Handle, alloc::alloc::Global>>>, core::task::poll::Poll<()>>
7078	2025-02-28T21:18:19.259Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/std/src/panic.rs:358:14
7079	2025-02-28T21:18:19.259Z	  21: tokio::runtime::task::harness::poll_future
7080	2025-02-28T21:18:19.259Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/task/harness.rs:520:18
7081	2025-02-28T21:18:19.259Z	  22: tokio::runtime::task::harness::Harness<T,S>::poll_inner
7082	2025-02-28T21:18:19.259Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/task/harness.rs:209:27
7083	2025-02-28T21:18:19.260Z	  23: tokio::runtime::task::harness::Harness<T,S>::poll
7084	2025-02-28T21:18:19.260Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/task/harness.rs:154:15
7085	2025-02-28T21:18:19.260Z	  24: tokio::runtime::task::raw::poll
7086	2025-02-28T21:18:19.260Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/task/raw.rs:271:5
7087	2025-02-28T21:18:19.260Z	  25: tokio::runtime::task::raw::RawTask::poll
7088	2025-02-28T21:18:19.260Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/task/raw.rs:201:18
7089	2025-02-28T21:18:19.260Z	  26: tokio::runtime::task::LocalNotified<S>::run
7090	2025-02-28T21:18:19.260Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/task/mod.rs:449:9
7091	2025-02-28T21:18:19.260Z	  27: tokio::runtime::scheduler::current_thread::CoreGuard::block_on::{{closure}}::{{closure}}
7092	2025-02-28T21:18:19.260Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:770:25
7093	2025-02-28T21:18:19.260Z	  28: with_budget<(), tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure#0}::{closure_env#1}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>>
7094	2025-02-28T21:18:19.260Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/coop.rs:107:5
7095	2025-02-28T21:18:19.260Z	  29: budget<(), tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure#0}::{closure_env#1}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>>
7096	2025-02-28T21:18:19.261Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/coop.rs:73:5
7097	2025-02-28T21:18:19.261Z	  30: {closure#0}<(), tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure#0}::{closure_env#1}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>>
7098	2025-02-28T21:18:19.261Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:364:43
7099	2025-02-28T21:18:19.261Z	  31: tokio::runtime::scheduler::current_thread::Context::enter
7100	2025-02-28T21:18:19.261Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:428:19
7101	2025-02-28T21:18:19.261Z	  32: tokio::runtime::scheduler::current_thread::Context::run_task
7102	2025-02-28T21:18:19.261Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:364:23
7103	2025-02-28T21:18:19.261Z	  33: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>
7104	2025-02-28T21:18:19.261Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:769:35
7105	2025-02-28T21:18:19.261Z	  34: tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}
7106	2025-02-28T21:18:19.261Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:807:68
7107	2025-02-28T21:18:19.261Z	  35: tokio::runtime::context::scoped::Scoped<T>::set
7108	2025-02-28T21:18:19.261Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context/scoped.rs:40:9
7109	2025-02-28T21:18:19.261Z	  36: tokio::runtime::context::set_scheduler::{{closure}}
7110	2025-02-28T21:18:19.262Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context.rs:180:26
7111	2025-02-28T21:18:19.262Z	  37: try_with<tokio::runtime::context::Context, tokio::runtime::context::set_scheduler::{closure_env#0}<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>), tokio::runtime::scheduler::current_thread::{impl#8}::enter::{closure_env#0}<tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>, core::option::Option<()>>>, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>)>
7112	2025-02-28T21:18:19.262Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/std/src/thread/local.rs:308:12
7113	2025-02-28T21:18:19.262Z	  38: std::thread::local::LocalKey<T>::with
7114	2025-02-28T21:18:19.262Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/std/src/thread/local.rs:272:9
7115	2025-02-28T21:18:19.262Z	  39: tokio::runtime::context::set_scheduler
7116	2025-02-28T21:18:19.262Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context.rs:180:9
7117	2025-02-28T21:18:19.262Z	  40: tokio::runtime::scheduler::current_thread::CoreGuard::enter
7118	2025-02-28T21:18:19.262Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:807:27
7119	2025-02-28T21:18:19.262Z	  41: tokio::runtime::scheduler::current_thread::CoreGuard::block_on
7120	2025-02-28T21:18:19.262Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:716:19
7121	2025-02-28T21:18:19.262Z	  42: {closure#0}<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7122	2025-02-28T21:18:19.263Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:196:28
7123	2025-02-28T21:18:19.263Z	  43: tokio::runtime::context::runtime::enter_runtime
7124	2025-02-28T21:18:19.263Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context/runtime.rs:65:16
7125	2025-02-28T21:18:19.263Z	  44: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7126	2025-02-28T21:18:19.263Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:184:9
7127	2025-02-28T21:18:19.263Z	  45: tokio::runtime::runtime::Runtime::block_on_inner
7128	2025-02-28T21:18:19.263Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/runtime.rs:368:47
7129	2025-02-28T21:18:19.264Z	  46: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7130	2025-02-28T21:18:19.264Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/runtime.rs:342:13
7131	2025-02-28T21:18:19.264Z	  47: test_cannot_finalize_attached_disk
7132	2025-02-28T21:18:19.264Z	             at ./tests/integration_tests/pantry.rs:823:1
7133	2025-02-28T21:18:19.264Z	  48: test_all::integration_tests::pantry::test_cannot_finalize_attached_disk::{{closure}}
7134	2025-02-28T21:18:19.264Z	             at ./tests/integration_tests/pantry.rs:826:2
7135	2025-02-28T21:18:19.264Z	  49: core::ops::function::FnOnce::call_once
7136	2025-02-28T21:18:19.264Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/ops/function.rs:250:5
7137	2025-02-28T21:18:19.264Z	  50: core::ops::function::FnOnce::call_once
7138	2025-02-28T21:18:19.264Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/ops/function.rs:250:5
7139	2025-02-28T21:18:19.264Z	note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
7140	2025-02-28T21:18:19.264Z	
7141	2025-02-28T21:18:19.264Z	thread 'integration_tests::pantry::test_cannot_finalize_attached_disk' panicked at clients/sled-agent-client/src/lib.rs:379:14:
7142	2025-02-28T21:18:19.265Z	instance_finish_transition() failed unexpectedly: reqwest::Error { kind: Request, url: "http://[::1]:39722/vmms/66f85e20-04e6-4bcc-a690-b1171ee62c8b/poke", source: hyper_util::client::legacy::Error(SendRequest, hyper::Error(IncompleteMessage)) }
7143	2025-02-28T21:18:19.265Z	stack backtrace:
7144	2025-02-28T21:18:19.265Z	   0: rust_begin_unwind
7145	2025-02-28T21:18:19.265Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/std/src/panicking.rs:692:5
7146	2025-02-28T21:18:19.265Z	   1: core::panicking::panic_fmt
7147	2025-02-28T21:18:19.265Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/panicking.rs:75:14
7148	2025-02-28T21:18:19.265Z	   2: core::result::unwrap_failed
7149	2025-02-28T21:18:19.265Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/result.rs:1704:5
7150	2025-02-28T21:18:19.266Z	   3: core::result::Result<T,E>::expect
7151	2025-02-28T21:18:19.266Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/result.rs:1061:23
7152	2025-02-28T21:18:19.266Z	   4: {async_block#0}
7153	2025-02-28T21:18:19.266Z	             at /work/oxidecomputer/omicron/clients/sled-agent-client/src/lib.rs:375:9
7154	2025-02-28T21:18:19.266Z	   5: poll<alloc::boxed::Box<(dyn core::future::future::Future<Output=()> + core::marker::Send), alloc::alloc::Global>>
7155	2025-02-28T21:18:19.266Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/future/future.rs:124:9
7156	2025-02-28T21:18:19.266Z	   6: {async_fn#0}
7157	2025-02-28T21:18:19.266Z	             at ./tests/integration_tests/pantry.rs:96:62
7158	2025-02-28T21:18:19.266Z	   7: {async_fn#0}
7159	2025-02-28T21:18:19.266Z	             at ./tests/integration_tests/pantry.rs:161:44
7160	2025-02-28T21:18:19.266Z	   8: {async_fn#0}
7161	2025-02-28T21:18:19.267Z	             at ./tests/integration_tests/pantry.rs:845:74
7162	2025-02-28T21:18:19.272Z	   9: {async_block#0}
7163	2025-02-28T21:18:19.272Z	             at ./tests/integration_tests/pantry.rs:823:1
7164	2025-02-28T21:18:19.272Z	  10: poll<&mut dyn core::future::future::Future<Output=()>>
7165	2025-02-28T21:18:19.272Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/future/future.rs:124:9
7166	2025-02-28T21:18:19.272Z	  11: poll<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7167	2025-02-28T21:18:19.272Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/future/future.rs:124:9
7168	2025-02-28T21:18:19.272Z	  12: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>
7169	2025-02-28T21:18:19.273Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:729:57
7170	2025-02-28T21:18:19.273Z	  13: with_budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>>
7171	2025-02-28T21:18:19.273Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/coop.rs:107:5
7172	2025-02-28T21:18:19.273Z	  14: budget<core::task::poll::Poll<()>, tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure#0}::{closure#0}::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>>
7173	2025-02-28T21:18:19.273Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/coop.rs:73:5
7174	2025-02-28T21:18:19.273Z	  15: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>
7175	2025-02-28T21:18:19.273Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:729:25
7176	2025-02-28T21:18:19.273Z	  16: tokio::runtime::scheduler::current_thread::Context::enter
7177	2025-02-28T21:18:19.273Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:428:19
7178	2025-02-28T21:18:19.273Z	  17: {closure#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>
7179	2025-02-28T21:18:19.273Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:728:36
7180	2025-02-28T21:18:19.273Z	  18: tokio::runtime::scheduler::current_thread::CoreGuard::enter::{{closure}}
7181	2025-02-28T21:18:19.274Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:807:68
7182	2025-02-28T21:18:19.274Z	  19: tokio::runtime::context::scoped::Scoped<T>::set
7183	2025-02-28T21:18:19.274Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context/scoped.rs:40:9
7184	2025-02-28T21:18:19.274Z	  20: tokio::runtime::context::set_scheduler::{{closure}}
7185	2025-02-28T21:18:19.274Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context.rs:180:26
7186	2025-02-28T21:18:19.274Z	  21: try_with<tokio::runtime::context::Context, tokio::runtime::context::set_scheduler::{closure_env#0}<(alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>), tokio::runtime::scheduler::current_thread::{impl#8}::enter::{closure_env#0}<tokio::runtime::scheduler::current_thread::{impl#8}::block_on::{closure_env#0}<core::pin::Pin<&mut core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>>, core::option::Option<()>>>, (alloc::boxed::Box<tokio::runtime::scheduler::current_thread::Core, alloc::alloc::Global>, core::option::Option<()>)>
7187	2025-02-28T21:18:19.274Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/std/src/thread/local.rs:308:12
7188	2025-02-28T21:18:19.274Z	  22: std::thread::local::LocalKey<T>::with
7189	2025-02-28T21:18:19.274Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/std/src/thread/local.rs:272:9
7190	2025-02-28T21:18:19.274Z	  23: tokio::runtime::context::set_scheduler
7191	2025-02-28T21:18:19.274Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context.rs:180:9
7192	2025-02-28T21:18:19.274Z	  24: tokio::runtime::scheduler::current_thread::CoreGuard::enter
7193	2025-02-28T21:18:19.275Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:807:27
7194	2025-02-28T21:18:19.275Z	  25: tokio::runtime::scheduler::current_thread::CoreGuard::block_on
7195	2025-02-28T21:18:19.275Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:716:19
7196	2025-02-28T21:18:19.275Z	  26: {closure#0}<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7197	2025-02-28T21:18:19.275Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:196:28
7198	2025-02-28T21:18:19.275Z	  27: tokio::runtime::context::runtime::enter_runtime
7199	2025-02-28T21:18:19.275Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/context/runtime.rs:65:16
7200	2025-02-28T21:18:19.275Z	  28: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7201	2025-02-28T21:18:19.275Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/scheduler/current_thread/mod.rs:184:9
7202	2025-02-28T21:18:19.275Z	  29: tokio::runtime::runtime::Runtime::block_on_inner
7203	2025-02-28T21:18:19.275Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/runtime.rs:368:47
7204	2025-02-28T21:18:19.276Z	  30: block_on<core::pin::Pin<&mut dyn core::future::future::Future<Output=()>>>
7205	2025-02-28T21:18:19.276Z	             at /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/tokio-1.43.0/src/runtime/runtime.rs:342:13
7206	2025-02-28T21:18:19.276Z	  31: test_cannot_finalize_attached_disk
7207	2025-02-28T21:18:19.276Z	             at ./tests/integration_tests/pantry.rs:823:1
7208	2025-02-28T21:18:19.276Z	  32: test_all::integration_tests::pantry::test_cannot_finalize_attached_disk::{{closure}}
7209	2025-02-28T21:18:19.276Z	             at ./tests/integration_tests/pantry.rs:826:2
7210	2025-02-28T21:18:19.276Z	  33: core::ops::function::FnOnce::call_once
7211	2025-02-28T21:18:19.276Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/ops/function.rs:250:5
7212	2025-02-28T21:18:19.276Z	  34: core::ops::function::FnOnce::call_once
7213	2025-02-28T21:18:19.276Z	             at /rustc/4d91de4e48198da2e33413efdcd9cd2cc0c46688/library/core/src/ops/function.rs:250:5

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with integration_tests::pantry::test_cannot_finalize_attached_disk and the CI log linked in the issue. Inspect sled-agent/src/sim/collection.rs:274 and the related simulated sled-agent call path to understand the communication error. Done means the test no longer fails with the unwrap panic in CI.

Written by the indexing model from the issue text.

Assessment

Tech stack
postgresql, rust
Domain
backend, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.