oxidecomputer / oxidecomputer/omicron

snapshot create internal server error when using packer to create image

Open
#11,265 9 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Rust
Stars
572
Forks
97
Avg merge
2d 12h
Merged PRs (30d)
96

Description

I use the Oxide packer-plugin to create vw images. This has been working for a while now. But recently I've started hitting 500s on the snapshot create step.

The following is from a build on rack3, so I do not have access to the logs, perhaps @augustuswm does?

==> oxide-instance.vivado: Clearing shell history
==> oxide-instance.vivado: Cleanup complete
==> oxide-instance.vivado: Provisioning with shell script: /tmp/packer-shell2176865329
==> oxide-instance.vivado: Stopping Oxide instance
==> oxide-instance.vivado: Waiting for Oxide instance to stop: Currently stopping.
==> oxide-instance.vivado: Waiting for Oxide instance to stop: Currently stopping.
==> oxide-instance.vivado: Waiting for Oxide instance to stop: Currently stopping.
==> oxide-instance.vivado: Waiting for Oxide instance to stop: Currently stopping.
==> oxide-instance.vivado: Waiting for Oxide instance to stop: Currently stopping.
==> oxide-instance.vivado: Oxide instance is stopped.
==> oxide-instance.vivado: Creating Oxide snapshot
==> oxide-instance.vivado: Failed creating Oxide snapshot.
==> oxide-instance.vivado: Provisioning step had errors: Running the cleanup provisioner, if present...
==> oxide-instance.vivado: Checking if Oxide instance is stopped: 0e61626f-b3eb-44e8-aa83-217dba26b1c8
==> oxide-instance.vivado: Deleting Oxide instance: 0e61626f-b3eb-44e8-aa83-217dba26b1c8
==> oxide-instance.vivado: Deleting Oxide disk: 79c872d6-b47b-472b-8bc4-92423117d3e4
==> oxide-instance.vivado: Deleting Oxide SSH public key: aa0b9e1d-a99f-4eae-8397-442a869def9d
Build 'oxide-instance.vivado' errored after 33 minutes 53 seconds: POST https://oxide.sys.r3.oxide-preview.com/v1/snapshots?project=vw-beta
----------- RESPONSE -----------
Status: 500 Internal
Message: Internal Server Error
RequestID: 8f51f70b-770c-4642-8896-5b543d9e4a55
------- RESPONSE HEADERS -------
Content-Type: [application/json]
X-Request-Id: [8f51f70b-770c-4642-8896-5b543d9e4a55]
Date: [Wed, 09 Sep 2026 06:43:58 GMT]
Content-Length: [124]

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the snapshot-create API request at POST /v1/snapshots and use request ID 8f51f70b-770c-4642-8896-5b543d9e4a55 to locate the server-side failure. Reproduce the Packer image workflow if possible and inspect the relevant service logs; done means the snapshot step no longer returns an unexplained 500.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
api, backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.