oxidecomputer / oxidecomputer/hubris

`SW1` on `london` stuck in thermal shutdown

Open
#2,060 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Rust
Stars
3.6k
Forks
239
Avg merge
1d 12h
Merged PRs (30d)
23

Description

As reported in various places in chat. Since the FPGA handles the Tofino sequencing and can survive SP reset, we've had bugs in the past where the SP and FPGA get out of sync with one another and do not recover properly. We expect that may have been the case here somehow but could not verify that since the production images don't have udprpc, rendering hiffy unusable in this context.

I've flashed the v1.0.37 dev image on this switch (which has udprpc) so we can debug further if it reproduces.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the earlier synchronization issue in PR 1763 and the supplied sidecar-b dev image, which includes udprpc. If the failure reproduces on SW1, use udprpc and hiffy to investigate whether the SP and FPGA are out of sync. Done means the failure is reproduced or ruled out and the findings or recovery path are recorded.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
embedded-iot
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.