awslabs / awslabs/shuttle

Test suite is flaky (racy?)

Open
#284 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
1.1k
Forks
59
Avg merge
4d 2h
Merged PRs (30d)
15

Description

Eg. https://github.com/awslabs/shuttle/actions/runs/25028936551/job/73306194391?pr=279.

Test suite is flaky. I wonder if it is due to test inference. We can look into it and try to fix it, or we can swap over to using cargo nextest (which I think we should do anyways)

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the failure from the linked GitHub Actions job and inspect whether test inference is involved. Compare the current test runner with cargo nextest; done means the flakiness is explained and fixed, or the suite is migrated if that is the chosen resolution.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.