chaoss / chaoss/CollectOSS

stop the smoke tests from being flaky

Open
#164 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
13
Forks
17
Avg merge
6h 59m
Merged PRs (30d)
1

Description

> [!NOTE]
> Migrated from [augurlabs/augur#3527](https://github.com/augurlabs/augur/issues/3527)
> Originally opened by `@MoralCode` on 2026-01-07

---

Right now the smoke tests (labeled as end to end tests, one for docker one for podman) are designed to run augur from docker for 3 minutes and parse the output looking for specific lines in the log to validate that it starts correctly.

This generally works, but sometimes the github action fails for no application-based reason (no exception etc) and a subsequent rerun usually passes.

Based on the logs, i suspect that, sometimes, the docker container just ends up taking a little too long to close down or something after it is told to stop, causing it to exceed a timeout (probably githubs side but could be our 3 min timeout), causing a job failure

We should find why this happens and fix it so the smoke tests no longer need occasional reruns to do their job (i.e. no phantom failures)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.