Add nightly comparison testing with key images
- Dominant language
- Go
- Stars
- 9.6k
- Forks
- 954
- Avg merge
- 23h 27m
- Merged PRs (30d)
- 48
Description
It would be ideal to collect a key set of docker images and run comparison testing on the results against a known good result nightly. Today we do this in the acceptance pipeline, however, the target JSONs are checked directly into the repo, which will not work with larger results without preprocessing to prune the results to only what needs to be compared (type-name-version).
Contributor guide
Research direction
Start by reviewing the acceptance pipeline and the checked-in target JSONs mentioned in the issue. Define how the key Docker image set and nightly comparison should work, including preprocessing results to type-name-version; done means larger results can be compared against known-good outputs without storing unpruned targets.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- docker, go
- Domain
- ci-cd, testing
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100