anchore / anchore/syft

Add nightly comparison testing with key images

Open
#358 0 comments 0 reactions 0 assignees View on GitHub
enhancement testing
Dominant language
Go
Stars
9.6k
Forks
954
Avg merge
23h 27m
Merged PRs (30d)
48

Description

It would be ideal to collect a key set of docker images and run comparison testing on the results against a known good result nightly. Today we do this in the acceptance pipeline, however, the target JSONs are checked directly into the repo, which will not work with larger results without preprocessing to prune the results to only what needs to be compared (type-name-version).

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the acceptance pipeline and the checked-in target JSONs mentioned in the issue. Define how the key Docker image set and nightly comparison should work, including preprocessing results to type-name-version; done means larger results can be compared against known-good outputs without storing unpruned targets.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, go
Domain
ci-cd, testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.