bytecodealliance / bytecodealliance/sightglass

ci: rebuilding the benchmarks should check for reproducibility

Open
#210 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
WebAssembly
Stars
88
Forks
37
Avg merge
5h 5m
Merged PRs (30d)
1

Description

The point of the `rebuild` CI task is to ensure that we can reliably reproduce the benchmarks included with Sightglass. IIRC, there was a time when that task checked if the benchmark output had changed, e.g., with `git diff --exit-code`. That check is no longer in place but I believe it should be re-added so we can more confidently claim that we have reproducible benchmark builds.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.