bytecodealliance / bytecodealliance/sightglass

Allow `summarize` to aggregate multiple benchmarks into one score

Open
#180 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
WebAssembly
Stars
88
Forks
37
Avg merge
5h 5m
Merged PRs (30d)
1

Description

When measuring more than one benchmark, it would be nice to be able to aggregate the results into a single score. One common way to do this is to take the geometric mean of a set of results. This issue proposes adding a `--aggregate-benchmarks` flag to do exactly this. When enabled, `sightglass-cli summarize --aggregate-benchmarks` would emit a single, "aggregated by geomean" result for each of the phases using ``, e.g., for the benchmark column.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.