benchmark-action / benchmark-action/github-action-benchmark

Allow specifying alerts on metrics different than CPU

Open
#206 3 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
TypeScript
Stars
1.3k
Forks
184
PR merge metrics
No merged PRs in 30d

Description

Currently, when specifying the alert threshold e.g. `alert-threshold: '200%'` we cannot specify the metric which we want to alert on.

For instance Go toolchain reports the following metrics:

- ns per benchmark
- Bytes allocated per benchmark
- allocations per benchmark

This action compares the first metric - ns per benchmark - which might be flaky e.g. on some CI systems.

This issue is a feature request to allow alerts on different metrics.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.