benchmark-action / benchmark-action/github-action-benchmark

Unable to compare summary results against specific ref: instead of previous ref

Open
#281 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
1.3k
Forks
184
PR merge metrics
No merged PRs in 30d

Description

I was trying to implement this one:https://github.com/benchmark-action/github-action-benchmark/pull/163 where I want to compare and display the results of the current commit to the results of commit ID: 9f43c15bbe42c350f93bd7494d2918974f1963b1 instead of the Previous commit (607222ae0d077886ea469a720865ec9cc56a77fe) in the summary part of the perf workflow.

I just added "ref:" at the bottom of it.

Maybe PR 163 is not actually implementing this and it isn't possible to do what I want it to do.

This is on the summary page:
Benchmark suite | Current: 612f42b21f8b6347229a05032e451dddfd3823c8 | Previous: 607222ae0d077886ea469a720865ec9cc56a77fe | Ratio
-- | -- | -- | --
BDN.benchmark.Operations.BasicOperations.InlinePing(Params: ACL) | 1748.2839510599772 ns (± 15.153228689520862) | 1817.795346069336 ns (± 11.748397682141338) | 0.96

My YML code:

```
# Run `github-action-benchmark` action for the Continuous Benchmarking Charts (https://microsoft.github.io/garnet/charts/)
- name: Store benchmark result for charts
uses: benchmark-action/github-action-benchmark@v1
with:
name: ${{matrix.test}} (${{matrix.os}} ${{matrix.framework}} ${{matrix.configuration}})
tool: 'benchmarkdotnet'
output-file-path: ./test/BDNPerfTests/BenchmarkDotNet.Artifacts/results/BDN.benchmark.${{ matrix.test }}-report-full-compressed.json
github-token: ${{ secrets.GITHUB_TOKEN }}
summary-always: true
gh-pages-branch: 'continuousbenchmark'
benchmark-data-dir-path: 'website/static/charts'
auto-push: true
max-items-in-chart: 50
ref: 9f43c15bbe42c350f93bd7494d2918974f1963b1

```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.