llnl / llnl/benchpark

Benchpark CDash Dashboard Improvements

Open
#751 0 comments 0 reactions 1 assignee View on GitHub

@michaelmckinsey1 is already working on this.

Since May 5, 2025.

Dominant language
Python
Stars
78
Forks
52
Avg merge
4d 19m
Merged PRs (30d)
10

Description

The following are improvements we can make to our dashboard https://my.cdash.org/index.php?project=Benchpark
- [ ] Add link to gitlab test on cdash test page so we don't need to manually look it up
- [ ] Getting experiment output on the dashboard. Must be careful not to include certain gitlab output from the host, as it may break policy.
- [ ] Include build output in build step? (Maybe not - path output from build error may break policy)
- [ ] Measuring accurate test run-time on dashboard. Currently the time being measured is automated to be the `cmake -E true/false`, which is misleading.
- [ ] Can we customize the configure and build steps? benchpark init -> configure, ramble setup -> build. Careful as output from these could break policy.
- ~Add Github dryruns? Maybe should be its own table, as there would be many rows.~ This would be too noisy and we already have this information contained on the PRs
- ~Add pytest? Probably only add these to nightly, would be one row, showing `p` passed tests and `f` failed tests, instead of 1 or 0 like the gitlab tests.~ This would be too noisy and we already have this information contained on the PRs

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.