PR CIs do not fail if the benchmark doesn't exist
Open
- Dominant language
- Python
- Stars
- 1.2k
- Forks
- 302
- PR merge metrics
- No merged PRs in 30d
Description
Discovered by @addisoncrump: https://github.com/google/fuzzbench/pull/2032#discussion_r1722393965
A more informative alternative is to let the CI fail and report 'the benchmark does not exist' to avoid misleading the user and inform us to remove/update CI.
Contributor guide
Assessment
This issue has not been assessed yet.