Add Extensive Tests to Check Benchmarks
- Dominant language
- PDDL
- Stars
- 39
- Forks
- 19
- PR merge metrics
- No merged PRs in 30d
Description
Add extensive tests that check if the benchmarks are still performing as expected. These tests should only be executed after big changes or once in a while but not after each commit. Potentially in parallel on the cluster.
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no files, tests, or entry points. Start by locating the benchmark implementations and existing test or execution configuration, then determine how benchmark runs are triggered and what performance expectations can be measured. Done means an occasional, non-per-commit test suite that checks benchmark performance and defines whether parallel cluster execution is supported.
Written by the indexing model from the issue text.
Assessment
- Domain
- performance, testing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100