automl / automl/DACBench

Add Extensive Tests to Check Benchmarks

Open
#88 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
PDDL
Stars
39
Forks
19
PR merge metrics
No merged PRs in 30d

Description

Add extensive tests that check if the benchmarks are still performing as expected. These tests should only be executed after big changes or once in a while but not after each commit. Potentially in parallel on the cluster.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points. Start by locating the benchmark implementations and existing test or execution configuration, then determine how benchmark runs are triggered and what performance expectations can be measured. Done means an occasional, non-per-commit test suite that checks benchmark performance and defines whether parallel cluster execution is supported.

Written by the indexing model from the issue text.

Assessment

Domain
performance, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.