Add option to run benchmarks until a certain precision is reached.
Open
Enhancement
- Dominant language
- Haskell
- Stars
- 523
- Forks
- 89
- PR merge metrics
- No merged PRs in 30d
Description
For some benchmarks I currently use `-L` to get accurate measurements.
In a perfect world I would rather specify run until you are 95% confident that the measured time is within +/-X% of the given value. Where I can specify both the confidence Intervall and the range.
Contributor guide
No contributing guide indexed for this repository
Research direction
No files, tests, or entry points are named in the issue. Begin by locating how benchmark duration and the -L option are handled, then clarify the statistical definition of confidence and range; done means an option can stop runs when the requested precision is reached.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- haskell
- Domain
- performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100