haskell / haskell/criterion

Add option to run benchmarks until a certain precision is reached.

Open
#193 0 comments 0 reactions 0 assignees View on GitHub
Enhancement
Dominant language
Haskell
Stars
523
Forks
89
PR merge metrics
No merged PRs in 30d

Description

For some benchmarks I currently use `-L` to get accurate measurements.

In a perfect world I would rather specify run until you are 95% confident that the measured time is within +/-X% of the given value. Where I can specify both the confidence Intervall and the range.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named in the issue. Begin by locating how benchmark duration and the -L option are handled, then clarify the statistical definition of confidence and range; done means an option can stop runs when the requested precision is reached.

Written by the indexing model from the issue text.

Assessment

Tech stack
haskell
Domain
performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.