haskell / haskell/criterion

Documentation: guidelines for interpreting R^2 and stddev

Open
#106 1 comment 0 reactions 0 assignees View on GitHub
Documentation
Dominant language
Haskell
Stars
523
Forks
89
PR merge metrics
No merged PRs in 30d

Description

In running the ~2000 criterion benchmarks currently on stackage, we've run into the problem that some of them are _clearly_ nonlinear.

We are trying to develop a data cleaning step which will throw these out before comparing two different runs of the full benchmark set. Once we find good thresholds, I would like to put some guidelines together to share these with criterion users.

This goes along with other documentation updates, e.g. #92 and #95.

CC @RyanGlScott @vollmerm

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.