elm-explorations / elm-explorations/benchmark

Results of individual benchmarks are affected by the amount of benchmarks in the suite

Open
#16 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Elm
Stars
28
Forks
4
PR merge metrics
No merged PRs in 30d

Description

I reproducibly get different results from the same benchmarks depending on whether I include other benchmarks in the suite.

These are the results I get, [when the suite contains other benchmarks](https://github.com/nikita-volkov/folding.elm/blob/af70d0f0950e5e6d81c67b7086a4683017e4407f/benchmarks/Unfoldl.elm):
![image](https://user-images.githubusercontent.com/1560937/59795402-daf17700-92e3-11e9-9fb1-e5a6dd93635b.png)

And these are [when the suite contains these benchmarks only](https://github.com/nikita-volkov/folding.elm/blob/05a2a7f4fb35075c64639e7b415a58fd0064f8f5/benchmarks/Unfoldl.elm):
![image](https://user-images.githubusercontent.com/1560937/59795461-fd839000-92e3-11e9-9d1f-56af2d3d75ac.png)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.