elm-explorations / elm-explorations/benchmark

Compare multi-benchmarks.

Open
#2 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Elm
Stars
28
Forks
4
PR merge metrics
No merged PRs in 30d

Description

**Issue by [BrianHicks](https://github.com/BrianHicks)**
_Monday Feb 13, 2017 at 16:11 GMT_
_Originally opened as https://github.com/BrianHicks/elm-benchmark/issues/6_

----

Right now `compare` only compares two single benchmarks (that is, `Benchmark`s created with `benchmark` through `benchmark8`.) We need to be able to compare any valid `Benchmark`. I suggest the following:

- for two `Group`s (that is, `Benchmark`s created with `describe`) we will zip the elements using `compare`, and modify the inner names. If one list is longer than the other, we will only zip the common elements and drop the rest. This will return a `Group` named "{group a} vs {group b}" whose elements are `Compare`s named "{element a name} / {element b name}" with children named "{group a}" and "{group b}". This logic recurses if any child elements are groups themselves.
- for two `Compare`s (that is, `Benchmark`s created with `compare`) we will combine as if they're groups with exactly two elements each.
- for mixed elements, we will not combine or change structure, and reporting in the runners will treat the compares as if they're `Group`s with two elements.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.