bencheeorg / bencheeorg/benchee_html

Graph execution time as a function of the size of the input

Open
#41 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Elixir
Stars
58
Forks
10
PR merge metrics
No merged PRs in 30d

Description

There should be a way of graphing the execution time as a function of the size of the input, so that one can demonstrate the time complexity of the algorithm empirically in graphs like this:

![image](https://user-images.githubusercontent.com/2668874/39005212-7c9e0092-43f7-11e8-886f-128e09d804be.png)

The size of the input can't be determined automatically, but it could given by the user in the form of a tuple: `{input_size, input_value}` or some similar API. I understand that this might require a new top-level Benchee function, and that might be a change too big to implement.

But even if this change isn't possible, just plotting the execution time of all the inputs in the same graph would be a big improvement.

In my concrete example, I want to show that a an implementation of a programming language lexer (let's say, implementation 1) has complexity roughly linear on the size of the file while the alternative impelmentation (say, implementation 2) has supralinear complexity. I can see how, as the input size rows, implementation 2 gets slower and slower than implementation 1, but I can't compare the execution time of the implementation 1 with itself as the input grows.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.