Should `np.median` be replaced with `np.mean` for plotting 'Mean code coverage growth over time'?
Open
- Dominant language
- Python
- Stars
- 1.2k
- Forks
- 302
- PR merge metrics
- No merged PRs in 30d
Description
I noticed that when plotting the '**Mean** code coverage growth over time' graph, `np.median` is used as the estimator (L166):
https://github.com/google/fuzzbench/blob/2920e74f192e1b7add95eb5ac49b0e0049d1c876/analysis/plotting.py#L159-L171
Shouldn't `np.mean` be used instead? For example, the order of this graph uses `benchmark_rank_by_mean`:
https://github.com/google/fuzzbench/blob/2920e74f192e1b7add95eb5ac49b0e0049d1c876/analysis/plotting.py#L156
Is there a specific reason for using np.median here, or am I missing something?
Looking forward to your insights. Thanks.
Contributor guide
Assessment
This issue has not been assessed yet.