ContinualAI / ContinualAI/avalanche

remove benchmarks `reproducibility_data`

Open
#1,273 0 comments 0 reactions 0 assignees View on GitHub
Benchmarks good first issue
Dominant language
Python
Stars
2.1k
Forks
321
PR merge metrics
No merged PRs in 30d

Description

`reproducibility_data` is an old serialization mechanism. With the current state of benchmarks it is easier and more efficient to save the benchmark arguments and fix a random seed to guarantee reproducibility (this is not guaranteed to work for different avalanche versions). Alternatively, it is possible to use serialization.

Therefore, we should remove `reproducibility_data` and and encourage other reproducibility solutions.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.