ContinualAI / ContinualAI/avalanche
remove benchmarks `reproducibility_data`
Open
Benchmarks
good first issue
- Dominant language
- Python
- Stars
- 2.1k
- Forks
- 321
- PR merge metrics
- No merged PRs in 30d
Description
`reproducibility_data` is an old serialization mechanism. With the current state of benchmarks it is easier and more efficient to save the benchmark arguments and fix a random seed to guarantee reproducibility (this is not guaranteed to work for different avalanche versions). Alternatively, it is possible to use serialization.
Therefore, we should remove `reproducibility_data` and and encourage other reproducibility solutions.
Contributor guide
Assessment
This issue has not been assessed yet.