Archive and release private experiments
- Dominant language
- Python
- Stars
- 1.2k
- Forks
- 302
- PR merge metrics
- No merged PRs in 30d
Description
Many academic papers user fuzzbench to evaluate their contributions vs other fuzzers.
Rarely (as in "I have never seen this done but it might have happened without me having noticed") however the testing setup and the Dockerfile of the new fuzzer is made available.
This makes assessing and reassessing papers impossible.
E.g. getting symqemu running is so far failed by Jonathan and me individually. In other experiments - did e.g. afl++ in the experiment have cmplog enabled and which version was it tested against? Impossible to know.
I therefore propose to archive private experiments and make these available 6 months later - unless the requestor actively announces this should not be done.
Contributor guide
Assessment
This issue has not been assessed yet.