google / google/fuzzbench

The dispatcher image makes reproducibility hard

Open
#1,346 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
1.2k
Forks
302
PR merge metrics
No merged PRs in 30d

Description

Sometimes old experiments can't be reproduced easily without manually modifying FuzzBench to use the dispatcher-image from the original experiment. This may be true for the Q based measurer when that is implemented.
To remedy this, I have two changes in mind:
1. Experiments should save data on which dispatcher image they used and this info should be automatically used in reproduction experiments.
2. the clang coverage binaries should be included in the coverage builds instead of on the dispatcher image. This is how OSS-Fuzz does it and it makes most sense.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.