google / google/fuzzbench

Using startup script for dispatcher instead of SSH doesn't throw errors when it should

Open
#544 3 comments 0 reactions 0 assignees View on GitHub
minor bug
Dominant language
Python
Stars
1.2k
Forks
302
PR merge metrics
No merged PRs in 30d

Description

If you try to start a dispatcher when you don't have enough quota, run_experiment.py will succeed since the instance will be created briefly. But Google Cloud will shut it down.
It's probably a good idea to continue using the startup script but wait until we can SSH into the dispatcher before reporting a success. This still gives us much of the benefits of using a startup script: having run_experiment.py terminate in a reasonable amount of time.
This will break @Shadoom7 but I think the issue on his machines is unique enough that is less of a concern than this problem.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.