google / google/ml-compiler-opt
Blackbox optimizers do not check for standard deviation of 0
Open
- Dominant language
- Python
- Stars
- 798
- Forks
- 123
- Avg merge
- 55m
- Merged PRs (30d)
- 4
Description
In ES training, when all of the rewards are the same value, the standard deviation is 0. The blackbox optimizers do not check for this case before dividing by the standard deviation of the function values (which is zero), resulting in a list of nan for the gradient and thus setting the model weights to nan as well. This case needs to be addressed so that the model weights result in real float values instead.
Contributor guide
Assessment
This issue has not been assessed yet.