google / google/ml-compiler-opt

Blackbox optimizers do not check for standard deviation of 0

Open
#285 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
798
Forks
123
Avg merge
55m
Merged PRs (30d)
4

Description

In ES training, when all of the rewards are the same value, the standard deviation is 0. The blackbox optimizers do not check for this case before dividing by the standard deviation of the function values (which is zero), resulting in a list of nan for the gradient and thus setting the model weights to nan as well. This case needs to be addressed so that the model weights result in real float values instead.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.