google-deepmind / google-deepmind/deepmind-research

Optimize fitness value

Open
#190 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
15.2k
Forks
2.9k
PR merge metrics
No merged PRs in 30d

Description

In original BKRGA paper, and in your REGAL paper we have some fitness value function which one we want to minimize.

In original device placement task we want to minimize runtime of inference/training of deep neural network. But this value is linear and we can't apply gradient descent to this problem.

How do you think, can we apply some loss function to update our fitness value function, e.g. square some things, maybe add some bias value?

For example, `fitness_value = runtime**2 + some_feature`

I have a question, REGAL have no conflicts with modify fitness value functions?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.