automl / automl/Mighty

Eval step reward is logging something strange

Open
#97 0 comments 0 reactions 1 assignee Claimed by @amsks View on GitHub
documentation good first issue question
Dominant language
Python
Stars
61
Forks
2
PR merge metrics
No merged PRs in 30d

Description

The eval step reward is currently implemented as "np.mean(rewards)/steps" which looks like it's supposed to return the mean reward per step. Due to numpy, this ends up being an array, however, of `[np.mean(rewards)/s for s in steps]` which is probably not what we want to log. Maybe we should just log the steps and the rewards and be done with it?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.