google / google/dopamine

Is it possible to release the evaluation scores of the baseline agents?

Open
#210 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
10.9k
Forks
1.4k
PR merge metrics
No merged PRs in 30d

Description

First, thanks for this awesome codebase, it helped me a lot :) I have three questions

1. Based on #147 and the [white paper](https://arxiv.org/abs/1812.06110), the results in the [baseline folder](https://github.com/google/dopamine/tree/master/baselines) are training returns instead of evaluation returns. Would it be possible to also release the evaluation returns, if they are available? The reason I'm asking is that I'm running some ensemble methods that behave very differently during training and evaluation. Even though the [white paper](https://arxiv.org/abs/1812.06110) shows that for the agents in the repo, using evaluation or training returns does not matter much for the 3 games tested, I'm not sure whether this is still the case for the other 57 games. And even if so, for apple-to-apple comparisons I would prefer to compare the evaluation returns.
2. Why are there only 199 iterations (indexed from 0 to 198) for the baseline results, given that we always run 200 iterations?
3. In the [MICo](https://arxiv.org/abs/2106.08229) paper, did you report training returns or evaluation returns?

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.