google / google/dopamine

Why use minimal action set and not legal action set like in Revisiting ALE paper?

Open
#101 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
10.9k
Forks
1.4k
PR merge metrics
No merged PRs in 30d

Description

I think this is an issue for reproducibility and comparaison.
The paper "Revisiting ALE [...]" by Machado et al. (2018) use the full action set (18 actions) on all games and it's hard to know what is exactly the impact of giving MinimalActionSet compared to FullActionSet.

I know that this was an issue to reproduce Breakout result:
"DeepMind used a minimal set of four actions in Breakout (xitari), several versions of OpenAi gym’s Breakout have six actions. Additional actions can alter the difficulty of the task the agent is trying to learn drastically! The Breakout-v4 and BreakoutDeterministic-v4 environments have four actions (check with env.unwrapped.get_action_meanings())." (from [this blog](https://towardsdatascience.com/tutorial-double-deep-q-learning-with-dueling-network-architectures-4c1b3fb7f756))

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.