Farama-Foundation / Farama-Foundation/Arcade-Learning-Environment
Score wrapping
- Dominant language
- C++
- Stars
- 2.5k
- Forks
- 477
- Avg merge
- 11h 11m
- Merged PRs (30d)
- 3
Description
On some games it is possible to loop the score. This has always been the case but is a greater issue on games where it is possible to learn policies that plays forever, e.g. on Atlantis. There should be a unifying scheme for dealing with score wrapping in games where this can occur. Either:
1. The episode should terminate (and the game can be considered "solved"), or
2. All evaluations should take place within strict time limitations.
Note that there are games, e.g. Krull, where a simple agent can loop the score without achieving anything meaningful. This needs to be taken into consideration when evaluating agents that loop the score.
Contributor guide
Assessment
This issue has not been assessed yet.