Farama-Foundation / Farama-Foundation/Arcade-Learning-Environment

Score wrapping

Open
#103 7 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C++
Stars
2.5k
Forks
477
Avg merge
11h 11m
Merged PRs (30d)
3

Description

On some games it is possible to loop the score. This has always been the case but is a greater issue on games where it is possible to learn policies that plays forever, e.g. on Atlantis. There should be a unifying scheme for dealing with score wrapping in games where this can occur. Either:
1. The episode should terminate (and the game can be considered "solved"), or
2. All evaluations should take place within strict time limitations.

Note that there are games, e.g. Krull, where a simple agent can loop the score without achieving anything meaningful. This needs to be taken into consideration when evaluating agents that loop the score.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.