google-deepmind / google-deepmind/pushworld

Feature request: upgrade from gym to gymnasium

Open
#5 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
97
Forks
16
PR merge metrics
No merged PRs in 30d

Description

Hi, would it be possible to upgrade this repository to use gymnasium rather than gym? We would like to list this project in this list of [third party environments](https://gymnasium.farama.org/environments/third_party_environments/), but are only adding environments which use gymnasium.

[Gymnasium](https://github.com/Farama-Foundation/Gymnasium) a maintained fork of openai gym and is designed as a drop-in replacement (`import gym` -> `import gymnasium as gym`). Beyond just bugfixes, many RL training libraries have also switched ([rllib](https://github.com/ray-project/ray/tree/master/rllib), [tianshou](https://github.com/thu-ml/tianshou), [CleanRL](https://github.com/vwxyzjn/cleanrl)), or are planning to switch ([stable-baselines3](https://github.com/DLR-RM/stable-baselines3/blob/e5deeed16efb57c34ccdcb14692439154d970527/docs/guide/install.rst#bleeding-edge-version)). It would be great if users could train agents using the latest models and features from these libraries (e.g., scalable distributed training/model serving using [Ray](https://github.com/ray-project/ray)/[RLlib](https://github.com/ray-project/ray/tree/master/rllib)).

For information about upgrading and compatibility, see [migration guide](https://gymnasium.farama.org/content/migration-guide/) and [gym compatibility](https://gymnasium.farama.org/content/gym_compatibility/). The main difference is the API has switched to returning `truncated` and `terminated`, rather than `done`, in order to give more information and mitigate edge case issues (for example, many popular tutorials/implementations of Q learning using gym were actually incorrect because of `done`, there will be an upcoming blog post explaining more details about this on the Farama site (https://farama.org/blog).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.