google-deepmind / google-deepmind/pushworld
Feature request: upgrade from gym to gymnasium
- Dominant language
- Python
- Stars
- 97
- Forks
- 16
- PR merge metrics
- No merged PRs in 30d
Description
Hi, would it be possible to upgrade this repository to use gymnasium rather than gym? We would like to list this project in this list of [third party environments](https://gymnasium.farama.org/environments/third_party_environments/), but are only adding environments which use gymnasium.
[Gymnasium](https://github.com/Farama-Foundation/Gymnasium) a maintained fork of openai gym and is designed as a drop-in replacement (`import gym` -> `import gymnasium as gym`). Beyond just bugfixes, many RL training libraries have also switched ([rllib](https://github.com/ray-project/ray/tree/master/rllib), [tianshou](https://github.com/thu-ml/tianshou), [CleanRL](https://github.com/vwxyzjn/cleanrl)), or are planning to switch ([stable-baselines3](https://github.com/DLR-RM/stable-baselines3/blob/e5deeed16efb57c34ccdcb14692439154d970527/docs/guide/install.rst#bleeding-edge-version)). It would be great if users could train agents using the latest models and features from these libraries (e.g., scalable distributed training/model serving using [Ray](https://github.com/ray-project/ray)/[RLlib](https://github.com/ray-project/ray/tree/master/rllib)).
For information about upgrading and compatibility, see [migration guide](https://gymnasium.farama.org/content/migration-guide/) and [gym compatibility](https://gymnasium.farama.org/content/gym_compatibility/). The main difference is the API has switched to returning `truncated` and `terminated`, rather than `done`, in order to give more information and mitigate edge case issues (for example, many popular tutorials/implementations of Q learning using gym were actually incorrect because of `done`, there will be an upcoming blog post explaining more details about this on the Farama site (https://farama.org/blog).
Contributor guide
Assessment
This issue has not been assessed yet.