google-deepmind / google-deepmind/mujoco_playground

Support for PPO with LSTM (Recurrent Policy)

Open
#236 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
2.2k
Forks
359
Avg merge
7d 3h
Merged PRs (30d)
1

Description

Hi, and thanks for the great work on this project!

I noticed that the current PPO implementation in MuJoCo Playground appears to use a standard MLP policy. I would like to use PPO with an LSTM (recurrent) policy to handle tasks that depend on temporal information.

- Does MuJoCo Playground currently support LSTM (or any recurrent) policies with PPO?
- Since it’s based on Brax, does Brax itself support recurrent policies (e.g., PPO + LSTM), or would this need to be implemented externally? If so, can you refer some guideline?

Thanks in advance for clarifying!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.