google / google/brax

Action repeat for PyTorch training

Open
#162 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
3.2k
Forks
349
PR merge metrics
No merged PRs in 30d

Description

The current PyTorch training routine in https://colab.research.google.com/github/google/brax/blob/main/notebooks/training_torch.ipynb lacks an option for `action_repeat` to be set. From some testing of the Torch version, it seems this is mandatory to learn things efficiently for `reacher` (in the default JAX version, `action_repeat=4`), Would it be possible for this to be added in?

Thanks so much!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.