NVIDIA-NeMo / NVIDIA-NeMo/RL

dtensor foreach must be false in optimizer

Open
#151 1 comment 0 reactions 0 assignees View on GitHub
bug t-pytdensor
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

dtensor policy needs foreach = False on the optimizer to work

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.