NVIDIA-NeMo / NVIDIA-NeMo/RL

Directly supporting Megatron Core checkpoints

Open
#671 2 comments 9 reactions 0 assignees View on GitHub
t-mcore
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

Please 👍 this issue if this if you'd like to see us support this.

The checkpoint format between megatron and the format we use is very very close so we should be able to support a thin translation for the metadata. The obvious limitation with this is we wouldn't be able to support vllm in general due to there not being an HF and/or vllm implementation of the model; so the user can only use the megatron inference backend.

Related #619

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.