NVIDIA-NeMo / NVIDIA-NeMo/RL

Add an option to save checkpoints in HF format

Open
#1,494 8 comments 2 reactions 0 assignees View on GitHub
enhancement good first issue
Dominant language
Python
Stars
2k
Forks
561
Avg merge
4d 5h
Merged PRs (30d)
145

Description

**Is your feature request related to a problem? Please describe.**
Since checkpoints are often converted to HF format for evaluation, add a config to optionally save HF format checkpoints in addition to the mcore / dtensor checkpoints. This prevents the user from having to run a manual conversion step afterwards.

**Describe the solution you'd like**
A clear and concise description of what you want to happen.

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.