NVIDIA-NeMo / NVIDIA-NeMo/Megatron-Bridge
Provide API for loading HF weights in memory to megatron model
Open
@yaoyu-33 is already working on this.
Since Jan 16, 2026.
area:ckpt
feature
tracking
- Dominant language
- Python
- Stars
- 921
- Forks
- 506
- Avg merge
- 1d 16h
- Merged PRs (30d)
- 236
Description
Is your feature request related to a problem? Please describe.
Provide load_weights(weights: List[Tuple[str, torch.Tensor]]) API for loading HF weights in mem to megatron model. The weight is a list of tuples of (hf_name, tensor).
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.