NVIDIA / NVIDIA/TransformerEngine
What is the updated NVFP4 recipe for Nemotron 3 SUPER/ULTRA?
Open
Nobody has claimed this yet.
fp4
question
- Dominant language
- Python
- Stars
- 3.5k
- Forks
- 831
- Avg merge
- 3d 11h
- Merged PRs (30d)
- 65
Description
Hi there,
I saw mentioning of an updated NVFP4 recipe mentioned in https://developer.nvidia.com/blog/inside-nvidia-nemotron-3-techniques-tools-and-data-that-make-it-efficient-and-accurate/#nvfp4_training
So, I was wondering what exactly has changed compared to the reciped in NVFP4 pretraining paper https://arxiv.org/pdf/2509.25149 ?
Many thanks
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the NVFP4 training section in the linked NVIDIA developer blog and the linked NVFP4 pretraining paper. Compare their recipes for Nemotron 3 SUPER/ULTRA and document the concrete changes; done means providing an authoritative explanation of what differs.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100