NVIDIA / NVIDIA/TransformerEngine
Discuss release of NVFP4-trained LLM on Hugging Face
@sbhavani is already working on this.
Since Oct 19, 2025.
- Dominant language
- Python
- Stars
- 3.5k
- Forks
- 831
- Avg merge
- 3d 11h
- Merged PRs (30d)
- 65
Description
Hi @taesiri 🤗
I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work through Hugging Face's daily papers as yours got featured: https://huggingface.co/papers/2509.25149.
The paper page lets people discuss about your paper and lets them find artifacts about it (your models for instance),
you can also claim the paper as yours which will show up on your public profile at HF, add Github and project page URLs.
I saw the mention of "Code: Transformer Engine support for NVFP4 training" and that you've trained a 12-billion-parameter model with your NVFP4 approach, as mentioned in the abstract. We'd be very interested in having any pre-trained model checkpoints that you might release, or are planning to release, on https://huggingface.co/models.
Hosting on Hugging Face will give you more visibility/enable better discoverability. We can add tags in the model cards so that people find the models easier, link it to the paper page, etc.
If you're down, leaving a guide here. If it's a custom PyTorch model, you can use the PyTorchModelHubMixin
class which adds from_pretrained and push_to_hub to the model which lets you to upload the model and people to download and use models right away.
If you do not want this and directly want to upload model through UI or however you want, people can also use hf_hub_download.
After uploaded, we can also link the models to the paper page (read here) so people can discover your model.
You can also build a demo for your model on Spaces, we can provide you a ZeroGPU grant, which gives you A100 GPUs for free.
Let me know if you're interested/need any guidance :)
Kind regards,
Niels
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.