NVIDIA / NVIDIA/Model-Optimizer
Does Model Optimizer support QAT for GLM-5 with FP8, INT4, and NVFP4 quantization?
Open
@kevalmorabia97 is already working on this.
Since Jul 14, 2026.
question
- Dominant language
- Python
- Stars
- 3.8k
- Forks
- 604
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 142
Description
How would you like to use ModelOpt
I would like to perform Quantization-Aware Training (QAT) on the GLM-5 model (744B parameters, MoE architecture) using Model-Optimizer, targeting the following low‑precision formats:
- FP8
- INT4 (full QAT, both weights and activations)
- NVFP4
Specifically, I want to verify official support and obtain any available examples or configuration templates for GLM-5 QAT with these precisions.
System information
CUDA version: 13
GPU: Blackwell
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.