NVIDIA / NVIDIA/Model-Optimizer

Does Model Optimizer support QAT for GLM-5 with FP8, INT4, and NVFP4 quantization?

Open
#1,666 6 comments 0 reactions 1 assignee View on GitHub

@kevalmorabia97 is already working on this.

Since Jul 14, 2026.

question
Dominant language
Python
Stars
3.8k
Forks
604
Avg merge
2d 8h
Merged PRs (30d)
142

Description

How would you like to use ModelOpt

I would like to perform Quantization-Aware Training (QAT) on the GLM-5 model (744B parameters, MoE architecture) using Model-Optimizer, targeting the following low‑precision formats:

  • FP8
  • INT4 (full QAT, both weights and activations)
  • NVFP4

Specifically, I want to verify official support and obtain any available examples or configuration templates for GLM-5 QAT with these precisions.

System information

CUDA version: 13
GPU: Blackwell

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.