NVIDIA / NVIDIA/Model-Optimizer
ONNX PTQ: no NVFP4 path for convolutional models
@ajrasane is already working on this.
Since Aug 28, 2026.
- Dominant language
- Python
- Stars
- 3.8k
- Forks
- 604
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 142
Description
Summary
The ONNX PTQ entry points expose NVFP4 for transformer-family models but not for convolutional
models. A CNN detector cannot request NVFP4 through the ONNX PTQ API at all — this is an
unreachable code path rather than a quality limitation, so it fails as "unsupported" rather than as
"poor accuracy".
Originally raised as a comment on #362, which is closed; re-filing standalone so it can be tracked.
Why it matters
We benchmark CNN detectors (YOLOv8/11/26-family) and a transformer detector (RT-DETRv2) through the
same export and quantization pipeline, and compare precisions across them. NVFP4 is reachable for
the transformer and not for the CNNs, so the comparison has a hole that is a property of the API
surface rather than of the models.
Environment
ModelOpt 0.46.0, ONNX PTQ path, explicit-QDQ (strongly typed) export.
What would help
Either an NVFP4 config selection path for convolutional graphs, or — if that is out of scope — an
explicit, early error naming NVFP4-on-CNN as unsupported, so callers do not have to discover it by
inspecting realized precisions afterwards.
I am happy to supply a representative CNN detector ONNX and the exact config that fails to select
NVFP4.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.