NVIDIA / NVIDIA/Model-Optimizer

[Model] Qwen3TTS

Open
#1,090 2 comments 0 reactions 1 assignee View on GitHub

@realAsma is already working on this.

Since Mar 30, 2026.

feature request onnx.quantization torch.quantization triaged
Dominant language
Python
Stars
3.8k
Forks
604
Avg merge
2d 6h
Merged PRs (30d)
138

Description

Detailed description of the requested feature

Support for quantization and deployment of Qwen3-TTS-style models within the NVIDIA optimization stack, ideally including compatibility with TensorRT-LLM or a clearly defined alternative pipeline.

Specifically, the request is for:

Ability to quantize non-Transformer / non-text-generation models (e.g., TTS pipelines) using a unified workflow similar to LLMs
Support for multi-component models, including:
text encoder (Transformer-based)
acoustic model (autoregressive / diffusion / codec-based)
vocoder (CNN-based waveform generator)

End-to-end export pipeline:

PyTorch → Quantization → ONNX → TensorRT engine(s)
Guidance or tooling for:
handling models not implemented in Hugging Face Transformers
exporting models with custom forward passes or generation loops
Optional: partial support for prefill/decode-style optimization where applicable (e.g., transformer submodules)

This would enable efficient deployment of modern TTS systems on NVIDIA GPUs with reduced latency and memory usage.

Describe alternatives you've considered
  1. torch AO library
Target hardware/use case
  1. NVIDIA GPUs (eg. A5000, etc.)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.