NVIDIA / NVIDIA/Model-Optimizer
[Model] Qwen3TTS
@realAsma is already working on this.
Since Mar 30, 2026.
- Dominant language
- Python
- Stars
- 3.8k
- Forks
- 604
- Avg merge
- 2d 6h
- Merged PRs (30d)
- 138
Description
Detailed description of the requested feature
Support for quantization and deployment of Qwen3-TTS-style models within the NVIDIA optimization stack, ideally including compatibility with TensorRT-LLM or a clearly defined alternative pipeline.
Specifically, the request is for:
Ability to quantize non-Transformer / non-text-generation models (e.g., TTS pipelines) using a unified workflow similar to LLMs
Support for multi-component models, including:
text encoder (Transformer-based)
acoustic model (autoregressive / diffusion / codec-based)
vocoder (CNN-based waveform generator)
End-to-end export pipeline:
PyTorch → Quantization → ONNX → TensorRT engine(s)
Guidance or tooling for:
handling models not implemented in Hugging Face Transformers
exporting models with custom forward passes or generation loops
Optional: partial support for prefill/decode-style optimization where applicable (e.g., transformer submodules)
This would enable efficient deployment of modern TTS systems on NVIDIA GPUs with reduced latency and memory usage.
Describe alternatives you've considered
- torch AO library
Target hardware/use case
- NVIDIA GPUs (eg. A5000, etc.)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.