✨[Feature] Is there a plan to support to convert quantized PT2 to trt ?
Open
@micwill755 is already working on this.
Since Jul 30, 2026.
feature request
story: Quantization & Precision
- Dominant language
- Python
- Stars
- 3k
- Forks
- 410
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 78
Description
when i use torch-tensorrt 2.4.0 to convert a quantized PT2 to trt, i got this error blow.
I wonder whether it will support in ther future? Or, i am able to do this based on the current version (maybe through converting the torch.ops.quantized_decomposed.dequantize_per_tensor.default operator to other quantization operator? ).
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.