[feature] native and reliable TensorRT acceleration with torch-tensorrt module, possible?
Open
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 155
Description
Hi there, I knew some Large Language Model code can be accelerated with
`torch 2.1.x `+ `torch.compile` and with extra `torch-tensorrt` package.
Just wondering if such kind of optimizations work for stable diffusion pipeline.
If so, looking forward to see it got implemented in ComfyUI.
Contributor guide
Assessment
This issue has not been assessed yet.