Comfy-Org / Comfy-Org/ComfyUI

[feature] native and reliable TensorRT acceleration with torch-tensorrt module, possible?

Open
#2,485 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 6h
Merged PRs (30d)
155

Description

Hi there, I knew some Large Language Model code can be accelerated with
`torch 2.1.x `+ `torch.compile` and with extra `torch-tensorrt` package.
Just wondering if such kind of optimizations work for stable diffusion pipeline.
If so, looking forward to see it got implemented in ComfyUI.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.