huggingface / huggingface/diffusers
[Features] Planning to support TensorRT for Flux Pipelines
Open
stale
- Dominant language
- Python
- Stars
- 34.5k
- Forks
- 7.3k
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 91
Description
🚀 Hi team,
I’m planning to code all Flux Pipelines with TensorRT support.
My plan is to create a new subfolder: `flux-tensorrt` inside the `examples` folder.
Pipelines to be supported:
```
FluxPipeline
FluxImg2ImgPipeline
FluxInpaintPipeline
FluxFillPipeline
FluxKontextPipeline
FluxKontextInpaintPipeline
```
✅ Initial phase: Support for both Flux.Dev and Flux Kontext.
🔜 Next step: Extend to the other pipelines.
📚 Some related references for Flux Kontext:
- https://blogs.nvidia.com/blog/rtx-ai-garage-flux-kontext-nim-tensorrt/
- https://github.com/NVIDIA/TensorRT/pull/4548
Contributor guide
Assessment
This issue has not been assessed yet.