huggingface / huggingface/diffusers

[Features] Planning to support TensorRT for Flux Pipelines

Open
#12,202 3 comments 1 reaction 0 assignees View on GitHub
stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

🚀 Hi team,

I’m planning to code all Flux Pipelines with TensorRT support.
My plan is to create a new subfolder: `flux-tensorrt` inside the `examples` folder.

Pipelines to be supported:
```
FluxPipeline
FluxImg2ImgPipeline
FluxInpaintPipeline
FluxFillPipeline
FluxKontextPipeline
FluxKontextInpaintPipeline
```

✅ Initial phase: Support for both Flux.Dev and Flux Kontext.
🔜 Next step: Extend to the other pipelines.

📚 Some related references for Flux Kontext:

- https://blogs.nvidia.com/blog/rtx-ai-garage-flux-kontext-nim-tensorrt/

- https://github.com/NVIDIA/TensorRT/pull/4548

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.