huggingface / huggingface/diffusers
why rebuild a vae in inference stage?
Open
stale
- Dominant language
- Python
- Stars
- 34.5k
- Forks
- 7.3k
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 91
Description
Thanks for ur effort for diffusion model.
I want to know why we need to rebuild a vae in inference stage. I think it will introduce extra GPU cost.
https://github.com/huggingface/diffusers/blob/a85b34e7fdc0a5fceb11aa0fa6199bd9afaca396/examples/text_to_image/train_text_to_image_sdxl.py#L1217C16-L1223C24
Contributor guide
Assessment
This issue has not been assessed yet.