huggingface / huggingface/diffusers
[GGUF] support serialization with GGUF
Open
quantization
wip
- Dominant language
- Python
- Stars
- 34.5k
- Forks
- 7.3k
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 91
Description
Thanks to @DN6 we support loading GGUF checkpoints and running on-the-fly dequants ([PR](https://github.com/huggingface/diffusers/pull/9964)).
Currently, we don't support `save_pretrained()` on a `DiffusionPipeline` with GGUF, which, IMO, could be massively impactful, too.
Contributor guide
Assessment
This issue has not been assessed yet.