huggingface / huggingface/diffusers
GGUF + `torch.compile` is not compatible with Hub Kernels
Aperta
gguf
torch-compile
- Lingua principale
- Python
- Stelle
- 34.5k
- Fork
- 7.3k
- Merge medio
- 3g 3h
- PR unite (30g)
- 91
Descrizione
The set checks when using hub kernels with GGUF are not traceable with torch.compile.
https://github.com/huggingface/diffusers/blob/b0dc51da31a112e5cd4e8a3ee9eafff08dab913d/src/diffusers/quantizers/gguf/utils.py#L74-L76
The GGUF Kernels also need to be updated to support the latest version of torch.
Initial Solution has been proposed: #12556
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.