huggingface / huggingface/diffusers
GGUF + `torch.compile` is not compatible with Hub Kernels
Ouverte
gguf
torch-compile
- Langage dominant
- Python
- Étoiles
- 34.5k
- Forks
- 7.3k
- Merge moyen
- 3 j 3 h
- PR mergées (30 j)
- 91
Description
The set checks when using hub kernels with GGUF are not traceable with torch.compile.
https://github.com/huggingface/diffusers/blob/b0dc51da31a112e5cd4e8a3ee9eafff08dab913d/src/diffusers/quantizers/gguf/utils.py#L74-L76
The GGUF Kernels also need to be updated to support the latest version of torch.
Initial Solution has been proposed: #12556
Guide de contribution
Ouvrir le guide de contribution
Évaluation
Cette issue n'a pas encore été évaluée.