huggingface / huggingface/diffusers
GGUF + `torch.compile` is not compatible with Hub Kernels
Đang mở
gguf
torch-compile
- Ngôn ngữ chính
- Python
- Star
- 34.5k
- Fork
- 7.3k
- Merge trung bình
- 3 ngày 3 giờ
- Pull request đã merge (30 ngày)
- 91
Mô tả
The set checks when using hub kernels with GGUF are not traceable with torch.compile.
https://github.com/huggingface/diffusers/blob/b0dc51da31a112e5cd4e8a3ee9eafff08dab913d/src/diffusers/quantizers/gguf/utils.py#L74-L76
The GGUF Kernels also need to be updated to support the latest version of torch.
Initial Solution has been proposed: #12556
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.