When we can get support for int8_blockwise please?
Open
Feature
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 158
Description
Thank you @comfyanonymous
Possible reason: ComfyUI execution error: Unsupported quantization format: int8_blockwise
I am using this repo to quantize models : https://github.com/silveroxides/convert_to_quant
Contributor guide
Assessment
This issue has not been assessed yet.