Comfy-Org / Comfy-Org/ComfyUI

SDNQ support

Open
#11,159 2 comments 8 reactions 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

### Feature Idea

[SDNQ](https://github.com/Disty0/sdnq) provides low bit quantization with good quality and performance. Incorporating it for on-the-fly quantization and loading pre-quantized models would be great, especially for larger models like flux.2 where fp8 is too large, even for 24GB gpus. I have tried writing a custom node for this, but failed due to the model and vram management getting in the way. Compared to nunchaku this approach doesn't depend on a custom model implementation from another dev team for each new model.

### Existing Solutions

[ComfyUI-SDNQ](https://github.com/EnragedAntelope/comfyui-sdnq) is a vibe coded custom node that doesn't actually work

### Other

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.