Comfy-Org / Comfy-Org/ComfyUI

UnetLoaderGGUF Unexpected architecture type in GGUF file: 'qwen2vl'

Open
#10,558 1 comment 0 reactions 0 assignees View on GitHub
Potential Bug
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

### Custom Node Testing

- [ ] I have tried disabling custom nodes and the issue persists (see [how to disable custom nodes](https://docs.comfy.org/troubleshooting/custom-node-issues#step-1%3A-test-with-all-custom-nodes-disabled) if you need help)

### Expected Behavior

Running on a macOS M3 environment with Comfyui desktop version v0.3.67, the UnetLoader (gguf) node throws the following error when loading the Qwen2.5-VL-7B-Instruct-abliterated.Q8_0.gguf model: "Unexpected architecture type in GGUF file: 'qwen2vl'". How can I resolve this? The Comfyui-gguf plugin is already the latest version.

### Actual Behavior

ComfyUI/custom_nodes/ComfyUI-GGUF/loader.py", line 91, in gguf_sd_loader
raise ValueError(f"Unexpected architecture type in GGUF file: {arch_str!r}")
ValueError: Unexpected architecture type in GGUF file: 'qwen2vl'

### Steps to Reproduce

gguf workflow

### Debug Logs

```powershell
ComfyUI/custom_nodes/ComfyUI-GGUF/loader.py", line 91, in gguf_sd_loader
raise ValueError(f"Unexpected architecture type in GGUF file: {arch_str!r}")
ValueError: Unexpected architecture type in GGUF file: 'qwen2vl'
```

### Other

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.