Comfy-Org / Comfy-Org/ComfyUI

Just not working? - GGUF

Open
#7,638 3 comments 0 reactions 0 assignees View on GitHub
Potential Bug
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 6h
Merged PRs (30d)
155

Description

### Expected Behavior

It should just begin to generate the first prompt, but instead I get the below error message. ComfyUI is up to date, I have the correct model files in place, using a 5070

### Actual Behavior

Just doesn't generate.

### Steps to Reproduce

Just put GGUF model loader in the standard workflow with a 5070?

### Debug Logs

```powershell
Error(s) in loading state_dict for Llama2:
size mismatch for model.embed_tokens.weight: copying a param with shape torch.Size([128320, 4096]) from checkpoint, the shape in current model is torch.Size([128256, 4096]).
```

### Other

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.