Just not working? - GGUF
Open
Potential Bug
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 155
Description
### Expected Behavior
It should just begin to generate the first prompt, but instead I get the below error message. ComfyUI is up to date, I have the correct model files in place, using a 5070
### Actual Behavior
Just doesn't generate.
### Steps to Reproduce
Just put GGUF model loader in the standard workflow with a 5070?
### Debug Logs
```powershell
Error(s) in loading state_dict for Llama2:
size mismatch for model.embed_tokens.weight: copying a param with shape torch.Size([128320, 4096]) from checkpoint, the shape in current model is torch.Size([128256, 4096]).
```
### Other
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.