abetlen / abetlen/llama-cpp-python
Invalid magic number when trying to load model
Open
bug
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 1.4k
- PR merge metrics
- PR metrics pending
Description
I'm trying to load a model but I'm getting the below issue.
Command: ./main -m ./models/Llama-2-7b-Chat-GGUF/llama-2-7b-chat.Q4_0.gguf -n 128
Contributor guide
Assessment
This issue has not been assessed yet.