ggml-model-i2_s.gguf gives magic file error when adding to Ollama
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 40.3k
- Forks
- 3.7k
- PR merge metrics
- No merged PRs in 30d
Description
I have successfully implemented BitNet but when I am trying to add it to Ollama with "ggml-model-i2_s.gguf" it fails:
ollama create bitnet -f Modelfile
transferring model data 100%
Error: invalid file magic
I can use the other gguf file "ggml-model-f32.gguf" for this, but first it take long to transfer to Ollama and second, it become very slow, size of 32G.
Is there any remedy for this?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the failure with the shown ollama create bitnet -f Modelfile command and ggml-model-i2_s.gguf, then compare it with the working ggml-model-f32.gguf path. Check the model files and Ollama's accepted GGUF format requirements; done means identifying a compatible remedy or documenting that this quantized file is unsupported.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- ai
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100