SciSharp / SciSharp/LLamaSharp
[BUG]: The model muse-glimmer is not loading
Nobody has claimed this yet.
- Dominant language
- C#
- Stars
- 3.8k
- Forks
- 508
- Avg merge
- 1d 5h
- Merged PRs (30d)
- 12
Description
Description
Two weeks ago was released very efficient and interesting Meta model - muse glimmer
https://huggingface.co/meta-models/Muse-Glimmer-30B
https://huggingface.co/unsloth/Muse-Glimmer-30B-GGUF
Latest llama.cpp v0.3.0 release already supports it.
Please, consider upgrading to it - this model is actually kind of silent revolution in terms of VRAM efficiency across dense models.
Reproduction Steps
Try to load any gguf from https://huggingface.co/unsloth/Muse-Glimmer-30B-GGUF as an LLM model
Environment & Configuration
- Operating system: win
- .NET runtime version: 8
- LLamaSharp version: 0.29
- CUDA version (if you are using cuda backend):
- CPU & GPU device: core i5 10400, amd rx 9070, Vulkan
Known Workarounds
No response
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by checking how LLamaSharp 0.29 integrates llama.cpp and handles GGUF model loading, then compare that support with the Muse-Glimmer GGUF files linked in the issue. Verify the change by attempting to load a model from the linked repository on the reported configuration and confirm that loading succeeds.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- csharp
- Domain
- ai, backend
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100