huggingface / huggingface/llm.nvim
Default model (starcoder2-15b) error with `llm-ls`
- Dominant language
- Lua
- Stars
- 1.2k
- Forks
- 58
- Avg merge
- 30m
- Merged PRs (30d)
- 1
Description
I'm trying to use the default configuration and run model from `Hugging Face` but the adult model seems to be not reachable.
Here is my configuration:
`NVIM v0.10.4`
`Ubuntu 24.04.1 LTS`
`init.lua`:
```
return {
{
'huggingface/llm.nvim',
ft = { "python" },
opts = require("configs.llm")
},
}
```
`configs/llm.lua`:
```
return {
tokens_to_clear = { "<|endoftext|>" },
fim = {
enabled = true,
prefix = "",
middle = "",
suffix = "",
},
model = "bigcode/starcoder2-15b",
context_window = 8192,
tokenizer = nil, -- also tried the repository way
lsp = {
bin_path = vim.api.nvim_call_function("stdpath", { "data" }) .. "/mason/bin/llm-ls",
cmd_env = { LLM_LOG_LEVEL = "DEBUG" }
},
}
```
As you can see this is the default config to run `StarCoder2-15b` from `HF`, I have installed `llm-ls` from `Mason`, and I have setup env variable ` LLM_NVIM_HF_API_TOKEN` with the `Write` token (I know I can restrict permissions).
Here is the error message in the log file:
```
{"timestamp":"2025-06-06T14:56:16.914325Z","level":"ERROR","err_msg":"serde json error: expected value at line 1 column 1","target":"llm_ls::error","line_number":8,"spans":[{"request_id":"e6c485d2-afaa-484a-a068-49b8ff11a4e0","name":"completion_request"}]}
```
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.