huggingface / huggingface/llm.nvim

Default model (starcoder2-15b) error with `llm-ls`

Open
#119 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Lua
Stars
1.2k
Forks
58
Avg merge
30m
Merged PRs (30d)
1

Description

I'm trying to use the default configuration and run model from `Hugging Face` but the adult model seems to be not reachable.

Here is my configuration:
`NVIM v0.10.4`
`Ubuntu 24.04.1 LTS`

`init.lua`:
```
return {
{
'huggingface/llm.nvim',
ft = { "python" },
opts = require("configs.llm")
},
}
```
`configs/llm.lua`:
```
return {
tokens_to_clear = { "<|endoftext|>" },
fim = {
enabled = true,
prefix = "",
middle = "",
suffix = "",
},
model = "bigcode/starcoder2-15b",
context_window = 8192,
tokenizer = nil, -- also tried the repository way
lsp = {
bin_path = vim.api.nvim_call_function("stdpath", { "data" }) .. "/mason/bin/llm-ls",
cmd_env = { LLM_LOG_LEVEL = "DEBUG" }
},
}
```
As you can see this is the default config to run `StarCoder2-15b` from `HF`, I have installed `llm-ls` from `Mason`, and I have setup env variable ` LLM_NVIM_HF_API_TOKEN` with the `Write` token (I know I can restrict permissions).

Here is the error message in the log file:
```
{"timestamp":"2025-06-06T14:56:16.914325Z","level":"ERROR","err_msg":"serde json error: expected value at line 1 column 1","target":"llm_ls::error","line_number":8,"spans":[{"request_id":"e6c485d2-afaa-484a-a068-49b8ff11a4e0","name":"completion_request"}]}
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.