huggingface / huggingface/llm.nvim
ollama not working
- Dominant language
- Lua
- Stars
- 1.2k
- Forks
- 58
- Avg merge
- 30m
- Merged PRs (30d)
- 1
Description
config:
```lua
return {
"huggingface/llm.nvim",
opts = {
model = "rouge/autocoder-s-6.7b:latest",
backend = "ollama",
url = "http://localhost:11434/api/generate",
request_body = {
parameters = {
max_new_tokens = 100000, -- the maximum numbers of tokens to generate, ignore the number of prompt token
temperature = 0.2, -- the bigger, more creatively
top_p = 0.95, -- the bigger, text generated is diverse
},
},
tokens_to_clear = { "<|endoftext|>" },
fim = {
enabled = true,
prefix = "",
middle = "",
suffix = "",
},
accept_keymap = "",
dismiss_keymap = "",
lsp = {
bin_path = vim.api.nvim_call_function("stdpath", { "data" })
.. "/mason/bin/llm-ls",
},
context_window = 100000, -- max number of tokens for the context window
tokenizer = {
repository = "Bin12345/AutoCoder_S_6.7B",
},
},
}
```
error message: [LLM] serde json error: EOF while parsing a value at line 1 column 0
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.