huggingface / huggingface/llm.nvim

OpenAI Configuration Seems to be Ignored

Open
#118 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Lua
Stars
1.2k
Forks
58
Avg merge
30m
Merged PRs (30d)
1

Description

I've installed this plugin successfully using Lazy, and I'm trying to set it up using a locally hosted OpenAI-compatible API, hosted via LM Studio. This is the configuration I'm using:

```lua
return {
{
'huggingface/llm.nvim',
opts = {
{
api_token = nil,
backend = "openai",
model = "qwen2.5-coder-32b-instruct",
url = "http://localhost:1234/v1/completions",
tokenizer = {
path = "/Users/[USERNAME]/.tokenizer.json"
},
request_body = {
temperature = 0.2,
top_p = 0.95,
}
}
}
}
}
```

The plugin is not communicating with my self-hosted API at all, and is instead (successfully) using HuggingFace Inference API.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.