huggingface / huggingface/llm-vscode

Error decoding response body: expected value at line 1 column 1

Open
#99 11 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
1.3k
Forks
142
Avg merge
3m
Merged PRs (30d)
2

Description

I am trying to use llm-vscode with a locally deployed Text Generation Inference (TGI) server but I keep getting the following error:

_Error decoding response body: expected value at line 1 column 1_

My setting is the following where and correspond to my server path. I tried both with /generate and without it

```
{
"editor.accessibilitySupport": "off",
"workbench.colorTheme": "Default Dark+",
"git.openRepositoryInParentFolders": "always",
"diffEditor.codeLens": true,
"llm.attributionEndpoint": "http://:/generate",
"llm.configTemplate": "Custom",
"llm.modelIdOrEndpoint": "http:// :/generate",
"llm.fillInTheMiddle.enabled": true,
"llm.fillInTheMiddle.prefix": "

 ",

"llm.fillInTheMiddle.middle": " ",
"llm.fillInTheMiddle.suffix": " ",
"llm.temperature": 0.2,
"llm.contextWindow": 4096,
"llm.tokensToClear": [
""
],
"llm.enableAutoSuggest": true,
"llm.documentFilter": {

},
"llm.tlsSkipVerifyInsecure": true
}
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.