huggingface / huggingface/llm-vscode
Weird behavior with "codellama/CodeLlama-13b-hf"
- Dominant language
- TypeScript
- Stars
- 1.3k
- Forks
- 142
- Avg merge
- 3m
- Merged PRs (30d)
- 2
Description
Suggestion is not being displayed when using CodeLlama. This is not the case with Starcoder, it shows the suggestion in the line that's triggered from.
Here are the attempts:
#### Requesting from Line 5, nothing gets displayed.

#### Requesting from Line 6 with a one space to the right, shows the suggestion.

### Settings
```json
{
"llm.fillInTheMiddle.enabled": true,
"llm.fillInTheMiddle.prefix": "
",
"llm.fillInTheMiddle.middle": " ",
"llm.fillInTheMiddle.suffix": " ",
"llm.temperature": 0.2,
"llm.contextWindow": 4096,
"llm.tokensToClear": [
""
],
"llm.tokenizer": {
"repository": "codellama/CodeLlama-13b-hf"
},
"llm.enableAutoSuggest": true,
"llm.maxNewTokens": 256,
"llm.configTemplate": "codellama/CodeLlama-13b-hf",
"llm.modelIdOrEndpoint": "codellama/CodeLlama-13b-hf"
}
```### Example Code
```go
package main
import "fmt"func main() {
// Cursor here
func() { messages <- "ping" }()
msg = <-messages
fmt.Println(msg)
}
```### VSCode
Version: 1.85.0
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.