intitni / intitni/CustomSuggestionServiceForCopilotForXcode
Using Qwen2.5-Coder with LM Studio
- Lenguaje dominante
- Swift
- Estrellas
- 88
- Forks
- 12
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
I am trying to setup code completion with the Qwen2.5-Coder models. I have tested different model versions and different settings for "Request Strategy" but it is not working well. Either the configuration is not compatible with LM Studio or otherwise the model responds with `` or `` most times. So the model tries to use format tags.
The best configuration for Qwen would be the "Naive" setting as the models are trained for this situation.
source: https://github.com/QwenLM/Qwen2.5-Coder?tab=readme-ov-file#1-basic-usage
However it is not working because LM Studio doesn't accept an empty system prompt like this:
```
{
"role": "system",
"content": ""
},
```
Maybe there could be a new option added to set a custom system prompt or to remove this empty message.
The Qwen2.5-Coder models are also trained for fill in the middle. This is the prompt format:
```
prompt = '<|fim_prefix|>' + prefix_code + '<|fim_suffix|>' + suffix_code + '<|fim_middle|>'
```
source: https://github.com/QwenLM/Qwen2.5-Coder?tab=readme-ov-file#3-file-level-code-completion-fill-in-the-middle
I did put the following in the 'FIM Template' text field but I am still getting responses like ``.
```
<|fim_prefix|> {prefix} <|fim_suffix|> {suffix} <|fim_middle|>
```
Maybe there is a conflict with the given system prompt which instructs to use other strings. The fill in the middle setting without system prompt is not working for the same reason as the "Naive" setting.
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Evaluación
Este issue todavía no se ha evaluado.