intitni / intitni/CustomSuggestionServiceForCopilotForXcode
Using Qwen2.5-Coder with LM Studio
- 主要言語
- Swift
- スター
- 88
- フォーク
- 12
- PR マージ指標
- 30日以内にマージされた PR はありません
説明
I am trying to setup code completion with the Qwen2.5-Coder models. I have tested different model versions and different settings for "Request Strategy" but it is not working well. Either the configuration is not compatible with LM Studio or otherwise the model responds with `` or `` most times. So the model tries to use format tags.
The best configuration for Qwen would be the "Naive" setting as the models are trained for this situation.
source: https://github.com/QwenLM/Qwen2.5-Coder?tab=readme-ov-file#1-basic-usage
However it is not working because LM Studio doesn't accept an empty system prompt like this:
```
{
"role": "system",
"content": ""
},
```
Maybe there could be a new option added to set a custom system prompt or to remove this empty message.
The Qwen2.5-Coder models are also trained for fill in the middle. This is the prompt format:
```
prompt = '<|fim_prefix|>' + prefix_code + '<|fim_suffix|>' + suffix_code + '<|fim_middle|>'
```
source: https://github.com/QwenLM/Qwen2.5-Coder?tab=readme-ov-file#3-file-level-code-completion-fill-in-the-middle
I did put the following in the 'FIM Template' text field but I am still getting responses like ``.
```
<|fim_prefix|> {prefix} <|fim_suffix|> {suffix} <|fim_middle|>
```
Maybe there is a conflict with the given system prompt which instructs to use other strings. The fill in the middle setting without system prompt is not working for the same reason as the "Naive" setting.
コントリビューションガイド
このリポジトリのコントリビューションガイドは索引されていません
評価
この issue はまだ評価されていません。