intitni / intitni/CustomSuggestionServiceForCopilotForXcode
Using Qwen2.5-Coder with LM Studio
- Ngôn ngữ chính
- Swift
- Star
- 88
- Fork
- 12
- Chỉ số merge pull request
- Không có pull request nào được merge trong 30 ngày
Mô tả
I am trying to setup code completion with the Qwen2.5-Coder models. I have tested different model versions and different settings for "Request Strategy" but it is not working well. Either the configuration is not compatible with LM Studio or otherwise the model responds with `` or `` most times. So the model tries to use format tags.
The best configuration for Qwen would be the "Naive" setting as the models are trained for this situation.
source: https://github.com/QwenLM/Qwen2.5-Coder?tab=readme-ov-file#1-basic-usage
However it is not working because LM Studio doesn't accept an empty system prompt like this:
```
{
"role": "system",
"content": ""
},
```
Maybe there could be a new option added to set a custom system prompt or to remove this empty message.
The Qwen2.5-Coder models are also trained for fill in the middle. This is the prompt format:
```
prompt = '<|fim_prefix|>' + prefix_code + '<|fim_suffix|>' + suffix_code + '<|fim_middle|>'
```
source: https://github.com/QwenLM/Qwen2.5-Coder?tab=readme-ov-file#3-file-level-code-completion-fill-in-the-middle
I did put the following in the 'FIM Template' text field but I am still getting responses like ``.
```
<|fim_prefix|> {prefix} <|fim_suffix|> {suffix} <|fim_middle|>
```
Maybe there is a conflict with the given system prompt which instructs to use other strings. The fill in the middle setting without system prompt is not working for the same reason as the "Naive" setting.
Hướng dẫn đóng góp
Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này
Đánh giá
Issue này chưa được đánh giá.