【微调模型调用有问题】Using a fine-tuned model for a Q&A with the output in English was not the answer I was looking for
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
I use the following code to create the API interface
`
python -m fastchat.serve.controller
python -m fastchat.serve.model_worker --model-path C:\models\Qwen1.5-0.5B-Chat
python -m fastchat.serve.openai_api_server --host 0.0.0.0 --port 8000
`
I get normal answers
But I used the fine-tuning model for the conversation, and I didn't get the results I wanted,
我使用API去对话，基准模型返回正常，但是微调模型返回不是我期望的
微调模型其他方式使用正常
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the three FastChat commands in the issue and compare the base-model and fine-tuned-model runs through the API. Inspect the model-worker and OpenAI API serving entry points, then reproduce the differing responses and determine what expected answer the fine-tuned model should return. Done means the fine-tuned model produces the expected Q&A result through this API path.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api, backend, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100