how to adapting GLM4 & QWEN2 to FastChat
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
I would like to adapt GLM4 to FastChat in order to leverage FastChat's features for deploying and testing the conversation model.I am working on adapting GLM4 to FastChat, but I am encountering issues with prompt template compatibility. Specifically, the prompt templates do not seem to fit well with GLM4, causing unexpected behavior or errors.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No file, test, or entry point is identified. Start by reproducing the prompt-template behavior for GLM4 and QWEN2 in FastChat, then determine the expected template compatibility and a validation path for deployment and conversation testing. Done means the models work with FastChat features without the reported prompt errors or unexpected behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100