Enhance support for non-Qwen models and providers
Nobody has claimed this yet.
- Dominant language
- TypeScript
- Stars
- 28k
- Forks
- 3.1k
- Avg merge
- 1d 1h
- Merged PRs (30d)
- 702
Description
What happened?
I saw a PR addressing an issue with kimi-k2 compatibility via Moonshot's API. This is great for users like me who love Qwen Code but need to use other models. If we are considering improving support for other models, I have a few more issues to raise:
- The auto-compress action in qwen-code seems to send the value of max_tokens to be something larger than 8k and the DeepSeek server rejects any requests where max_tokens value is set larger than 8k. Maybe allowing building the summary over multiple requests should be fine.
- Auto-compression virtually fails for GLM models via z.ai server. The returned summary is usually just around 300 tokens in size, clearly far too less and all context is indeed lost afterwards. Not sure what causes this but maybe max_tokens is the culprit here as well.
What did you expect to happen?
Non-qwen models to work very nicely with qwen-code and being able to use qwen-code as my default go-to driver for everything instead of having to use other tools for non-Qwen models.
Client information
0.1.12
Login information
No response
Anything else we need to know?
No response
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing auto-compression with DeepSeek and GLM through the mentioned providers, using client version 0.1.12, and inspect the max_tokens values and returned summary sizes. Done means non-Qwen models can complete compression without rejected requests and retain an adequate summary across these providers.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- typescript
- Domain
- ai, cli
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100