kvcache-ai / kvcache-ai/ktransformers
How to convert Kimi K2.5 to AMXINT4 weights?
Open
- Dominant language
- Python
- Stars
- 19.5k
- Forks
- 1.6k
- Avg merge
- 19h 32m
- Merged PRs (30d)
- 27
Description
### Reminder
- [x] I have read the above rules and searched the existing issues.
### System Info
K2.5's expert weights are in int4 right? The convert_cpu_weights.py script does not support int4 input type. Anyone has the solution? Thanks in advance.
### Reproduction
```text
Put your message here.
```
### Others
_No response_
Contributor guide
Research direction
Start by reading convert_cpu_weights.py to identify its accepted input types and conversion flow. Determine how K2.5 expert weights are represented, then establish a reproducible conversion path for the reported int4 input to AMXINT4 weights and verify the resulting output.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 42/100