kvcache-ai / kvcache-ai/ktransformers

How to convert Kimi K2.5 to AMXINT4 weights?

Open
#1,841 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
19.5k
Forks
1.6k
Avg merge
19h 32m
Merged PRs (30d)
27

Description

### Reminder

- [x] I have read the above rules and searched the existing issues.

### System Info

K2.5's expert weights are in int4 right? The convert_cpu_weights.py script does not support int4 input type. Anyone has the solution? Thanks in advance.

### Reproduction

```text
Put your message here.
```

### Others

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by reading convert_cpu_weights.py to identify its accepted input types and conversion flow. Determine how K2.5 expert weights are represented, then establish a reproducible conversion path for the reported int4 input to AMXINT4 weights and verify the resulting output.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.