kvcache-ai / kvcache-ai/ktransformers

KT +SGLANG是否支持GGUF MOE模型读取,例如QWEN3.6 35B A3B GGUF 的 UNSLOTH量化

Open
#2,034 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
19.5k
Forks
1.6k
Avg merge
19h 32m
Merged PRs (30d)
27

Description

### Reminder

- [x] I have read the above rules and searched the existing issues.

### System Info

nothing

### Reproduction

```text
Put your message here.
```

### Others

_No response_

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points and provides no system information or reproduction. First clarify the expected support for the QWEN3.6 35B A3B GGUF model and its Unsloth quantization, then inspect the model-loading path and existing GGUF/MOE coverage; done should include a documented compatibility result or a defined implementation scope.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.