kvcache-ai / kvcache-ai/ktransformers

is this project dead?

Open
#1,490 28 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
19.5k
Forks
1.6k
Avg merge
19h 32m
Merged PRs (30d)
27

Description

Hi , i long time awating for update to new cuda driver support, but last commit is around 2 months ago, is there any alternative allow me run on system with qwen 235B on 16G VRAM and 512G RAM in latest debian 13, cuda and nvidia driver?

Contributor guide

Open the contributing guide

Research direction

The issue asks whether ktransformers supports a newer CUDA driver and whether an alternative can run Qwen 235B on the stated Debian 13, CUDA, NVIDIA driver, VRAM, and RAM setup. No source files, tests, or entry points are identified; first clarify the supported environment and define whether the goal is driver support or an alternative recommendation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.