kvcache-ai / kvcache-ai/ktransformers

推理引擎空闲状态下CPU负载过高

Open
#1,836 1 comment 0 reactions 1 assignee Claimed by @ovowei View on GitHub
Dominant language
Python
Stars
19.5k
Forks
1.6k
Avg merge
19h 32m
Merged PRs (30d)
27

Description

### Reminder

- [x] I have read the above rules and searched the existing issues.

### System Info

CPU: 2 * AMD EPYC 9275F 24-Core Processor
RAM: 16 * DDR5 4800 48G
GPU: 1 * 5090
NVIDIA Driver Version: 570.195.03
CUDA Version: 12.8

KTransformers CLI v0.1.0

Python 3.12.12
平台 Linux 6.11.3-061103-generic
CUDA 12.8

Packages:

kt-kernel 0.5.1
sglang 0.0.0.dev8805+g384f824c3.d20260124 (PyPI)

### Reproduction

```text
使用如下命令运行推理引擎时,即使再推理引擎没有进行任何推理引擎时,CPU也有两个核心占用为100%,导致CPU在待机情况下温度略高,请问是否有什么降低待机时CPU占用率的方法?

命令:

uv run kt run /models/MiniMax-M2.1/ \
--host 0.0.0.0 \
--port 9810 \
--served-model-name DeepSeek-V3.1 \
--max-running-requests 4 \
--tool-call-parser minimax-m2 \
--reasoning-parser minimax \
--kt-method FP8 \
--kt-cpuinfer 40 \
--kt-threadpool-count 2 \
--kt-num-gpu-experts 8 \
--chunked-prefill-size 12288 \
--max-total-tokens 50000 \
--kt-gpu-prefill-token-threshold 2048 \
--log-level debug

# top页面

top - 15:34:13 up 3 days, 19:48, 4 users, load average: 2.27, 2.24, 2.20
Threads: 6270 total, 4 running, 6241 sleeping, 0 stopped, 25 zombie
%Cpu(s): 2.2 us, 0.2 sy, 0.0 ni, 97.7 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st
MiB Mem : 773526.9 total, 64471.8 free, 258718.7 used, 455698.2 buff/cache
MiB Swap: 8192.0 total, 7756.5 free, 435.5 used. 514808.2 avail Mem

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
13007 root 20 0 587.5g 423.6g 209.4g R 99.9 56.1 91,43 sglang::schedul
13543 root 20 0 587.5g 423.6g 209.4g R 99.9 56.1 91,40 sglang::schedul
4387 root 20 0 16.4g 1.2g 248416 S 4.3 0.2 210:33.80 python3
3992828 root 20 0 20372 12404 3188 R 2.0 0.0 0:01.04 top
1485686 ubuntu 20 0 609432 179888 28648 S 1.3 0.0 65:44.74 python
13516 root 20 0 587.5g 423.6g 209.4g S 1.0 56.1 104:11.12 numa_1_t_9
4389 root 20 0 7064600 886640 145596 S 0.7 0.1 23:34.47 python3
13486 root 20 0 587.5g 423.6g 209.4g S 0.7 56.1 104:17.51 numa_0_t_4
13487 root 20 0 587.5g 423.6g 209.4g S 0.7 56.1 103:31.76 numa_0_t_5
```

### Others

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.