kvcache-ai / kvcache-ai/Mooncake

[Bug]: 有人遇到过模型答非所问吗

Open
#3,048 6 comments 0 reactions 1 assignee Claimed by @Lin-z-w View on GitHub
bug
Dominant language
C++
Stars
6.6k
Forks
1.2k
Avg merge
3d 5h
Merged PRs (30d)
312

Description

### Bug Report

vllm版本:v0.23.0
GPU:NVIDIA H20
模型:deepseek v4 flash
mooncake版本:0.3.10.post1
配置上mooncake store作为kvcache卸载,出现了大量的答非所谓,重启ai-coding agent又没出现了
另外的vllm实例没有配置mooncake就没有出,该怎么排查啊

### Before submitting...

- [ ] Ensure you searched for relevant issues and read the [documentation]

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.