kvcache-ai / kvcache-ai/Mooncake
[Bug]: 有人遇到过模型答非所问吗
Open
bug
- Dominant language
- C++
- Stars
- 6.6k
- Forks
- 1.2k
- Avg merge
- 3d 5h
- Merged PRs (30d)
- 312
Description
### Bug Report
vllm版本:v0.23.0
GPU:NVIDIA H20
模型:deepseek v4 flash
mooncake版本:0.3.10.post1
配置上mooncake store作为kvcache卸载,出现了大量的答非所谓,重启ai-coding agent又没出现了
另外的vllm实例没有配置mooncake就没有出,该怎么排查啊
### Before submitting...
- [ ] Ensure you searched for relevant issues and read the [documentation]
Contributor guide
Assessment
This issue has not been assessed yet.