vllm-project / vllm-project/aibrix
[Feature Request] Do you have a plan to add mooncake kvcache store as aibrix kvcache backend
Open
area/distributed
area/kv-cache
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 98
Description
### 🚀 Feature Description and Motivation
1 I want to use mooncake kvcache store as vllm kvcache store, I find your project aibrix kvcache connector is a good way to integrate with vllm kvcache management,
2 bug aibrix kvcache connector don't support mooncake kvcache store as backend
3 also i find there are many examples, like infinistore backend and mock connector as example
4 i still haven't enough confidence to make it
### Use Case
1 use mooncake kvcache store as backend
### Proposed Solution
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.