vllm-project / vllm-project/aibrix

[Feature Request] Do you have a plan to add mooncake kvcache store as aibrix kvcache backend

Open
#1,673 2 comments 0 reactions 1 assignee Claimed by @DwyaneShi View on GitHub
area/distributed area/kv-cache
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 19h
Merged PRs (30d)
98

Description

### 🚀 Feature Description and Motivation

1 I want to use mooncake kvcache store as vllm kvcache store, I find your project aibrix kvcache connector is a good way to integrate with vllm kvcache management,
2 bug aibrix kvcache connector don't support mooncake kvcache store as backend
3 also i find there are many examples, like infinistore backend and mock connector as example
4 i still haven't enough confidence to make it

### Use Case

1 use mooncake kvcache store as backend

### Proposed Solution

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.