vllm-project / vllm-project/aibrix

[Question] How to access the vLLM-Vineyard integration code mentioned in Distributed KV Cache documentation?

Open
#733 5 comments 0 reactions 0 assignees View on GitHub
area/kv-cache kind/support
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 19h
Merged PRs (30d)
98

Description

The [Distributed KV Cache documentation](https://aibrix.readthedocs.io/latest/features/distributed-kv-cache.html) references a customized vLLM implementation with Vineyard integration.

However, I couldn't locate the corresponding code implementation.

Could you help me clarify:

1. Is the customized vLLM code with Vineyard support publicly accessible?
2. If available, is it in a separate branch/repository?

Contributor guide

Open the contributing guide

Research direction

Start with the linked Distributed KV Cache documentation and inspect its references to the customized vLLM implementation and Vineyard integration. Confirm whether the implementation is publicly available in this repository, another branch, or a separate repository; done means the documentation identifies the accessible code or clearly states that it is unavailable.

Written by the indexing model from the issue text.

Assessment

Domain
documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.