vllm-project / vllm-project/aibrix
[Question] How to access the vLLM-Vineyard integration code mentioned in Distributed KV Cache documentation?
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 98
Description
The [Distributed KV Cache documentation](https://aibrix.readthedocs.io/latest/features/distributed-kv-cache.html) references a customized vLLM implementation with Vineyard integration.
However, I couldn't locate the corresponding code implementation.
Could you help me clarify:
1. Is the customized vLLM code with Vineyard support publicly accessible?
2. If available, is it in a separate branch/repository?
Contributor guide
Research direction
Start with the linked Distributed KV Cache documentation and inspect its references to the customized vLLM implementation and Vineyard integration. Confirm whether the implementation is publicly available in this repository, another branch, or a separate repository; done means the documentation identifies the accessible code or clearly states that it is unavailable.
Written by the indexing model from the issue text.
Assessment
- Domain
- documentation
- Issue type
- Documentation
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100