vllm-project / vllm-project/aibrix
[Docs] Explain difference between AIBrixOffloadingConnector vs AIBrixPDReuseConnector
Open
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 98
Description
### 🚀 Feature Description and Motivation
KV-centric P/D is not documented as one story. kvcache-offloading.rst covers offload, but there is no docs-site page explaining AIBrixOffloadingConnector vs AIBrixPDReuseConnector, shared store, PrisKV/InfiniStore backend choices, single-node no-RDMA path, or the comparison diagram requested in the PR.
### Use Case
give user clear guidance
### Proposed Solution
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.