vllm-project / vllm-project/aibrix

[Docs] Explain difference between AIBrixOffloadingConnector vs AIBrixPDReuseConnector

Open
#2,341 0 comments 0 reactions 2 assignees Claimed by @dczhu View on GitHub
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 19h
Merged PRs (30d)
98

Description

### 🚀 Feature Description and Motivation

KV-centric P/D is not documented as one story. kvcache-offloading.rst covers offload, but there is no docs-site page explaining AIBrixOffloadingConnector vs AIBrixPDReuseConnector, shared store, PrisKV/InfiniStore backend choices, single-node no-RDMA path, or the comparison diagram requested in the PR.

### Use Case

give user clear guidance

### Proposed Solution

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.