vllm-project / vllm-project/aibrix

Request: Create unified sglang/vllm images to use both AIBrix KVCache and routing features

Open
#1,780 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
5.1k
Forks
697
Avg merge
1d 19h
Merged PRs (30d)
104

Description

### 🚀 Feature Description and Motivation

Currently AIBrix KVCache and routing tests are using separate images. Using a single image to reduce maintenance overhead and provide cleaner dev/test vehicle.

### Use Case

Used for both dev & testing.

### Proposed Solution

_No response_

Contributor guide

Open the contributing guide

Research direction

No files, tests, or image entry points are identified. Start by locating the separate AIBrix KVCache and routing sglang/vllm image definitions and their dev/test consumers; done means one shared image supports both workflows and the existing tests run against it.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker
Domain
devops, infrastructure
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.