vllm-project / vllm-project/aibrix

when use stormservice to deploy sglang pd case, "routing role" and "pd_disaggregation.go doPrefillRequest" which one make sense??

Open
#1,786 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 19h
Merged PRs (30d)
98

Description

### 🐛 Describe the bug

i want to deploy sglang pd, i use stormservice to make it.
1\ i found in stormservice there is a role named "routing", it seems the routing pod handle PD routing.
2\ but , i found in pkg/plugins/gateway/algorithms/pd_disaggregation.go there are two functions call, doPrefillRequest and preparePrefillPayload , those function call have already adapted SGLangEngine logic,

i don't know which one make sense

### Steps to Reproduce

none

### Expected behavior

none

### Environment

none

Contributor guide

Open the contributing guide

Research direction

Start by reading pkg/plugins/gateway/algorithms/pd_disaggregation.go, especially doPrefillRequest and preparePrefillPayload, then trace the stormservice routing role mentioned in the issue. Compare the two request paths for an SGLang PD deployment; done means the responsible path and relationship between them are clearly established, with a reproducible deployment scenario if a code change is needed.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
ai-infra-agents, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.