vllm-project / vllm-project/aibrix

[RFC]: Add dependencies field in StormService

Open
#1,834 10 comments 0 reactions 1 assignee View on GitHub

@googs1025 is already working on this.

Since Dec 9, 2025.

Dominant language
Go
Stars
5.1k
Forks
697
Avg merge
1d 19h
Merged PRs (30d)
104

Description

🚀 Feature Description and Motivation

I deploy vLLM+LMCache+Mooncake with StormService in my production K8S like this:

apiVersion: orchestration.aibrix.ai/v1alpha1
kind: StormService
metadata:
  name: vllm-lmcache-mooncake
spec:
  replicas: 1
  updateStrategy:
    type: InPlaceUpdate
  stateful: true
  selector:
    matchLabels:
      app: vllm-lmcache-mooncake
  template:
    metadata:
      labels:
        app: vllm-lmcache-mooncake
    spec:
      roles:
        - name: mooncake-master
          replicas: 1
          stateful: true

        - name: mooncake-store
          replicas: 1
          stateful: true

       - name: vllm
          replicas: 1
          dependencies:  # new field
            - "mooncake-master"
          stateful: true

the vllm pod dependency on the mooncake-master pod, it needs mooncake-master pod starts firstly.

I found RBG https://github.com/sgl-project/rbg/blob/main/keps/74-mooncake-integration/README.md#deploy-standalone-inference-service-with-mooncake has the dependencies field.

it's best to add dependencies field at StormService.

Use Case

Deploy vLLM+Mooncake Store in K8S.

Proposed Solution

No response

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.