vllm-project / vllm-project/aibrix

lora的modeladapter中设置Replicas多副本不生效

Open
#1,675 4 comments 0 reactions 1 assignee Claimed by @Jeffwan View on GitHub
area/lora kind/support
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 19h
Merged PRs (30d)
98

Description

我这边对一个基础模型分别尝试启动2个pod和5个pod,然以后调整modeladapter.yaml中Replicas数量。 想实现多pod挂载lora,但是每次尝试发现都只有一个pod会进行挂载。请问这是什么原因。
**kubectl get pods**
```
qwen3-8b-d445dbdb7-fqssw 2/2 Running 0 50m
qwen3-8b-d445dbdb7-mcc4p 2/2 Running 0 50m
```

**kubectl describe modeladapter qwen3-8b-cflora**
```
Name: qwen3-8b-cflora
Namespace: default
Labels: model.aibrix.ai/name=qwen3-8b-cflora
model.aibrix.ai/port=8000
Annotations:
API Version: model.aibrix.ai/v1alpha1
Kind: ModelAdapter
Metadata:
Creation Timestamp: 2025-10-17T07:42:18Z
Finalizers:
adapter.model.aibrix.ai/finalizer
Generation: 1
Resource Version: 441059
UID: 71775340-593c-442d-83f8-f540e2dcb377
Spec:
Artifact URL: /lora_models/qwen3-8b-cflora
Base Model: qwen3-8b
Pod Selector:
Match Labels:
adapter.model.aibrix.ai/enabled: true
model.aibrix.ai/name: qwen3-8b
Replicas: 2
Scheduler Name: least-adapters
Status:
Conditions:
Last Transition Time: 2025-10-17T07:42:18Z
Message: Starting reconciliation
Reason: ModelAdapterPending
Status: Unknown
Type: Initialized
Last Transition Time: 2025-10-17T07:42:18Z
Message: ModelAdapter default/qwen3-8b-cflora has been allocated to pod default/qwen3-8b-d445dbdb7-mcc4p
Reason: Scheduled
Status: True
Type: Scheduled
Last Transition Time: 2025-10-17T07:42:18Z
Message: ModelAdapter default/qwen3-8b-cflora is ready
Reason: ModelAdapterAvailable
Status: True
Type: Ready
Instances:
qwen3-8b-d445dbdb7-mcc4p
Phase: Running
Events:
```
查看aibrix-controller-manager 中会有如下日志,不知道是不是这个错误导致。
`E1017 07:42:18.600173 1 controller.go:316] "msg"="Reconciler error" "error"="update modelAdapter status error: Operation cannot be fulfilled on modeladapters.model.aibrix.ai \"qwen3-8b-cflora\": the object has been modified; please apply your changes to the latest version and try again" "ModelAdapter"={"name":"qwen3-8b-cflora","namespace":"default"} "controller"="model-adapter-controller" "controllerGroup"="model.aibrix.ai" "controllerKind"="ModelAdapter" "name"="qwen3-8b-cflora" "namespace"="default" "reconcileID"="303a4507-3868-4d8c-b6cd-cf8c43cda29e"
`

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.