vllm-project / vllm-project/aibrix
lora的modeladapter中设置Replicas多副本不生效
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 98
Description
我这边对一个基础模型分别尝试启动2个pod和5个pod,然以后调整modeladapter.yaml中Replicas数量。 想实现多pod挂载lora,但是每次尝试发现都只有一个pod会进行挂载。请问这是什么原因。
**kubectl get pods**
```
qwen3-8b-d445dbdb7-fqssw 2/2 Running 0 50m
qwen3-8b-d445dbdb7-mcc4p 2/2 Running 0 50m
```
**kubectl describe modeladapter qwen3-8b-cflora**
```
Name: qwen3-8b-cflora
Namespace: default
Labels: model.aibrix.ai/name=qwen3-8b-cflora
model.aibrix.ai/port=8000
Annotations:
API Version: model.aibrix.ai/v1alpha1
Kind: ModelAdapter
Metadata:
Creation Timestamp: 2025-10-17T07:42:18Z
Finalizers:
adapter.model.aibrix.ai/finalizer
Generation: 1
Resource Version: 441059
UID: 71775340-593c-442d-83f8-f540e2dcb377
Spec:
Artifact URL: /lora_models/qwen3-8b-cflora
Base Model: qwen3-8b
Pod Selector:
Match Labels:
adapter.model.aibrix.ai/enabled: true
model.aibrix.ai/name: qwen3-8b
Replicas: 2
Scheduler Name: least-adapters
Status:
Conditions:
Last Transition Time: 2025-10-17T07:42:18Z
Message: Starting reconciliation
Reason: ModelAdapterPending
Status: Unknown
Type: Initialized
Last Transition Time: 2025-10-17T07:42:18Z
Message: ModelAdapter default/qwen3-8b-cflora has been allocated to pod default/qwen3-8b-d445dbdb7-mcc4p
Reason: Scheduled
Status: True
Type: Scheduled
Last Transition Time: 2025-10-17T07:42:18Z
Message: ModelAdapter default/qwen3-8b-cflora is ready
Reason: ModelAdapterAvailable
Status: True
Type: Ready
Instances:
qwen3-8b-d445dbdb7-mcc4p
Phase: Running
Events:
```
查看aibrix-controller-manager 中会有如下日志,不知道是不是这个错误导致。
`E1017 07:42:18.600173 1 controller.go:316] "msg"="Reconciler error" "error"="update modelAdapter status error: Operation cannot be fulfilled on modeladapters.model.aibrix.ai \"qwen3-8b-cflora\": the object has been modified; please apply your changes to the latest version and try again" "ModelAdapter"={"name":"qwen3-8b-cflora","namespace":"default"} "controller"="model-adapter-controller" "controllerGroup"="model.aibrix.ai" "controllerKind"="ModelAdapter" "name"="qwen3-8b-cflora" "namespace"="default" "reconcileID"="303a4507-3868-4d8c-b6cd-cf8c43cda29e"
`
Contributor guide
Assessment
This issue has not been assessed yet.