vllm-project / vllm-project/aibrix
Lora Scheduler should pick up the new generation pod for migration
Open
area/lora
kind/enhancement
priority/important-longterm
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 98
Description
### 🚀 Feature Description and Motivation
Follow up issue here. https://github.com/aibrix/aibrix/issues/600
There's a potential improvement, scheduler should pick up the new pod rather than old pod. Otherwise it will experience another round migration
### Use Case
_No response_
### Proposed Solution
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.