vllm-project / vllm-project/aibrix
Improve the needsUpdateDeployment logics
Open
area/kv-cache
kind/feature
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 98
Description
### 🚀 Feature Description and Motivation
Varun raise great point on the checking logic
1. consider number of containers
2. Second, better to have a second loop to match by container name rather than depending on the container index (removes the assumption part).
### Use Case
_No response_
### Proposed Solution
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.