vllm-project / vllm-project/aibrix
Parallelize initContainer and main container image downloading
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 98
Description
### 🚀 Feature Description and Motivation

Main container image is pulled after initContainer is done. If the initContainer runs time consuming work, there's an opportunity to download the image at the same time. In this case, it's faster that the workflow that pull image -> starts the engine -> pull model from remote.
### Use Case
_No response_
### Proposed Solution
_No response_
Contributor guide
Research direction
Start by locating the workflow that pulls the initContainer and main container images, then trace how the engine starts and the model is fetched. Define how image downloads can overlap without changing container startup ordering, and verify that the resulting workflow preserves the intended engine and model initialization behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- kubernetes
- Domain
- infrastructure
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100