vllm-project / vllm-project/aibrix
Examples should come with health and readiness checks
Open
good first issue
help wanted
kind/documentation
kind/support
priority/important-soon
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 98
Description
### 🚀 Feature Description and Motivation
Currently, the pod becomes ready immediately, however, the application loading time is still long, at this moment, request to the model server will fail. We used to have such settings but we recently remove them for simplicity.
### Use Case
for stable deployment
### Proposed Solution
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.