caikit / caikit/caikit-ray-backend
Handle resource schedueling requests from caikit
- Dominant language
- Python
- Stars
- 0
- Forks
- 3
- PR merge metrics
- No merged PRs in 30d
Description
## Is your feature request related to a problem? Please describe.
The Ray backend can currently request CPU/GPU resources per job, but caikit has no way of passing these in currently.
## Describe the solution you'd like
There is an issue open to add this feature, and the Ray backend will need to adapt to the approach caikit will use to specify resources, in order to appropriately schedule jobs according to resource needs
## Describe alternatives you've considered
## Additional context
Caikit issue: https://github.com/caikit/caikit/issues/494
Contributor guide
Research direction
Start by reading the caikit issue #494 to understand the resource specification it introduces, then inspect the Ray backend's existing per-job CPU/GPU resource request path. Done means the backend accepts caikit's resource requests and schedules jobs according to those requirements.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100