caikit / caikit/caikit-ray-backend

Handle resource schedueling requests from caikit

Open
#41 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
0
Forks
3
PR merge metrics
No merged PRs in 30d

Description

## Is your feature request related to a problem? Please describe.

The Ray backend can currently request CPU/GPU resources per job, but caikit has no way of passing these in currently.

## Describe the solution you'd like

There is an issue open to add this feature, and the Ray backend will need to adapt to the approach caikit will use to specify resources, in order to appropriately schedule jobs according to resource needs

## Describe alternatives you've considered

## Additional context

Caikit issue: https://github.com/caikit/caikit/issues/494

Contributor guide

Open the contributing guide

Research direction

Start by reading the caikit issue #494 to understand the resource specification it introduces, then inspect the Ray backend's existing per-job CPU/GPU resource request path. Done means the backend accepts caikit's resource requests and schedules jobs according to those requirements.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.