nebari-dev / nebari-dev/rayserve-pack
[ENH] - Add ability to scale nodes to zero
Open
Nobody has claimed this yet.
- Dominant language
- Makefile
- Stars
- 1
- Forks
- 4
- Avg merge
- 3d 14h
- Merged PRs (30d)
- 5
Description
Feature description
We currently have to set a defined number of nodes that are always available. I would like the ability to have nodes scale down when they aren't in use.
Value and/or benefit
Greatly reduce operational costs of the platform and also enable it scale as needed.
Anything else?
Note: I'm working on AWS GovCloud.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by inspecting how the RayService CRD and nebari-operator currently define and provision nodes. Determine the autoscaling behavior needed for unused nodes, including AWS GovCloud constraints. Done means nodes can scale to zero when idle and scale back up as demand requires.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, kubernetes
- Domain
- cloud, infrastructure
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 45/100