Support Dynamic Replica Adjustment at Runtime Without Service Interruption
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 682
- Forks
- 128
- Avg merge
- 9h 44m
- Merged PRs (30d)
- 1
Description
Hi Vidur Team,
We are researching auto-scaling solutions for large models and have found your simulator to be highly valuable for our work!
However, the simulator currently only supports static configuration upon startup. We are interested in knowing: Is it feasible to modify it to support dynamic replica count adjustment during runtime? Does your team have plans to implement such a feature? Alternatively, could you provide some guidance? This would allow us to observe the impact of different replica counts on various metrics without interrupting the service.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are identified. Start by tracing how replica counts are configured at startup and how runtime metrics are collected; done means replica counts can change during simulation without service interruption and the metric impact can be observed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100