Feature request: Support sleep mode
Open
- Dominant language
- C++
- Stars
- 529
- Forks
- 80
- Avg merge
- 9h 7m
- Merged PRs (30d)
- 38
Description
vLLM's sleep mode is not aviable for the Intel Backend. To save on Idle Power Consumption it would be great to add the XPU backend
Contributor guide
Research direction
Start by locating the existing sleep-mode implementation and the Intel/XPU backend entry points in llm-scaler. Compare how sleep mode is supported for other backends, then identify the XPU-specific work needed and verify that idle power consumption is reduced without breaking backend operation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 38/100