intel / intel/llm-scaler

Feature request: Support sleep mode

Open
#568 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
529
Forks
80
Avg merge
9h 7m
Merged PRs (30d)
38

Description

vLLM's sleep mode is not aviable for the Intel Backend. To save on Idle Power Consumption it would be great to add the XPU backend

Contributor guide

Open the contributing guide

Research direction

Start by locating the existing sleep-mode implementation and the Intel/XPU backend entry points in llm-scaler. Compare how sleep mode is supported for other backends, then identify the XPU-specific work needed and verify that idle power consumption is reduced without breaking backend operation.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.