Azure / Azure/azureml-examples

"Serverless Endpoints" aka "Scale to Zero"

Open
#1,905 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Jupyter Notebook
Stars
2k
Forks
1.7k
Avg merge
18h 18m
Merged PRs (30d)
2

Description

### Describe your suggestion

I would like to know if serverless endpoints or scale-to-zero endpoints are something that the Azure team is working on. I think I don't need to get into why this feature would be beneficial to have and I believe AWS rolled out something similar earlier this year.

Is it on the roadmap? When is it expected to come?

EDIT: To clarify I'm not talking about auto shutoff for compute instances. I'm talking about something similar for inference endpoints.

Thanks,

### Additional details

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.