Azure / Azure/azureml-examples

Azure online endpoint is Scaling taking long time

Open
#3,515 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Jupyter Notebook
Stars
2k
Forks
1.7k
Avg merge
18h 18m
Merged PRs (30d)
2

Description

### Operating System

Linux

### Version Information

Using the latest version of ML online endpoint

### Steps to reproduce

I have a project to run an AI model using an online endpoint as a backend service, the endpoint is configured (manually set in the portal) to be auto-scale based on the number of requests.

![Image](https://github.com/user-attachments/assets/3036582c-43df-4136-8d47-d775bce90113)

### Expected behavior

Expect the endpoint will scale up between 1-2 minutes like other services such as virtual machine scaleset, etc...

### Actual behavior

With endpoint, scaling takes a long time, about 12-18 minutes.

### Addition information

Do you have suggestions for speeding up the scaling time?

Contributor guide

Open the contributing guide

Research direction

The issue provides no repository file, test, or implementation entry point. Start by reviewing the Azure Machine Learning online endpoint autoscale configuration in the portal and the reported 12–18 minute behavior; done would require a documented, reproducible cause or a confirmed way to reduce the scale-up time.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure
Domain
ai, cloud, performance
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.