aws / aws/sagemaker-hyperpod-cli

Autoscaling configuration for custom endpoints misses some capabilities

Open
#305 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
41
Forks
95
Avg merge
23h 5m
Merged PRs (30d)
8

Description

The autoscaling configuration for custom endpoints misses some configurations in the template, including min and max replica counts, cooldown period and more.
The Prometheus trigger is also missing.

Reference: https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-model-deployment-autoscaling.html#sagemaker-hyperpod-model-deployment-autoscaling-yaml

The problem is that these parameters are completely missing from the template so there is no way to use them with the current CLI.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.