aws / aws/sagemaker-hyperpod-cli
Autoscaling configuration for custom endpoints misses some capabilities
Open
- Dominant language
- Python
- Stars
- 41
- Forks
- 95
- Avg merge
- 23h 5m
- Merged PRs (30d)
- 8
Description
The autoscaling configuration for custom endpoints misses some configurations in the template, including min and max replica counts, cooldown period and more.
The Prometheus trigger is also missing.
Reference: https://docs.aws.amazon.com/sagemaker/latest/dg/sagemaker-hyperpod-model-deployment-autoscaling.html#sagemaker-hyperpod-model-deployment-autoscaling-yaml
The problem is that these parameters are completely missing from the template so there is no way to use them with the current CLI.
Contributor guide
Assessment
This issue has not been assessed yet.