aws / aws/sagemaker-python-sdk

model.deploy to allow for auto scale configuration

Closed
#1,880 2 comments 0 reactions 0 assignees View on GitHub
component: Inference APIs and Interfaces type: feature request
Dominant language
Python
Stars
2.3k
Forks
1.3k
Avg merge
1d 22h
Merged PRs (30d)
35

Description

**Describe the feature you'd like**

today we deploy a model like so:

```python
model = SKLearn(
entry_point=script_path,
framework_version="0.20.0",
py_version="py3",
instance_type="ml.m5.2xlarge",
role=role,
sagemaker_session=sagemaker_session,
dependencies=[...],
)

predictor = model.deploy(
endpoint_name="some_name",
initial_instance_count=1,
instance_type="ml.m5.large",
predictor_cls=SKLearnPredictorJson,
)
```

**How would this feature be used? Please describe.**

When calling `model.deploy` it would be ideal if there was a way to set an autoscale policy (similar to how we can set `initial_instance_count`).

**Describe alternatives you've considered**

I'm still researching if I can use `SKLearn` class while also using boto3 to attach a policy.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.