aws / aws/amazon-sagemaker-examples

Sagemaker Endpoint save without running m5.large instance

Open
#4,329 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
11k
Forks
7k
Avg merge
8h 29m
Merged PRs (30d)
8

Description

If I delete an endpoint on a trained model, will I be required to re-train it? How can I save that model and endpoint. To be used later, without continuously running the m5.large instance.

Say, I want to run an inference 2 days later. How can I make sure to not be charged for the endpoint instance for the entire time and only be charged for resources used during inference?
I understand that Deploying an endpoint might require an m5.large instance, whereas using an inference might be done by t3.medium instance. Can you please share documentation on this? or codes/videos? I am trying to understand this concept.

Contributor guide

Open the contributing guide

Research direction

The issue names no repository file, notebook, or test. Start by reviewing SageMaker endpoint deletion, trained-model persistence, and inference options; done would require a clearly scoped example or documentation covering retraining, endpoint costs, and delayed inference.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, machine-learning
Domain
cloud, documentation, machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.