aws / aws/sagemaker-python-sdk

PyTorch image_uris for graviton is outdated

Open Beginner friendly
#5,532 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
2.3k
Forks
1.3k
Avg merge
1d 22h
Merged PRs (30d)
35

Description

The list of `inference_graviton` image URIs is out-of-date, making it difficult to deploy models on graviton with the latest PyTorch version.

The SDK says 2.4.0 is latest version:
https://github.com/aws/sagemaker-python-sdk/blob/ad190b995c492ce3904a24502fec63e2eeb53abd/sagemaker-core/src/sagemaker/core/image_uri_config/pytorch.json#L1352-L1363

Although 2.6.0 has been available for a year:
- https://github.com/aws/deep-learning-containers/blob/master/available_images.md#sagemaker-framework-arm64graviton-containers-sm-support-only
- https://github.com/aws/deep-learning-containers/commit/b41cd39059d22041a156c4c47dfaf12438d1d796

## Workaround
It's still possible to manually provide the image URI to the ModelBuilder which leads to a working deployment.

Contributor guide

Open the contributing guide

Research direction

Open sagemaker-core/src/sagemaker/core/image_uri_config/pytorch.json at the inference_graviton entries cited in the issue. Compare those URIs with the SageMaker Graviton container list and linked Deep Learning Containers commit, then update the outdated PyTorch version entry; done means the SDK exposes the available 2.6.0 image URI for Graviton deployments.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python, pytorch
Domain
cloud, machine-learning
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Clearly specified
Newbie friendliness
74/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.