aws / aws/sagemaker-python-sdk

PyTorch image_uris for graviton is outdated

Open
#5,532 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
2.3k
Forks
1.3k
Avg merge
2d 2h
Merged PRs (30d)
32

Description

The list of `inference_graviton` image URIs is out-of-date, making it difficult to deploy models on graviton with the latest PyTorch version.

The SDK says 2.4.0 is latest version:
https://github.com/aws/sagemaker-python-sdk/blob/ad190b995c492ce3904a24502fec63e2eeb53abd/sagemaker-core/src/sagemaker/core/image_uri_config/pytorch.json#L1352-L1363

Although 2.6.0 has been available for a year:
- https://github.com/aws/deep-learning-containers/blob/master/available_images.md#sagemaker-framework-arm64graviton-containers-sm-support-only
- https://github.com/aws/deep-learning-containers/commit/b41cd39059d22041a156c4c47dfaf12438d1d796

## Workaround
It's still possible to manually provide the image URI to the ModelBuilder which leads to a working deployment.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.