aws / aws/sagemaker-python-sdk
PyTorch image_uris for graviton is outdated
- Dominant language
- Python
- Stars
- 2.3k
- Forks
- 1.3k
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 32
Description
The list of `inference_graviton` image URIs is out-of-date, making it difficult to deploy models on graviton with the latest PyTorch version.
The SDK says 2.4.0 is latest version:
https://github.com/aws/sagemaker-python-sdk/blob/ad190b995c492ce3904a24502fec63e2eeb53abd/sagemaker-core/src/sagemaker/core/image_uri_config/pytorch.json#L1352-L1363
Although 2.6.0 has been available for a year:
- https://github.com/aws/deep-learning-containers/blob/master/available_images.md#sagemaker-framework-arm64graviton-containers-sm-support-only
- https://github.com/aws/deep-learning-containers/commit/b41cd39059d22041a156c4c47dfaf12438d1d796
## Workaround
It's still possible to manually provide the image URI to the ModelBuilder which leads to a working deployment.
Contributor guide
Assessment
This issue has not been assessed yet.