aws / aws/sagemaker-python-sdk

Request image_uris.retrieve utility to include inf2 / neuron containers.

Open
#4,035 0 comments 0 reactions 1 assignee Claimed by @mollyheamazon View on GitHub
component: neo Pending information
Dominant language
Python
Stars
2.3k
Forks
1.3k
Avg merge
1d 22h
Merged PRs (30d)
35

Description

**Describe the feature you'd like**
Request image_uris.retrieve utility to include inf2 containers.
```
baseimage = sagemaker.image_uris.retrieve(
framework="Neuron",
region=region,
py_version="py310",
image_scope="inference",
version="2.12.0",
instance_type="ml.inf2.24xlarge",
)
print(baseimage)

FileNotFoundError: [Errno 2] No such file or directory: '/home/ec2-user/anaconda3/envs/python3/lib/python3.10/site-packages/sagemaker/image_uri_config/Neuron.json'
```
Need to update this: src/sagemaker/image_uri_config/

Output should be the correct ECR image:

eg. 763104351884.dkr.ecr.us-west-2.amazonaws.com/pytorch-inference-neuronx:1.13.1-neuronx-py310-sdk2.12.0-ubuntu20.04

**Describe alternatives you've considered**
Manually searching in https://github.com/aws/deep-learning-containers/blob/master/available_images.md#neuron-containers

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.