aws / aws/sagemaker-pytorch-inference-toolkit

Is this Dockerfile compatible with sagemaker elastic inference

Open
#128 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
143
Forks
73
PR merge metrics
No merged PRs in 30d

Description

**What did you find confusing? Please describe.**
This is Dockerfile link:
https://github.com/aws/sagemaker-pytorch-inference-toolkit/blob/master/docker/1.5.0/py3/Dockerfile.cpu
This link https://docs.aws.amazon.com/sagemaker/latest/dg/ei-endpoints.html#ei-endpoints-pytorch
states:
You can download the Elastic Inference enabled binary for PyTorch from the public Amazon S3 bucket at [console.aws.amazon.com/s3/buckets/amazonei-pytorch](https://console.aws.amazon.com/s3/buckets/amazonei-pytorch). For information about building a container that uses the Elastic Inference enabled version of PyTorch, see [Building your image](https://github.com/aws/sagemaker-pytorch-serving-container/#building-your-image).
I am confused. If I use the Dockerfile above, do I still need to download and install https://console.aws.amazon.com/s3/buckets/amazonei-pytorch to build docker container image?
If I want to use customer docker image for Sagemaker elastic inference, do I need to convert pytorch code into torchscript?
This part is not covered.
Can I use it for Python version >=3.7 and PyTorch version >=1.12?

**Describe how documentation can be improved**
A clear and concise description of where documentation was lacking and how it can be improved.

**Additional context**
[Add any other context or screenshots about the documentation request here.](https://docs.aws.amazon.com/elastic-inference/latest/developerguide/ei-pytorch-using.html)

Contributor guide

Open the contributing guide

Research direction

Review docker/1.5.0/py3/Dockerfile.cpu and the linked SageMaker Elastic Inference and PyTorch serving documentation. Determine whether the Dockerfile covers the required binary, whether customer images require TorchScript, and which Python and PyTorch versions are supported. Done means documenting clear answers and linking the relevant build and deployment guidance.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, python, pytorch
Domain
cloud, documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.