aws / aws/amazon-sagemaker-examples

"Host a Pretrained Model on SageMaker" tutorial fails with "Received server error (500) from primary and could not load the entire response body."

Open
#4,551 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
11k
Forks
7k
Avg merge
8h 29m
Merged PRs (30d)
8

Description

**Link to the notebook**

https://github.com/aws/sagemaker-python-sdk/files/14076220/deploy-v4-any-pytorch-tutorial.md

**Describe the bug**
"Host a Pretrained Model on SageMaker" tutorial fails with "An error occurred (ModelError) when calling the InvokeEndpoint operation: Received server error (500) from primary and could not load the entire response body."

**To reproduce**
follow https://sagemaker-examples.readthedocs.io/en/latest/sagemaker-script-mode/pytorch_bert/deploy_bert_outputs.html#Deploy-Model

**Logs**

# Expected behavior
![image](https://github.com/aws/amazon-sagemaker-examples/assets/2075175/90b37dd0-2f27-44ff-8d35-927c93ab19dc)

# error seeing

![image](https://github.com/aws/amazon-sagemaker-examples/assets/2075175/1b2b8c47-6ad8-4940-98ed-8cf62f835d77)

# similar post

I made a similar post under aws/sagemaker-python-sdk: https://github.com/aws/sagemaker-python-sdk/issues/4395

Contributor guide

Open the contributing guide

Research direction

Start with the linked deploy-v4-any-pytorch-tutorial.md notebook and follow the Deploy Model section at the referenced pytorch_bert tutorial. Compare the expected behavior with the ModelError response and review the related sagemaker-python-sdk issue for context. Done means the tutorial's endpoint invocation completes successfully and matches the expected result.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, jupyter-notebook, pytorch
Domain
cloud, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.