aws / aws/sagemaker-python-sdk
Multi-model endpoint workers die when sklearn entrypoint imports package installed with requirements.txt
- Dominant language
- Python
- Stars
- 2.3k
- Forks
- 1.3k
- Avg merge
- 1d 22h
- Merged PRs (30d)
- 35
Description
Multi-model endpoint workers die when the entry point imports a package installed through requirements.txt. The package is installed successfully and the endpoint is created successfully, but inference requests always fail.
```
ModelError: An error occurred (ModelError) when calling the InvokeEndpoint operation: Received server error (500) from model with message "{
"code": 500,
"type": "InternalServerException",
"message": "Worker died."
}
```
**To reproduce**
Include a requirements.txt in the `source_dir` and import the installed package in the entry point script or the `model_fn`.
https://gist.github.com/gavinmh/267bc34ddedaf0931151a901859e165d changes the `sklearn_multi_model_endpoint_home_value.ipynb` example notebook.
In particular, it adds:
```
%%writefile $SOURCE_DIR/requirements.txt
shap
```
**Expected behavior**
`shap` is imported.
**Screenshots or logs**


**System information**
A description of your system. Please provide:
- **SageMaker Python SDK version**: 2.3.0
- **Framework name (eg. PyTorch) or algorithm (eg. KMeans)**: sklearn
- **Framework version**: 0.23-1
- **Python version**: 3.7
- **CPU or GPU**: CPU
- **Custom Docker image (Y/N)**: N
**Additional context**
Add any other context about the problem here.
Contributor guide
Assessment
This issue has not been assessed yet.