aws / aws/sagemaker-python-sdk

Multi-model endpoint workers die when sklearn entrypoint imports package installed with requirements.txt

Đã đóng
#1,833 7 bình luận 0 reaction 1 người được giao Được @mollyheamazon nhận Xem trên GitHub
Pending information scikit-learn
Ngôn ngữ chính
Python
Star
2.3k
Fork
1.3k
Merge trung bình
1 ngày 22 giờ
Pull request đã merge (30 ngày)
35

Mô tả

Multi-model endpoint workers die when the entry point imports a package installed through requirements.txt. The package is installed successfully and the endpoint is created successfully, but inference requests always fail.

```
ModelError: An error occurred (ModelError) when calling the InvokeEndpoint operation: Received server error (500) from model with message "{
"code": 500,
"type": "InternalServerException",
"message": "Worker died."
}
```

**To reproduce**
Include a requirements.txt in the `source_dir` and import the installed package in the entry point script or the `model_fn`.

https://gist.github.com/gavinmh/267bc34ddedaf0931151a901859e165d changes the `sklearn_multi_model_endpoint_home_value.ipynb` example notebook.

In particular, it adds:

```
%%writefile $SOURCE_DIR/requirements.txt

shap
```

**Expected behavior**
`shap` is imported.

**Screenshots or logs**

![image](https://user-images.githubusercontent.com/1227260/90271794-fc83bb00-de21-11ea-8320-b39147a4e422.png)

![image](https://user-images.githubusercontent.com/1227260/90271384-5a63d300-de21-11ea-847d-63df4a66b3a7.png)

**System information**
A description of your system. Please provide:
- **SageMaker Python SDK version**: 2.3.0
- **Framework name (eg. PyTorch) or algorithm (eg. KMeans)**: sklearn
- **Framework version**: 0.23-1
- **Python version**: 3.7
- **CPU or GPU**: CPU
- **Custom Docker image (Y/N)**: N

**Additional context**
Add any other context about the problem here.

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.