aws / aws/sagemaker-python-sdk

Sagemaker local client invoke_endpoint returns different response than non local counterpart

未关闭
#3,348 0 条评论 0 个 reaction 已指派 1 人 已被 @nargokul 认领 在 GitHub 查看
component: local mode type: bug
主要语言
Python
星标
2.3k
派生
1.3k
平均合并
1 天 22 小时
30 天内合并 PR
35

描述

Sagemaker local client invoke_endpoint method returns a different response than using the boto3 runtime_client, so it makes debugging difficult in local mode, because the same code wouldn't work in production. The missing part is the ResponseMetadata key in the payload
it just returns Body and ContentType
I would want to access ResponseMetadata, InvokedProductionVariant and other related metadata in local mode

**To reproduce**
1. Have a local container running the sagemaker model
2. Invoke the endpoint with sagemaker local client
```python
sagemaker_session = LocalSession()
sagemaker_session.config = {"local": {"local_code": True}}
sm_client = sagemaker_session.sagemaker_runtime_client
response = sm_client.invoke_endpoint(
EndpointName="local-endpoint-name",
ContentType="application/json",
Body=json.dumps(payload),
)
response["ResponseMetadata"]["HTTPStatusCode"] <- Fails
```

**Expected behavior**
the local client should return the same response as the non-local client
local client
```json
{"Body": "foo", "ContentType": "bar"}
```
non-local client
```json
{"Body": "foo", "ContentType": "bar", "ResponseMetadata": {"foo": "bar"}}
```

**System information**
A description of your system. Please provide:
- **SageMaker Python SDK version**: 2.108.0
- **Python version**: 3.7.10
- **CPU or GPU**: CPU
- **Custom Docker image (Y/N)**: Y

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。