aws / aws/sagemaker-python-sdk

Native GRPC Support for Endpoints

Offen
#2,458 0 Kommentare 2 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
component: hosting type: feature request
Vorherrschende Sprache
Python
Sterne
2.3k
Forks
1.3k
Ø Merge
1 T. 22 Std.
Gemergte PRs (30 T.)
35

Beschreibung

**Describe the feature you'd like**
Add support for making `GRPC` calls to sagemaker endpoints for model serving/batch transform. Currently, only `REST` is supported.

**How would this feature be used? Please describe.**
If one plans to deploy a model in an environment where clients make GRPC calls, it is currently not possible to use sagemaker to deploy models. REST is not an option in some deployment environments.

**Describe alternatives you've considered**
I understand there is the option to serialize the request/response data into recordio/protobuf and make a REST call but if clients are expecting to make GRPC calls, this is not an option.

If production clients will make GRPC calls it is not really worth the effort to implement a REST `serve` entrypoint in images, as it won't match how the model is called in production. This results in two different images and custom frameworks around serving/batch transformation. It would greatly improve the experience if data scientists are able to test a model with GRPC then directly deploy it via sagemaker.

**Additional context**
Getting a feeler out here for if this may be eventually supported. Is this something that could potentially be implemented in the sdk alone or would it require changes to proprietary apis? Basically, wondering if this is something that could be implemented by the community.

Beitragsleitfaden

Beitragsleitfaden öffnen

Rechercherichtung

Das Issue identifiziert keine SDK-Dateien, Tests oder Einstiegspunkte für den SageMaker-Endpunkt und die batch-transform-Pfade. Bestimme zunächst, ob native GRPC-Unterstützung im Python SDK implementiert werden kann oder Änderungen an der proprietären SageMaker API erfordert; abgeschlossen wäre die Arbeit, wenn Clients GRPC-Aufrufe für das Model Serving und die Batch-Transformation durchführen können.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Bewertung

Tech-Stack
aws, grpc, python
Bereich
api, cloud, machine-learning
Issue-Typ
Feature
Schwierigkeit
5/5
Geschätzter Aufwand
Über eine Woche
Aktivitätsstatus
Veraltet
Klarheit
Muss geklärt werden
Anfängerfreundlichkeit
20/100

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.