aws / aws/aws-cdk

[aws-stepfunctions-tasks] Add support for SageMaker Processing

Open
#9,537 10 comments 25 reactions 1 assignee Claimed by @kaizencc View on GitHub
@aws-cdk/aws-stepfunctions-tasks effort/medium feature-request in-progress p1
Dominant language
TypeScript
Stars
12.9k
Forks
4.6k
Avg merge
2d 3h
Merged PRs (30d)
83

Description

SageMaker and Step Functions released a new integration to create processing jobs directly in the state machine:
- https://docs.aws.amazon.com/step-functions/latest/dg/connect-sagemaker.html#sagemaker-example-processing
- https://docs.aws.amazon.com/sagemaker/latest/APIReference/API_CreateProcessingJob.html

### Use Case

SageMaker Processing is a very flexible API call that can be used to run preprocessing/post-processing and therefore fully automate a ML use case using Step Functions.

### Proposed Solution

Use https://github.com/aws/aws-cdk/blob/master/packages/%40aws-cdk/aws-stepfunctions-tasks/lib/sagemaker/create-training-job.ts as starting point.

### Other

* [ ] :wave: I may be able to implement this feature request

---

This is a :rocket: Feature Request

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.