aws / aws/aws-step-functions-data-science-sdk-python

Feature request: allowing for Retry to work with SageMaker steps

Open
#140 5 comments 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
299
Forks
84
PR merge metrics
No merged PRs in 30d

Description

Currently, the `Retry` mechanism does not work with `TrainingStep `and `ProcessingStep` as the full job name must be specified to the step constructor so that if the step fails when the job has already been created, all retries will fail in submitting the job as the job name has already been used.
This happens for almost any error (including capacity errors) excluding throttling errors.

A possible solution might be to add an alternative parameter to specify a job name prefix, instead of a full name, and let SageMaker add some random suffix.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.