aws / aws/aws-step-functions-data-science-sdk-python
Feature request: allowing for Retry to work with SageMaker steps
- 主要语言
- Python
- 星标
- 299
- 派生
- 84
- PR 合并指标
- 30 天内没有已合并 PR
描述
Currently, the `Retry` mechanism does not work with `TrainingStep `and `ProcessingStep` as the full job name must be specified to the step constructor so that if the step fails when the job has already been created, all retries will fail in submitting the job as the job name has already been used.
This happens for almost any error (including capacity errors) excluding throttling errors.
A possible solution might be to add an alternative parameter to specify a job name prefix, instead of a full name, and let SageMaker add some random suffix.
贡献指南
调研方向
首先跟踪 TrainingStep 和 ProcessingStep 构造函数,以及 Retry 在失败后如何重新提交作业。检查 SageMaker 作业名称的处理方式,然后验证使用前缀和生成的后缀可以防止名称冲突,同时保留针对容量错误和其他非限流错误的重试。
由索引模型根据 Issue 内容生成。
评估
- 技术栈
- aws, machine-learning, python
- 领域
- cloud, machine-learning
- Issue 类型
- 功能
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 活跃度
- 停滞
- 描述清晰度
- 基本清楚
- 新手友好度
- 35/100