aws / aws/amazon-sagemaker-examples
[Example Request]
- Dominant language
- Jupyter Notebook
- Stars
- 11k
- Forks
- 7k
- Avg merge
- 8h 29m
- Merged PRs (30d)
- 8
Description
Is there a way to add an end step to a sagemaker pipeline that still runs at the very end even if other previous steps fail. Before I thought we could make it a [Fail Step](https://sagemaker.readthedocs.io/en/stable/workflows/pipelines/sagemaker.workflow.pipelines.html?highlight=definition#sagemaker.workflow.fail_step.FailStep) but that only lets you return an error message and doesn’t let you run code. If we made it a conditional step how would we make sure it ran at the very end without depending on any previous steps. I thought of adding all previous steps as a dependency so it runs at the end, but then the end step wouldn't run if any step before that failed.
Contributor guide
Research direction
Start with the linked SageMaker FailStep documentation and the conditional-step behavior described in the issue. Determine whether an end step can run after earlier steps fail without depending on those failed steps; done means a documented, reproducible approach or example.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws
- Domain
- cloud, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100