aws / aws/amazon-sagemaker-examples

[Example Request]

Open
#3,294 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
11k
Forks
7k
Avg merge
8h 29m
Merged PRs (30d)
8

Description

Is there a way to add an end step to a sagemaker pipeline that still runs at the very end even if other previous steps fail. Before I thought we could make it a [Fail Step](https://sagemaker.readthedocs.io/en/stable/workflows/pipelines/sagemaker.workflow.pipelines.html?highlight=definition#sagemaker.workflow.fail_step.FailStep) but that only lets you return an error message and doesn’t let you run code. If we made it a conditional step how would we make sure it ran at the very end without depending on any previous steps. I thought of adding all previous steps as a dependency so it runs at the end, but then the end step wouldn't run if any step before that failed.

Contributor guide

Open the contributing guide

Research direction

Start with the linked SageMaker FailStep documentation and the conditional-step behavior described in the issue. Determine whether an end step can run after earlier steps fail without depending on those failed steps; done means a documented, reproducible approach or example.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
cloud, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.