aws / aws/sagemaker-python-sdk

[Feature request]: Selectively execute a pipeline step which has upstream dependencies

オープン
#4,444 コメント 0 件 リアクション 0 件 担当者 1 名 @nargokul が担当を希望しています GitHub で見る
component: pipelines type: feature request
主要言語
Python
スター
2.3k
フォーク
1.3k
平均マージ
1日 22時間
マージ済み PR(30日)
35

説明

**Describe the feature you'd like**
A feature to selectively execute a sagemaker pipeline step which has upstream dependencies when all the dependent parameter for the step is passed via a dict.

Presently using `sagemaker.workflow.selective_execution_config.SelectiveExecutionConfig` to execute a pipeline with dependencies gives a client error.

```sh
ClientError: An error occurred (ValidationException) when calling the StartPipelineExecution operation: Invalid
SourcePipelineExecutionArn: null. The selected steps [] have dependencies on [, ...]
```

The expected behavior would be to execute the step successfully when the dependent parameters are passed.

**How would this feature be used? Please describe.**

- Selective execution of steps which are downstream which have many dependencies. Executing all the dependencies seems wasteful.

**Describe alternatives you've considered**

- Execute all dependencies, current feature.
- Create a temporary new pipeline with the specification for the step by removing the dependency and executing it.

**Additional context**
sagemaker sdk version: 2.208.0

Any alternative or suggestion would be helpful.

コントリビューションガイド

コントリビューションガイドを開く

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。