Azure / Azure/azureml-examples

Conditional Pipeline Job steps Azure ML v2

Open
#1,469 13 comments 8 reactions 0 assignees View on GitHub
example request pipeline
Dominant language
Jupyter Notebook
Stars
2k
Forks
1.7k
Avg merge
18h 18m
Merged PRs (30d)
2

Description

## What example? Describe it

How to run steps conditionally from a Job pipeline (yaml) if possible at all.

Example:
I want to run a step (fine-tuning for example) only on some boolean condition and I would like to pass this condition inside the yaml file which describe the pipeline Job. ( In Kubeflow this is possible through dsl.condition in the python sdk )

```
$schema: https://azuremlschemas.azureedge.net/latest/pipelineJob.schema.json
type: pipeline
experiment_name: exp
description: description

jobs:
#Training step
train:
name: training
display_name: Model-training
environment: azureml:ccep_train_env_docker@latest
code: ../../training
command: >-
python train_aml.py
**IF :**
#Fine tune step
finetuning:
name: fine_tuning
display_name: Fine-Tuning-Model
code: ../../finetuning
command: >-
python finetune_aml.py

```
Not sure this is possible at all, in case would be great to have an ehnancement, is super useful.

Thanks

-

Contributor guide

Open the contributing guide

Research direction

No repository file, test, or entry point is named. Start by checking the Azure ML v2 pipelineJob schema and existing pipeline examples to determine whether conditional jobs are supported; done requires an agreed YAML behavior or a documented limitation.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, python, yaml
Domain
cloud, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.