Azure / Azure/azureml-examples
Conditional Pipeline Job steps Azure ML v2
- Dominant language
- Jupyter Notebook
- Stars
- 2k
- Forks
- 1.7k
- Avg merge
- 18h 18m
- Merged PRs (30d)
- 2
Description
## What example? Describe it
How to run steps conditionally from a Job pipeline (yaml) if possible at all.
Example:
I want to run a step (fine-tuning for example) only on some boolean condition and I would like to pass this condition inside the yaml file which describe the pipeline Job. ( In Kubeflow this is possible through dsl.condition in the python sdk )
```
$schema: https://azuremlschemas.azureedge.net/latest/pipelineJob.schema.json
type: pipeline
experiment_name: exp
description: description
jobs:
#Training step
train:
name: training
display_name: Model-training
environment: azureml:ccep_train_env_docker@latest
code: ../../training
command: >-
python train_aml.py
**IF :**
#Fine tune step
finetuning:
name: fine_tuning
display_name: Fine-Tuning-Model
code: ../../finetuning
command: >-
python finetune_aml.py
```
Not sure this is possible at all, in case would be great to have an ehnancement, is super useful.
Thanks
-
Contributor guide
Research direction
No repository file, test, or entry point is named. Start by checking the Azure ML v2 pipelineJob schema and existing pipeline examples to determine whether conditional jobs are supported; done requires an agreed YAML behavior or a documented limitation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, python, yaml
- Domain
- cloud, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100