Azure / Azure/MachineLearningNotebooks

Potential feature request: PipelineArgument dynamically derived from PipelineParameter

Open
#1,744 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
4.4k
Forks
2.6k
PR merge metrics
No merged PRs in 30d

Description

Hello,

I couldn't find a pre-existing issue or documentation on this topic. Is it possible to create pipeline parameters which are dynamically generated from the values of other PipelineParameters?

e.g. the below shows the basic scenario we're looking for.

```python

customer_project = PipelineParameter(name="customer_project")
publish_version = PipelineParameter(name="publish_version")

# following is generated from above pipeline parameters but can still be used as an argument in Pipeline Steps
input_data_parameter = PipelineArgument(name="input_data", value_spec="base_input/{param:customer_project}/{param:publish_version}/train")
input_data = (input_data_parameter, DataPathComputeBinding(mode='mount'))
...
train_step = PythonScriptStep(
...
inputs=[input_data]
)

```

Is there a better way to do what I'm trying to do here?

Currently we have some workarounds like have a "parent" PythonScriptStep which just handles submitting child runs, and generating the right paths from pipeline arguments, but it seems like an extra step and ability to have something like above would be nicer for us.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.