Azure / Azure/azureml-examples

Many to one relationsship between components

Open
#2,840 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Jupyter Notebook
Stars
2k
Forks
1.7k
Avg merge
18h 18m
Merged PRs (30d)
2

Description

### Describe your suggestion

Hi,

**Request**
Is it possible to support many-to-one relationsship between components ?

**Explanation**
As of now its possible to take the output of one component and set it as input for as many components you like in a pipeline.
What I would like to do, is to take the output of an unknown amount of components and point them all to the same input of another component.

**Why is this needed**
When creating ensemble-models I would like to test with different kinds of base-models. Azure ML could be great for this due to its pipeline + component + designer functionality. But to make this work, I need a component that takes either the forecast from multiple models or the trained model itself. See picture below for clearification:
![image](https://github.com/Azure/azureml-examples/assets/9076403/dce4b5d7-6a49-4c8d-a2f4-9e41f4840b00)

With this functionality we could
1. Developers create a library of model-components (untrained models)
2. Data scientists can use the designer tool to drag and drop these models into a pipeline and create an ensemble of them using the ensemble component.

**Possible alternatives**
If one could define dependencies between components (e.g. combonent D shal not run before all of the components A to C are done), then this could also be solved by writing models/forecasts to a storage then using the same storage location as input in the ensemble component.

### Additional details

_No response_

Contributor guide

Open the contributing guide

Research direction

Begin with the Azure ML pipeline, component, and Designer behavior described in the issue; no repository files or tests are identified. Done would require a documented implementation path for feeding an unknown number of component outputs into one input, or for using the proposed dependency and storage alternative.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.