apache / apache/airflow

Restore support of starting mapped tasks from triggerer

Open
#48,009 0 comments 0 reactions 0 assignees View on GitHub
area:dynamic-task-mapping area:Triggerer kind:feature kind:meta
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 10h
Merged PRs (30d)
483

Description

### Body

#48006 disabled starting mapped tasks from triggerer because it was crashing the scheduler (https://github.com/apache/airflow/issues/47735). It was discovered late in the airlfow 3 beta process so, disabling it was a reasonable choice.

When time permits, one could look into restoring this capability, perhaps with limitations.

### Committer

- [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Contributor guide

Open the contributing guide

Research direction

Start by reading issues #48006 and #47735 to understand why starting mapped tasks from the triggerer was disabled and how it affected the scheduler. Trace the triggerer-to-scheduler path described there and define acceptable limitations before making changes. Done means the capability is restored without reproducing the scheduler crash.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend, data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.