apache / apache/airflow

Serialize ExternalTaskMarker dag dependency

Open
#44,879 0 comments 0 reactions 0 assignees View on GitHub
area:serialization kind:meta
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 7h
Merged PRs (30d)
484

Description

### Body

Related to: https://github.com/apache/airflow/issues/42367

Final Goal:
`SerializedDagModel.get_dag_dependencies()` is not returning linked objects related to `ExternalTaskMarker`. This is useful for the front-end to be able to display that a specific dag /task depends on an external task.

Consideration:
- This impacts how we serialize dags, especially the `dag_dependencies` fields.

### Committer

- [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Contributor guide

Open the contributing guide

Research direction

Start with SerializedDagModel.get_dag_dependencies() and the ExternalTaskMarker behavior described in the issue. Trace how dag_dependencies are serialized, then verify that linked ExternalTaskMarker objects appear in the returned dependencies and that the front-end can identify the external DAG/task relationship.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend, data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.