apache / apache/airflow

Playback of the workflow statuses in the Graph View for a specific DAG run

Open
#12,965 1 comment 0 reactions 0 assignees View on GitHub
area:UI kind:feature
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 9h
Merged PRs (30d)
472

Description

**Description**

I find myself a lot with the need to see how execution happened in retrospect.
I'm looking for a **play** button that will show how the ETL progressed over time.
The information for that play is recorded in the database as for specific run Airflow knows the timestamps of each task try (start, end, status)

So lets say I have ETL that looks like:

A = DummyOperator(task_id='1')
B = PythonOperator(task_id='2')
C = DummyOperator(task_id='3')

```
A >> B
C
```

There are many possible scenarios for the execution of this ETL in a specific run. C can run before A, they can run in parallel etc.

So what I want to see is the reproduce step according to the timestamps in a graphic way
For example (steps):

```
A becomes brown (Scheduled)
C becomes grey (Scheduled)
A becomes grey (Queued)
A becomes light green (Running)
C becomes grey (Queued)
A becomes yellow (Up for retry)
C becomes light green (Running)
C becomes green (Success)
A becomes light green (Running)
A becomes green (Success)
```

This representation in text doesn't really tell the full story but it's the best I can do in "tree" manner.
I know we have the Gant View but this is a static view and also it shows only the last run of each task.

**More Info**
While playing the playback if I can also pause it or control over the playback speed it would be great.
The playback doesn't really execute anything. It's just a nice playback of how the tasks statuses changed over time in a specific DAG run.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.