apache / apache/airflow

Explore and add static checks for DAGs for early detection of common issues

Open
#43,176 34 comments 4 reactions 1 assignee Claimed by @Lee-W View on GitHub
area:DAG-processing kind:feature
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 10h
Merged PRs (30d)
483

Description

### Description

As per users' feedback in the Airflow Debugging Survey 2024, 48.3% of respondents chose early issue detection during execution as one of their top 2 choices.

### Use case/motivation

Goal of this issue:
- Enhance early detection of DAG issues to minimize dev time
- Some sort of static analysis similar to Ruff checks for DAGs
- Runtime analysis of DAGs if feasible can also be done to save dev time

### Related issues

Parent Issue: https://github.com/apache/airflow/issues/40975

### Are you willing to submit a PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.