Add defer support for SQLExecuteQueryOperator
Open
area:providers
kind:feature
provider:common-sql
- Dominant language
- Python
- Stars
- 46.9k
- Forks
- 17.8k
- Avg merge
- 2d 7h
- Merged PRs (30d)
- 484
Description
### Body
The SQLExecuteQueryOperator serves several kind of DBs: Sqlite, PostgresSQL, Snowflake etc..
We want to explore the option to add defer capabilities to this operator which will be very helpful when running long duration queries.
### Committer
- [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Contributor guide
Research direction
Start by locating SQLExecuteQueryOperator and reviewing how its SQLite, PostgreSQL, and other database execution paths handle long-running queries. Compare the operator's current behavior with Airflow's defer capabilities and define how completion and existing query behavior should be preserved for each supported database.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- postgresql, python, sql, sqlite
- Domain
- data-engineering, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100