apache / apache/airflow

Add control over bundle "version in db" check in pasring loop

Open
#46,130 0 comments 0 reactions 1 assignee Claimed by @jedcunningham View on GitHub
area:core area:dag-bundles kind:meta
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 10h
Merged PRs (30d)
483

Description

### Body

Right now, in order to protect against multiple DAG processors becoming out of sync and parsing different versions of a bundle at the same time, we are constantly querying the db for the currently known bundle version. We, however, need a way to turn that down a bit, both for single DAG processor and multiple DAG processors.

### Committer

- [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.