Optimize git bundle for ephemeral workers
Open
area:dag-bundles
kind:meta
provider:cncf-kubernetes
- Dominant language
- Python
- Stars
- 46.9k
- Forks
- 17.8k
- Avg merge
- 2d 10h
- Merged PRs (30d)
- 483
Description
### Body
When running in KE, we could likely do a single shallow clone, instead of our "clone to bare repo, then clone the right version" approach we take now. This would make the worker startup process a bit cheaper.
### Committer
- [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Contributor guide
Research direction
No files, tests, or entry points are named. Start by locating the KE worker startup path and compare its current bare-repository clone followed by version clone with the proposed single shallow clone; done means the startup flow uses the cheaper approach and its behavior is validated.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- git, python
- Domain
- infrastructure, performance
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100