apache / apache/airflow

Remove postgres subcharts from Airflow Helm Charts

Open
#55,823 7 comments 5 reactions 0 assignees View on GitHub
area:helm-chart kind:meta
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 10h
Merged PRs (30d)
483

Description

### Body

Bitnami (now VMware) has restricted access to newer postgres images in their main repository. This affects all KinD-based testing and development workflows, as temporary workaround we have used `docker.io/postgres` images: https://github.com/apache/airflow/pull/55820 but over a long term, we should remove that subchart as discussed in lazy consensus too: https://lists.apache.org/thread/3o4wj76pmd2m13jho7sxcbfkbgpv88h9

The plan of action could be:

* Remove postgres dependency entirely from the helm chart (lazy consensus has been achieved: https://lists.apache.org/thread/3o4wj76pmd2m13jho7sxcbfkbgpv88h9)
* Make sqlite the default database in values.yaml for development/testing
* Update CI/CD pipelines to use sqlite
* Eliminate bitnami dependency
* Users can extend our helm charts and provide their own DBs on top of it.

### Committer

- [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Contributor guide

Open the contributing guide

Research direction

Start with the Helm chart and values.yaml, then trace the CI/CD pipelines and KinD-based development and testing workflows that consume the PostgreSQL dependency. Confirm all Bitnami references before making changes, and consider the work done when the chart uses SQLite by default, pipelines use SQLite, the Bitnami dependency is gone, and users can provide external databases.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, helm, kubernetes, postgresql, sqlite
Domain
ci-cd, databases, devops, infrastructure
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.