apache / apache/airflow

Launch Pod/job in separate namespace and support in helm chart

Open
#25,222 6 comments 1 reaction 0 assignees View on GitHub
area:helm-chart good first issue kind:feature
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 10h
Merged PRs (30d)
483

Description

### Description

Our engineers want to run jobs in a separate namespace from the installed release via helm chart.

It looks to me like right now the rbac configuration has two choices
* multicluster - generates ClusterRole
* !multicluster - generales rolebinding in RELEASE namespace.

Why these don't work for us
* multicluster is too wide, we want to restrict the namespace
* !multicluster - I think only lets stuff be generated in the same namespace? Or will airflow be able to generate pods in another namespace

Sorry for the ignorant questions - don't really know airflow, just trying to help out the engineers.

### Use case/motivation

Our engineers want to run jobs in a separate namespace from the installed release via helm chart.

### Related issues

There are some about pod override of namespace, I'm not sure due to inexperience with Airflow

### Are you willing to submit a PR?

- [X] Yes I am willing to submit a PR!

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)

Contributor guide

Open the contributing guide

Research direction

Start with the Helm chart's RBAC configuration, comparing the multicluster ClusterRole path with the non-multicluster RoleBinding in the release namespace. Trace how Airflow launches jobs and pods and confirm the intended namespace permissions. Done means a separately configured target namespace is supported without granting cluster-wide access, with chart coverage for both RBAC modes.

Written by the indexing model from the issue text.

Assessment

Tech stack
helm, kubernetes, python
Domain
devops, infrastructure
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.