apache / apache/airflow

Add an ability for breeze to utilize local Kubernetes cluster

Open
#56,172 2 comments 2 reactions 1 assignee Claimed by @rawwar View on GitHub
area:dev-env area:dev-tools kind:feature
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 10h
Merged PRs (30d)
483

Description

### Description

I came up with this idea while working on #39791.
Currently there is no comfortable way to integrate a local k8s cluster (e.g., `kind`) with Breeze, which makes KPO and KubernetesExecutor hard to emulate locally with a regular `breeze start-airflow`. As `kind` cluster can be deployed as a Docker container, it's just a matter of few configurations to make it accessible by the Airflow instance delpoyed with Breeze.

### Use case/motivation

Using `KubernetesPodOperator` and `KubernetesExecutor` within breeze deployment while working with a local ks8 cluster

### Related issues

_No response_

### Are you willing to submit a PR?

- [x] Yes I am willing to submit a PR!

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.