apache / apache/airflow

Airflow Scheduler All Tasks stuck in queued

Open
#51,589 0 comments 1 reaction 0 assignees View on GitHub
_eol_affected_version:2.10 area:core area:scheduler kind:bug needs-triage priority:medium
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 10h
Merged PRs (30d)
483

Description

### Apache Airflow version

Other Airflow 2 version (please specify below)

### If "Other Airflow 2 version" selected, which one?

2.10.4

### What happened?

Hey,
I tried increasing the default pool slot and to schedule more tasks and started to get this error:
unknown error while flushing task queue and result queue
Which comes from [this](https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes/stable/_modules/airflow/providers/cncf/kubernetes/executors/kubernetes_executor.html) code section. Any idea how to debug it?
Airflow wasn't able to schedule almost any task until I reseted to default pool size back to 128.
Any help would be appreciated!

### What you think should happen instead?

_No response_

### How to reproduce

none

### Operating System

apache/airflow:2.10.4-python3.12

### Versions of Apache Airflow Providers

_No response_

### Deployment

Official Apache Airflow Helm Chart

### Deployment details

Using official helm chart and deploying on amazon eks

### Anything else?

_No response_

### Are you willing to submit PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)

Contributor guide

Open the contributing guide

Research direction

Start with the KubernetesExecutor code section linked in the report and investigate the queue-flushing error when the default pool is increased beyond 128. Reproduce the behavior in the apache/airflow:2.10.4-python3.12 image using the official Helm chart on Amazon EKS; done means identifying the cause and documenting a verified fix or configuration change.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, helm, kubernetes, python
Domain
data-engineering, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.