Airflow Scheduler All Tasks stuck in queued
- Dominant language
- Python
- Stars
- 46.9k
- Forks
- 17.8k
- Avg merge
- 2d 10h
- Merged PRs (30d)
- 483
Description
### Apache Airflow version
Other Airflow 2 version (please specify below)
### If "Other Airflow 2 version" selected, which one?
2.10.4
### What happened?
Hey,
I tried increasing the default pool slot and to schedule more tasks and started to get this error:
unknown error while flushing task queue and result queue
Which comes from [this](https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes/stable/_modules/airflow/providers/cncf/kubernetes/executors/kubernetes_executor.html) code section. Any idea how to debug it?
Airflow wasn't able to schedule almost any task until I reseted to default pool size back to 128.
Any help would be appreciated!
### What you think should happen instead?
_No response_
### How to reproduce
none
### Operating System
apache/airflow:2.10.4-python3.12
### Versions of Apache Airflow Providers
_No response_
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
Using official helm chart and deploying on amazon eks
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
Contributor guide
Research direction
Start with the KubernetesExecutor code section linked in the report and investigate the queue-flushing error when the default pool is increased beyond 128. Reproduce the behavior in the apache/airflow:2.10.4-python3.12 image using the official Helm chart on Amazon EKS; done means identifying the cause and documenting a verified fix or configuration change.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, helm, kubernetes, python
- Domain
- data-engineering, distributed-systems
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100