apache / apache/airflow

Occasionally, the scheduler, will stop returning logs. I think this code is part of the issue

Open
#57,158 2 comments 0 reactions 0 assignees View on GitHub
area:logging area:scheduler kind:bug
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 10h
Merged PRs (30d)
483

Description

https://github.com/apache/airflow/blob/f9b38d288621cb76f9ed43b16dad00d19654fdef/airflow-core/src/airflow/utils/log/file_task_handler.py#L167-L192

By default the time out is never.

Contributor guide

Open the contributing guide

Research direction

Start with airflow-core/src/airflow/utils/log/file_task_handler.py lines 167-192, then trace how the default timeout is used when scheduler logs are fetched. Reproduce the case where log delivery stops and establish the expected behavior for an unset timeout; done means the failure is explained and covered by an appropriate regression test.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
observability
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.