Point users to a TaskInstance's Event Log if tasks are missing
- Dominant language
- Python
- Stars
- 46.9k
- Forks
- 17.8k
- Avg merge
- 2d 10h
- Merged PRs (30d)
- 483
Description
### Description
Task logs can be missing for a wide variety of reasons. Two of the most common ones are:
* The task was stuck in queued and failed by `task_queued_timeout`
* The task became a zombie
In these scenarios, it'd be helpful to populate the TaskInstance's logs with a message pointing users to the TaskInstance's Event Log.
### Related issues
* #40975
* #42136
### Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
Contributor guide
Research direction
Start by tracing how TaskInstance logs are populated for queued-task timeouts and zombie tasks, then read related issues #40975 and #42136 for context. Done means the TaskInstance log contains a message directing users to its Event Log when task logs are missing in these scenarios.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering, observability
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 66/100