apache / apache/airflow

Decouple remote logging configuration from core airflow

Open
#65,281 6 comments 0 reactions 0 assignees View on GitHub
area:core area:logging area:providers kind:feature kind:meta
Dominant language
Python
Stars
46.9k
Forks
17.8k
Avg merge
2d 9h
Merged PRs (30d)
472

Description

### Body

`airflow_local_settings.py` hardcodes imports and configuration for each remote logging provider (S3, GCS, OpenSearch, etc). Example: https://github.com/apache/airflow/blob/main/airflow-core/src/airflow/config_templates/airflow_local_settings.py#L165-L181

Right now this means that:
- Core must know provider implementation details
- Provider changes require core updates
- New logging providers must modify core code

Find a way to have providers register their remote logging config themselves - either via provider.yml or entrypoints. More details to follow in a PR once I have completed some investigation here.

### Committer

- [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.