apache / apache/beam

Improve log configuration when using multiple logging frameworks in Pipeline

Open
#18,244 1 comment 0 reactions 0 assignees View on GitHub
beam-model improvement P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

We need to improve / document how to configure the different logging frameworks to support the different Beam modules (SDK/Runners/IOs).

I have seen this reported already in slack, but it also bit me recently when trying to log things with a module whose dependencies only supported java based logging over slf4j (no log4j). I tried to provide the classical log4j.properties but I could not get it to log anything, nothing from the sdk, and logically nothing from the java logging framework.

[Discussion on dev list](https://lists.apache.org/thread.html/502fc4a0575534ddd5f6abffd0743de8d2ccc7fee078b5922c2e1300@%3Cdev.beam.apache.org%3E)

Imported from Jira [BEAM-1757](https://issues.apache.org/jira/browse/BEAM-1757). Original Jira may contain additional context.
Reported by: iemejia.

Contributor guide

Open the contributing guide

Research direction

Start with the linked dev-list discussion and review how logging is configured across the Beam SDK, runners, and IO modules. Document the supported configurations for the different logging frameworks, including the Java logging case described in the issue; done means users can determine how to obtain logs from the relevant modules.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
documentation
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.