[Feature Request]: Support default log level and log level overrides for runners based on translators
Open
new feature
P2
runners
universal
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
### What would you like to happen?
Currently log level and log level overrides are handled by fn harness: https://github.com/apache/beam/blob/9f40bbf9c3ba4227e696554426c66abee0f37e6f/sdks/java/harness/src/main/java/org/apache/beam/fn/harness/logging/BeamFnLoggingClient.java#L118
For PipelineRunners that run pipeline using translator, e.g., FlinkRunner, SparkRunner, but not involve fn harness (non-portable), these options does not take effect. (Flink support is in #23635). We need support default log level and log level overrides on these runners.
### Issue Priority
Priority: 2
### Issue Component
Component: runner-universal
Contributor guide
Assessment
This issue has not been assessed yet.