Flink python test logs are too noisy
Open
flink
improvement
P3
portability
runners
tests
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
When running Python tests on the Flink runner, all the info logs from the Flink local cluster are printed to the test log, which creates a lot of noise. Especially severe for Flink Python PVR tests, which have 30****MB log files.
Imported from Jira [BEAM-9356](https://issues.apache.org/jira/browse/BEAM-9356). Original Jira may contain additional context.
Reported by: ibzib.
Contributor guide
Research direction
Start by locating the Flink runner's Python test setup, especially the Python PVR tests, and trace how the local Flink cluster's info logs are captured. Done means the tests retain useful diagnostics without producing the reported multi-megabyte log noise.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100