Remove the need for --test-pipeline-options in flink/spark Python tests.
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Flink and Spark Python tests are skipped if \--test-pipeline-options is unset, but that's just an unfortunate implementation detail of the test framework - we want to skip Flink and Spark tests in the general pytest suite. We should find a better way to know to skip these tests, so that there's less cognitive load in trying to figure out what \--test-pipeline-options should be set to.
https://github.com/apache/beam/blob/51541a595b09751dd3dde2c50caf2a968ac01b68/sdks/python/apache_beam/runners/portability/flink_runner_test.py#L81
Imported from Jira [BEAM-12300](https://issues.apache.org/jira/browse/BEAM-12300). Original Jira may contain additional context.
Reported by: ibzib.
Contributor guide
Assessment
This issue has not been assessed yet.