Java Examples are failing for different runners
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
With the recent addition of suites to continuously test Java examples in different runners, some existing integration tests fail for different runners
* __org.apache.beam.examples.WindowedWordCountIT.testWindowedWordCountInBatchDynamicSharding__, fails in FlinkRunner with AssertionError, for DirectRunner and SparkRunner the test never finishes.
* _org.apache.beam.examples.WindowedWordCountIT.testWindowedWordCountInStreamingStaticSharding_ fails in SparkRunner with error _Failed to read from sharded output_
* _org.apache.beam.examples.cookbook.BigQueryTornadoesIT.testE2eBigQueryTornadoesWithStorageApiUsingQuery_ fails in FlinkRunner with _Error deleting table, Not found: Dataset_
Imported from Jira [BEAM-14019](https://issues.apache.org/jira/browse/BEAM-14019). Original Jira may contain additional context.
Reported by: benglez.
Contributor guide
Research direction
Start by running the three named integration tests across the runners listed in the issue and compare their failures: WindowedWordCountIT's batch dynamic-sharding and streaming static-sharding tests, plus BigQueryTornadoesIT.testE2eBigQueryTornadoesWithStorageApiUsingQuery. Done means these tests complete successfully in their affected runners without assertion, sharded-output, or dataset-deletion errors.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- distributed-systems, testing
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100