Support OrderedListState in Google Cloud Dataflow Runner V2
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
OrderedListState tests (below) fail on Dataflow Runner V2 and are currently excluded from postcommits.
org.apache.beam.sdk.transforms.ParDoTest$StateTests.testOrderedListStateRangeDeleteBounded
org.apache.beam.sdk.transforms.ParDoTest$StateTests.testOrderedListStateRangeDeleteBounded36 org.apache.beam.sdk.transforms.ParDoTest$StateTests.testOrderedListStateRangeDeleteUnbounded
org.apache.beam.sdk.transforms.ParDoTest$StateTests.testOrderedListStateRangeFetchUnbounded
org.apache.beam.sdk.transforms.ParDoTest$StateTests.testOrderedListStateUnbounded 3 min
org.apache.beam.sdk.transforms.ParDoTest$StateTests.testOrderedListStateRangeFetchBounded
org.apache.beam.sdk.transforms.ParDoTest$StateTests.testOrderedListStateBounded
Imported from Jira [BEAM-11130](https://issues.apache.org/jira/browse/BEAM-11130). Original Jira may contain additional context.
Reported by: tysonjh.
Contributor guide
Research direction
Start with the listed org.apache.beam.sdk.transforms.ParDoTest$StateTests OrderedListState tests and reproduce their failures on Dataflow Runner V2. Trace the Runner V2 behavior responsible for the bounded and unbounded range operations; done means these tests pass and are no longer excluded from postcommits.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- google-cloud, java
- Domain
- data-engineering, distributed-systems
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100