Support portable combiner lifting in Java Spark Runner
Open
P3
portability
runners
spark
sub-task
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 205
Description
Adjust Spark Runner to support portable combiner lifting as described in the following doc:
https://s.apache.org/beam-runner-api-combine-model
Imported from Jira [BEAM-11478](https://issues.apache.org/jira/browse/BEAM-11478). Original Jira may contain additional context.
Reported by: ibzib.
Subtask of issue #18583
Contributor guide
Research direction
Start with the Java Spark Runner entry point and read the linked portable combiner lifting model. Check the imported BEAM-11478 Jira context and parent issue #18583 for requirements and scope. Done means the Spark Runner supports portable combiner lifting as described by that model.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- data-engineering, distributed-systems
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100