Execute ReduceFnRunner Directly in Flink Runner
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 205
Description
Right now, a `ReduceFnRunner` is executed via `GroupAlsoByWindowViaWindowSetDoFn` which in turn is executed via a `DoFnRunner`. We should change that to get rid of the dependence on `GroupAlsoByWindowViaWindowSetDoFn` which is an `OldDoFn` and also to get rid of some unneeded layering.
Imported from Jira [BEAM-956](https://issues.apache.org/jira/browse/BEAM-956). Original Jira may contain additional context.
Reported by: aljoscha.
Contributor guide
Research direction
Start by tracing how ReduceFnRunner is invoked through GroupAlsoByWindowViaWindowSetDoFn and DoFnRunner in the Flink Runner. Determine the changes needed to execute ReduceFnRunner directly while removing the OldDoFn dependency and unnecessary layering. Done means the intermediate dependency and layer are gone without changing the runner's behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- stream-processing
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100