apache / apache/beam

Support portable combiner lifting in Java Flink Runner

Open
#18,584 0 comments 0 reactions 0 assignees View on GitHub
flink P3 runners sub-task
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

Adjust Flink Runner to support portable combiner lifting as described in the following doc:

https://s.apache.org/beam-runner-api-combine-model

Imported from Jira [BEAM-4678](https://issues.apache.org/jira/browse/BEAM-4678). Original Jira may contain additional context.
Reported by: danoliveira.
This issue has child subcomponents which were not migrated over. See the original Jira for more information.
Subtask of issue #18583

Contributor guide

Open the contributing guide

Research direction

Start by reading the portable combiner lifting model at the linked design document, then review parent issue #18583 and the original BEAM-4678 Jira issue for the missing subcomponents and context. Done means the Flink Runner supports the portable combiner lifting behavior described there, but the issue does not identify specific files or tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.