apache / apache/beam

Use portable WindowIntoPayload in DataflowRunner

Open
#18,618 0 comments 0 reactions 0 assignees View on GitHub
dataflow P3 portability runners task
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

The Java-specific blobs transmitted to Dataflow need more context, in the form of portability framework protos.

Imported from Jira [BEAM-3514](https://issues.apache.org/jira/browse/BEAM-3514). Original Jira may contain additional context.
Reported by: kenn.
This issue has child subcomponents which were not migrated over. See the original Jira for more information.

Contributor guide

Open the contributing guide

Research direction

Start by locating DataflowRunner and the WindowIntoPayload handling in the Apache Beam codebase, then consult the linked BEAM-3514 Jira issue for the missing child-component context. The work is done when the Java-specific blobs sent to Dataflow use the portability framework protos described by the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, distributed-systems
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.