apache / apache/beam

Add support for PaneInfo descriptor in Python SDK

Open
#18,721 0 comments 0 reactions 0 assignees View on GitHub
core improvement P3 python
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

The PaneInfo descriptor allows a user to determine which particular triggering emitted a value.  This allows the user to differentiate between speculative (early), on-time (at end of window) and late value emissions coming out of a GroupByKey.  We should add support for this feature in the Python SDK.

Imported from Jira [BEAM-3759](https://issues.apache.org/jira/browse/BEAM-3759). Original Jira may contain additional context.
Reported by: ccy.

Contributor guide

Open the contributing guide

Research direction

Begin with the Python SDK's GroupByKey and triggering behavior, then consult the linked BEAM-3759 Jira issue for the missing context. Identify the appropriate SDK entry point and tests for exposing PaneInfo, and cover speculative, on-time, and late emissions so completion is demonstrated for each case.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.