apache / apache/beam

Direct runner could display the watermark for debugging

Open
#18,530 0 comments 0 reactions 0 assignees View on GitHub
direct improvement P3 runners
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

When using the direct runner to test and investigate streaming pipeline, it would be very convenient to display the watermark of each element to check if a window/trigger definition is correct.

Imported from Jira [BEAM-3278](https://issues.apache.org/jira/browse/BEAM-3278). Original Jira may contain additional context.
Reported by: jbonofre.

Contributor guide

Open the contributing guide

Research direction

Start with the direct runner and review the imported BEAM-3278 Jira issue for the additional context. Trace how a streaming pipeline processes watermarks, windows, and triggers; done means the direct runner displays each element's watermark so those definitions can be inspected.

Written by the indexing model from the issue text.

Assessment

Domain
stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.