apache / apache/beam

Add Utility BiTemporalStreamJoin

Open
#19,553 1 comment 1 reaction 0 assignees View on GitHub
improvement P3 sdk-ideas
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Add utility class that enables a temporal join between two streams where Stream A is matched to Stream B where

A.timestamp = (max(b.timestamp) where b.timestamp <= a.timestamp) 

This will use the following overall flow:

KV(key, Timestamped) 

| Window

| GBK

| Statefull DoFn

 

 

Imported from Jira [BEAM-7386](https://issues.apache.org/jira/browse/BEAM-7386). Original Jira may contain additional context.
Reported by: rarokni@gmail.com.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.