apache / apache/beam

Using ValueProvider<Long> with FixedWindows and Duration

Open
#18,704 0 comments 0 reactions 0 assignees View on GitHub
core improvement java P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

Moving toward Apache Beam 2.x, I want to use templates as much as possible, and ValueProvider accordingly.

In my logic, I am using a FixedWindow, but the duration is flexible, so I rather get it from a ValueProvider.

The problem is that FixedWindows.of() only get Duration, and I failed to find a simple way to grab a ValueProvider and make a duration out of it.

According to Eugene Kirpichov "Unfortunately this question has a simple answer: this is currently not supported"

Imported from Jira [BEAM-3378](https://issues.apache.org/jira/browse/BEAM-3378). Original Jira may contain additional context.
Reported by: shushu.

Contributor guide

Open the contributing guide

Research direction

Start with the Java SDK's FixedWindows.of() and ValueProvider APIs to understand where the duration is resolved. Define and test a supported path for template-provided durations, with completion shown by a FixedWindows use case that accepts ValueProvider.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.