apache / apache/beam

The DirectRunner should garbage collect PCollectionView contents

Open
#18,243 0 comments 0 reactions 0 assignees View on GitHub
direct improvement P3 runners
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

It should use the Maximum Lookback of the associated `WindowMappingFn`

Imported from Jira [BEAM-1931](https://issues.apache.org/jira/browse/BEAM-1931). Original Jira may contain additional context.
Reported by: tgroh.

Contributor guide

Open the contributing guide

Research direction

Start by locating the DirectRunner code handling PCollectionView contents and the associated WindowMappingFn. Read the original BEAM-1931 Jira issue for any missing context, then verify that cleanup follows the WindowMappingFn's Maximum Lookback and add or update the relevant tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.