apache / apache/beam

Provide a runner-internal ExecutorService for maintenance tasks

Open
#18,079 0 comments 0 reactions 0 assignees View on GitHub
direct improvement P3 runners
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

There are multiple locations throughout the DirectRunner that require some work to be done at some later point (e.g. DirectMetrics.COUNTER_COMMITTER, EvaluationContext.watermarkCallbackExecutor). These should use a common ExecutorService to ensure that if necessary we can manage the shared JVM resources properly.

Imported from Jira [BEAM-723](https://issues.apache.org/jira/browse/BEAM-723). Original Jira may contain additional context.
Reported by: tgroh.

Contributor guide

Open the contributing guide

Research direction

Start by tracing the DirectRunner locations named in the issue, especially DirectMetrics.COUNTER_COMMITTER and EvaluationContext.watermarkCallbackExecutor, and review the original Jira issue for context. Done means these maintenance tasks use a common runner-internal ExecutorService whose shared JVM resources can be managed consistently.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.