apache / apache/beam

SDK harnesses should be able to indicate panic in FnAPI

Open
#18,515 0 comments 0 reactions 0 assignees View on GitHub
beam-model improvement P3 portability
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 5h
Merged PRs (30d)
204

Description

If the SDK harness encounters a permanent problem (local file corruption or bad staged files, say) it should be able to rely that information to the runner as a "panic" message, say. Such conditions may also happen during the boot stage.

Using process/container exit codes would likely not work well, because that information may not flow easily to the runner logic depending on how containers are managed.

Imported from Jira [BEAM-2947](https://issues.apache.org/jira/browse/BEAM-2947). Original Jira may contain additional context.
Reported by: herohde.

Contributor guide

Open the contributing guide

Research direction

Start with the FnAPI SDK harness and runner handling described in the issue, including boot-stage behavior, and review the imported Jira BEAM-2947 for the missing context. Define how a permanent harness failure is represented as a panic message and how the runner receives and handles it.

Written by the indexing model from the issue text.

Assessment

Domain
api, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.