apache / apache/beam

Make InteractiveRunner work without runner api roundtrip

Open
#21,622 0 comments 0 reactions 0 assignees View on GitHub
improvement interactive P2 python runners
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

InteractiveRunner still uses a runner api roundtrip to make "deep copies" of pipelines.

Such a roundtrip is not guaranteed to work especially when a transform is not serializable. Example issues is BEAM-14112.

 

Though a temporary fix could be made, a better approach is to refactor the implementation of InteractiveRunner to always work on runner api protos without relying on roundtrip or "deep copies".

Imported from Jira [BEAM-14331](https://issues.apache.org/jira/browse/BEAM-14331). Original Jira may contain additional context.
Reported by: ningk.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.