apache / apache/beam

Dataflow specific pipeline updates are not reflected in the pipeline proto

Open
#20,656 0 comments 0 reactions 0 assignees View on GitHub
bug dataflow P3 runners
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

More specifically the to visits here.

[https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py#L566](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py#L566)

 

These have to be done before creating the pipeline proto for Dataflow to be able to correctly generate job requests from portable protos.

 

Imported from Jira [BEAM-10933](https://issues.apache.org/jira/browse/BEAM-10933). Original Jira may contain additional context.
Reported by: chamikara.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.