apache / apache/beam

ReadFromPubSub fails on Flink Runner

Open
#21,325 0 comments 0 reactions 0 assignees View on GitHub
bug flink P3 portability runners
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

This was reported by a user on Slack. They are using Beam Python on Flink on kubernetes.

Caused by: java.lang.IllegalArgumentException: PCollectionNodes [PCollectionNode{id=ref_PCollection_PCollection_1, PCollection=unique_name: "22Read from Pub/Sub/Read.None"
coder_id: "ref_Coder_BytesCoder_1"
is_bounded: UNBOUNDED
windowing_strategy_id: "ref_Windowing_Windowing_1"
}] were consumed but never produced

It looks like a bug in the java fuser, similar to BEAM-6473.

https://the-asf.slack.com/archives/C9H0YNP3P/p1642787607002700

Imported from Jira [BEAM-13750](https://issues.apache.org/jira/browse/BEAM-13750). Original Jira may contain additional context.
Reported by: ibzib.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.