apache / apache/beam

Re. BEAM-974 - PubSub.read/write() .withCoder requirement should raise a more informative error in Dataflow

Open
#18,180 0 comments 0 reactions 0 assignees View on GitHub
core java P3 wish
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Hello,
I'm a Google Cloud Support Specialist who recently owned a case from a platinum customer who was reporting "validation of workflow failed" internal error when attempting to use new beta SDK. Eventually, it was determined that the problem was that they weren't using .withCoder, which became required after BEAM-974[1]. They would like to request that a more informative error be thrown, as the current one is far too vague to be able to derive any useful information from. Thank you.

Regards,

Garrett Anderson
Cloud Support Specialist
Google Cloud Platform Support

[1] https://issues.apache.org/jira/browse/BEAM-974

Imported from Jira [BEAM-1662](https://issues.apache.org/jira/browse/BEAM-1662). Original Jira may contain additional context.
Reported by: gfunk.

Contributor guide

Open the contributing guide

Research direction

Start by locating the PubSub.read/write() validation used by Dataflow and reproduce the workflow validation failure described in the issue. Trace the missing .withCoder case and confirm that the resulting error identifies the requirement clearly.

Written by the indexing model from the issue text.

Assessment

Tech stack
gcp, java
Domain
cloud, data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.