Bigquery Warning messages cause Dataflow job to fail
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
I have a job fails when BigQuery throws any warning messages, even if the query is successful.
org.apache.beam.sdk.io.gcp.bigquery.BigQueryHelpers.parseStatus Checks for "getErrors" and sets status to failure if there are any. However, this can include warning messages.
[Google's Bigquery Client Code]([https://github.com/googleapis/google-api-java-client-services/blob/master/clients/google-api-services-bigquery/v2/1.30.1/com/google/api/services/bigquery/model/JobStatus.java)] states that
"Errors here do not necessarily mean that the job has completed or was unsuccessful."
Imported from Jira [BEAM-10999](https://issues.apache.org/jira/browse/BEAM-10999). Original Jira may contain additional context.
Reported by: acuitymd.
Contributor guide
Assessment
This issue has not been assessed yet.