apache / apache/beam

Erroneous Beam Deprecation warnings are confusing Bigquery IO users.

Open
#19,688 0 comments 1 reaction 0 assignees View on GitHub
gcp improvement io P3 python
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Bigquery sink is marked deprecated: https://github.com/apache/beam/blob/32e2e3e910619d400568073dde0d7b36698a416a/sdks/python/apache_beam/io/gcp/bigquery.py#L499, however it is used by Dataflow runner in codepath that processes WriteToBigQuery https://github.com/apache/beam/blob/32e2e3e910619d400568073dde0d7b36698a416a/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py#L680.

This generates a warning message for all BQ users, including those who use WriteToBigQuery: "Warning: BigQuerySink is deprecated since 2.11.0. Use WriteToBigQuery instead".

This message is a red herring and confuses BQ users.

One possibility to address this is to make BigQuerySink an alias for _BigQuerySink, and use _BigQuerySink internally.

Imported from Jira [BEAM-7686](https://issues.apache.org/jira/browse/BEAM-7686). Original Jira may contain additional context.
Reported by: tvalentyn.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.