Add more integration tests for BigQueryIO
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Seems like we currently only have a single test that directly read using a query.
[https://github.com/apache/beam/blob/328129bf033bc6be16bc8e09af905f37b7516412/examples/java/src/test/java/org/apache/beam/examples/cookbook/BigQueryTornadoesIT.java](https://github.com/apache/beam/blob/328129bf033bc6be16bc8e09af905f37b7516412/examples/java/src/test/java/org/apache/beam/examples/cookbook/BigQueryTornadoesIT.java)
We should consider adding more integration tests. For example,
(1) Read directly from a given table and a dataset.
(2) Read from a federated table.
(3) Read using BQ legacy SQL.
(4) Read from a table with nested/repeated fields.
(5) Read from non-standard BQ regions (for example, Japan).
Also, we should consider adding tests for BQ streaming writes once we have framework support for that.
Imported from Jira [BEAM-5670](https://issues.apache.org/jira/browse/BEAM-5670). Original Jira may contain additional context.
Reported by: chamikara.
Contributor guide
Assessment
This issue has not been assessed yet.