ReadFromBigQuery fails with ValueProvider for table
Open
bigquery
bug
core
gcp
io
P3
python
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
2 errors are present:
1. ReadFromBigQuery passing a ValueProvider for the table param gets this error:
'_CustomBigQuerySource' object has no attribute 'dataset'
File "./lib/python3.7/site-packages/apache_beam/io/gcp/bigquery.py", line 656, in estimate_size self.table_reference.get(), self.dataset, self.project)
There are a 2 places where self.dataset are referenced, but it is never set to any value in the CustomBigQuerySource class. This should be set __init__() method.
2. _export_files references table_ref as a str before checking if its a ValueProvider.
Imported from Jira [BEAM-10792](https://issues.apache.org/jira/browse/BEAM-10792). Original Jira may contain additional context.
Reported by: mballou.
Contributor guide
Assessment
This issue has not been assessed yet.