Construction time schema Validation for writing to BQ
Open
core
improvement
java
P3
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
`BigQueryIO.write` should be able to validate the schema of the input PCollection against the schema for this table (either retrieved from DataCatalog, or from BQ metadata). Then we can fail at pipeline construction time rather than waiting until execution.
At the very least this should work when writing Beam Rows.
Imported from Jira [BEAM-8560](https://issues.apache.org/jira/browse/BEAM-8560). Original Jira may contain additional context.
Reported by: bhulette.
Contributor guide
Assessment
This issue has not been assessed yet.