Add ability to detect table schema changes to BigQueryIO's STORAGE_WRITE_API methods
Open
gcp
io
java
new feature
P2
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 205
Description
If the table schema changed the BigQueryIO should be able to recognize it and fetch the updated schema.
Imported from Jira [BEAM-14015](https://issues.apache.org/jira/browse/BEAM-14015). Original Jira may contain additional context.
Reported by: slilichenko.
Contributor guide
Research direction
Start by locating BigQueryIO's STORAGE_WRITE_API methods and reading how they currently obtain and use table schemas. The work is complete when schema changes are detected and the updated schema is fetched for those methods, with corresponding tests covering the behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100