apache / apache/beam

feat: add schema update support for bigquerystorage Write API

Open
#21,331 0 comments 0 reactions 0 assignees View on GitHub
gcp io java new feature P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Please add schema update support similar to what we have in the BigQueryStorage Java client: [https://github.com/googleapis/java-bigquerystorage/pull/1447](https://github.com/googleapis/java-bigquerystorage/pull/1447)

 

When schema is updated, we should:

1) close the existing StreamWriter

2) update TableSchema and Descriptor

3) create a new StreamWriter with the updated TableSchema and Descriptor

 

Related customer impact: Case #29451211 (salesforce)

Imported from Jira [BEAM-13944](https://issues.apache.org/jira/browse/BEAM-13944). Original Jira may contain additional context.
Reported by: stephaniewang526.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.