GoogleCloudPlatform / GoogleCloudPlatform/spring-cloud-gcp

Expand BigQueryJsonDataWriter to include option to use default-stream mode

Open
#1,504 3 comments 1 reaction 0 assignees View on GitHub
priority: p3 type: enhancement
Dominant language
Java
Stars
551
Forks
349
Avg merge
1d 13h
Merged PRs (30d)
14

Description

**Is your feature request related to a problem? Please describe.**
With the latest version of spring-cloud-gcp-bigquery available as of writing, I'd like to be able to use the BigQuery [write-api](https://cloud.google.com/bigquery/docs/write-api) in [default-stream](https://cloud.google.com/bigquery/docs/write-api-streaming#at-least-once) mode in addition to the current [committed-type](https://cloud.google.com/bigquery/docs/write-api-streaming#exactly-once) mode which has already been implemented.

**Describe the solution you'd like**
I'd like the ability to configure the already existing BigQueryJsonDataWriter as requested [here](https://github.com/GoogleCloudPlatform/spring-cloud-gcp/issues/1015) and merged [here](https://github.com/GoogleCloudPlatform/spring-cloud-gcp/pull/1219) in default-stream mode. This will enable the developer to use the retry functionality which can automatically retry appends that resulted in retriable error codes and retry appends after filtering out faulty rows.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.