BigQueryIO ValueProvider support for NumFileShards and Triggering Frequency
Open
gcp
improvement
io
java
P3
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Enhance BigQueryIO to accept ValueProviders for:
* withTriggeringFrequency(..)
* withNumFileShards(..)
It would allow Dataflow templates to accept these parameters at runtime instead of being hardcoded. This opens up the ability to create Dataflow templates which allow users to flip back-and-forth between batch and streaming inserts.
withMethod(..) cannot be changed at runtime currently.
Imported from Jira [BEAM-4096](https://issues.apache.org/jira/browse/BEAM-4096). Original Jira may contain additional context.
Reported by: ryanmcdowell.
Contributor guide
Assessment
This issue has not been assessed yet.