Create BigtableIO setting to report external system throttle time to Dataflow
Open
gcp
io
java
new feature
P2
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Create a setting inside of BigtableConfig to report external system throttle time to Dataflow. This setting will inform Dataflow that the client is throttling and Dataflow will either maintain or decrease workers.
This should help with overloading issues on the Bigtable side.
Imported from Jira [BEAM-14554](https://issues.apache.org/jira/browse/BEAM-14554). Original Jira may contain additional context.
Reported by: diegomez17.
Contributor guide
Assessment
This issue has not been assessed yet.