Message limit for grpc message is set to default 4 MB
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
The default limit of a grpc message is set low to 4 MB, and is not overridden in the sdk_worker.py for the _control_channel. This was first discovered when submitting a beam job via a flink operator orchestrated by kubernetes ([https://github.com/GoogleCloudPlatform/flink-on-k8s-operator)](https://github.com/GoogleCloudPlatform/flink-on-k8s-operator). This issue was resolved for apache-beam\==2.18 in BEAM-10334, but exists in apache-beam\==2.22 (and presumably all versions 2.17 onwards).
This can be fixed by modifying the options parameter to allow any size grpc message to be sent or received.
Imported from Jira [BEAM-10458](https://issues.apache.org/jira/browse/BEAM-10458). Original Jira may contain additional context.
Reported by: kshivvy.
Contributor guide
Assessment
This issue has not been assessed yet.