Configurable combiner packing limit
Open
core
improvement
P3
python
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Currently translations.pack_combiners has no upper limit, which means it can potentially pack thousands of combiners together, which may cause OOM issues if the accumulators are large. We should set a default upper limit, and also make the upper limit configurable per-combiner.
Imported from Jira [BEAM-12798](https://issues.apache.org/jira/browse/BEAM-12798). Original Jira may contain additional context.
Reported by: myffical@gmail.com.
Contributor guide
Assessment
This issue has not been assessed yet.