RunInference: investigate adding optional batching flag
Open
core
ml
new feature
P3
python
run-inference
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
### What would you like to happen?
Look into adding a flag that users can specify to turn off `BatchElements`.
### Issue Priority
Priority: 2
### Issue Component
Component: sdk-py-core
Subtask of: https://github.com/apache/beam/issues/22117
Contributor guide
Assessment
This issue has not been assessed yet.