Hook In Batching DoFn Apis to RunInference
Open
core
ml
P2
python
run-inference
sub-task
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Hook into the batching DoFn APIs to the base RunInference interface.
We should also investigate what defaults we should set for batching, and perhaps make that part of the API.
See [s.apache.org/batched-dofns](https://www.google.com/url?q=http://s.apache.org/batched-dofns&sa=D&source=docs&ust=1646063987404027&usg=AOvVaw1VO9QgWlbAhx0Rh2Bzl1nw) for more details.
Imported from Jira [BEAM-14044](https://issues.apache.org/jira/browse/BEAM-14044). Original Jira may contain additional context.
Reported by: Ryan.Thompson.
Subtask of issue #21435
Contributor guide
Assessment
This issue has not been assessed yet.