apache / apache/beam

RunInference Benchmarking tests

Open
#21,454 1 comment 0 reactions 0 assignees View on GitHub
core ml P2 python run-inference sub-task
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

RunInference benchmarks will evaluate performance of Pipelines, which represent common use cases of Beam **** Dataflow in Pytorch, sklearn and possibly TFX. These benchmarks would be the integration tests that exercise several software components using Beam, PyTorch, Scikit learn and TensorFlow extended.

we would use the datasets that's available publicly (Eg; Kaggle). 

Size: small / 10 GB / 1 TB etc

The default execution runner would be Dataflow unless specified otherwise.

These tests would be run very less frequently(every release cycle).  

Imported from Jira [BEAM-14068](https://issues.apache.org/jira/browse/BEAM-14068). Original Jira may contain additional context.
Reported by: Anand Inguva.
Subtask of issue #21435

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.