apache / apache/beam

RunInference V1

Open
#21,435 1 comment 1 reaction 0 assignees View on GitHub
core ml new feature P2 python run-inference
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

Users of machine learning frameworks must currently implement their own transforms for running ML inferences. The exception is the TensorFlow [RunInference transform](https://github.com/tensorflow/tfx-bsl/blob/master/tfx_bsl/beam/run_inference.py). However, this is hosted in its own [repo](https://github.com/tensorflow/tfx-bsl), and has an [API](https://www.tensorflow.org/tfx/tfx_bsl/api_docs/python/tfx_bsl/public/beam/RunInference) that is exclusively geared towards the TensorFlow TFX library. Our goal is to add new implementations of RunInference for the two other popular machine learning frameworks: scikit-learn and Pytorch.

Please see main design document [here](https://s.apache.org/inference-sklearn-pytorch).

Imported from Jira [BEAM-13970](https://issues.apache.org/jira/browse/BEAM-13970). Original Jira may contain additional context.
Reported by: yeandy.

Contributor guide

Open the contributing guide

Research direction

Start with the linked design document and compare its requirements with TensorFlow's existing RunInference implementation. Identify the appropriate Apache Beam entry points for adding scikit-learn and PyTorch support. Done means both frameworks have RunInference implementations matching the agreed design, with validation provided by the project's relevant tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
pytorch, scikit-learn
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.