RunInference V1
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 205
Description
Users of machine learning frameworks must currently implement their own transforms for running ML inferences. The exception is the TensorFlow [RunInference transform](https://github.com/tensorflow/tfx-bsl/blob/master/tfx_bsl/beam/run_inference.py). However, this is hosted in its own [repo](https://github.com/tensorflow/tfx-bsl), and has an [API](https://www.tensorflow.org/tfx/tfx_bsl/api_docs/python/tfx_bsl/public/beam/RunInference) that is exclusively geared towards the TensorFlow TFX library. Our goal is to add new implementations of RunInference for the two other popular machine learning frameworks: scikit-learn and Pytorch.
Please see main design document [here](https://s.apache.org/inference-sklearn-pytorch).
Imported from Jira [BEAM-13970](https://issues.apache.org/jira/browse/BEAM-13970). Original Jira may contain additional context.
Reported by: yeandy.
Contributor guide
Research direction
Start with the linked design document and compare its requirements with TensorFlow's existing RunInference implementation. Identify the appropriate Apache Beam entry points for adding scikit-learn and PyTorch support. Done means both frameworks have RunInference implementations matching the agreed design, with validation provided by the project's relevant tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- pytorch, scikit-learn
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100