Add benchmarks for machine learning application
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1k
- Forks
- 203
- Avg merge
- 1h 20m
- Merged PRs (30d)
- 2
Description
Today, Machine learning applications are important use-cases of Python.
I haven't prepared concrete benchmark implementations yet, but I would like to suggest guidelines for machine learning benchmarks.
A. Each benchmark should provide all of the following implementations and shows the same result.
Pure Python-based implementation (might be not easy).Sympy based implementation- Numpy-based implementation.
- (optional) Famous frameworks like scikit-learn, TensorFlow, or PyTorch-based implementation.
B. Following algorithm-based benchmark should provide training and inference benchmark.
- Regression algorithm
- Decision tree algorithm
- Clustering algorithm
- Nearest neighborhood algorithm
- Matrix factorization
- ... (Please suggest!)
C. Deep learning-based or neural network-based benchmarks only provide inference benchmark with fixed weights since training benchmark needs GPU resources but using GPU resource is out of the topic.
- Simple neural network
- ... (Please suggest!)
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points and does not provide concrete benchmark implementations. Start by reviewing the repository's existing benchmark conventions, then clarify the algorithms and implementations in scope; done would require an agreed set of matching training and inference benchmarks.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- numpy, python, pytorch, scikit-learn, tensorflow
- Domain
- machine-learning, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100