Owner
mlcommons
76 indexed repositories · View on GitHub
-
training
Reference implementations of MLPerf® training benchmarks
Python · 1771 stars
-
inference
Reference implementations of MLPerf® inference benchmarks
Python · 1629 stars
-
croissant
Croissant is a high-level format for machine learning datasets that brings together four rich layers.
Jupyter Notebook · 901 stars
-
ck
Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to learn how to run AI, ML, and oth...
Python · 651 stars
-
tiny
MLPerf® Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers
C · 479 stars
-
algorithmic-efficiency
MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement...
Python · 425 stars
-
storage
MLPerf® Storage Benchmark Suite
Python · 203 stars
-
chakra
Repository for MLCommons Chakra schema and tools
Python · 196 stars
-
GaNDLF
A generalizable application framework for segmentation, regression, and classification using PyTorch
Python · 191 stars
-
medperf
An open benchmarking platform for medical artificial intelligence using Federated Evaluation.
Python · 172 stars
-
mlcube
MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.
Python · 160 stars
-
modelbench
Run safety benchmarks against AI models and view detailed reports showing how well they performed.
Python · 134 stars
-
peoples-speech
The People’s Speech Dataset
Jupyter Notebook · 115 stars
-
training_policies
Issues related to MLPerf™ training policies, including rules and suggested changes
Python · 95 stars
-
mlperf_client
MLPerf Client is a benchmark for Windows, Linux and macOS, focusing on client form factors in ML inference scenarios.
C++ · 91 stars
-
ailuminate
The AILuminate v1.1 benchmark suite is an AI risk assessment benchmark developed with broad involvement from leading AI companies, academ...
83 stars
-
mobile_app_open
Mobile App Open
C++ · 71 stars
-
inference_policies
Issues related to MLPerf® Inference policies, including rules and suggested changes
63 stars
-
training_results_v0.7
This repository contains the results and code for the MLPerf™ Training v0.7 benchmark.
Python · 57 stars
-
inference_results_v0.5
This repository contains the results and code for the MLPerf™ Inference v0.5 benchmark.
C++ · 55 stars
- 56 more repositories live on View on GitHub
-
status: needs-triage type: feature
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
mlcommons/modelbench#1660 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
mlcommons/modelbench#1659 · 1 comment ·
-
Difficulty 3/5 1-2 days Newbie friendliness 45/100
mlcommons/modelbench#1658 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 65/100
mlcommons/modelbench#1657 · 2 comments ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
mlcommons/modelbench#1656 ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
mlcommons/modelbench#1655 ·
-
Fix AWS SUTs Open
Difficulty 3/5 1-2 days Newbie friendliness 48/100
mlcommons/modelbench#1654 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 64/100
mlcommons/modelbench#1653 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
mlcommons/ailuminate#38 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
mlcommons/modelbench#1648 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 58/100
mlcommons/modelbench#1646 ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
mlcommons/modelbench#1645 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 42/100
mlcommons/modelbench#1644 · 1 comment ·
-
status: needs-triage type: bug
Difficulty 3/5 1-2 days Newbie friendliness 78/100
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
mlcommons/mobile_app_open#1177 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 78/100
-
Difficulty 4/5 3-5 days Newbie friendliness 20/100
mlcommons/modelbench#1641 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
mlcommons/modelbench#1640 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
mlcommons/modelbench#1638 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
mlcommons/modelbench#1637 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 25/100
mlcommons/modelbench#1633 ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
mlcommons/ailuminate#37 ·
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 35/100
mlcommons/mlperf_client#19 · 2 comments ·
-
Difficulty 3/5 1-2 days Newbie friendliness 25/100
mlcommons/modelbench#1632 ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
Difficulty 2/5 Half a day Newbie friendliness 84/100
mlcommons/modelbench#1629 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 38/100
mlcommons/modelbench#1628 ·
-
mlcommons/mobile_open#43 · 2 comments · 3 assignees ·
-
Run Riki's 11 SUTs Open
Difficulty 4/5 3-5 days Newbie friendliness 35/100
mlcommons/modelbench#1625 · 2 comments ·
-
Difficulty 5/5 Over a week Newbie friendliness 30/100
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
Difficulty 4/5 3-5 days Newbie friendliness 58/100
-
Difficulty 5/5 Over a week Newbie friendliness 38/100
-
Difficulty 3/5 1-2 days Newbie friendliness 25/100
mlcommons/modelbench#1622 ·
-
status: needs-triage type: feature
Difficulty 3/5 1-2 days Newbie friendliness 68/100
-
mlcommons/modelbench#1621 · 3 comments · 1 assignee ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
mlcommons/modelbench#1620 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
mlcommons/modelbench#1618 ·
-
mlcommons/modelbench#1617 · 1 assignee ·
-
Difficulty 5/5 Over a week Newbie friendliness 30/100
mlcommons/modelbench#1616 ·
-
Difficulty 5/5 Over a week Newbie friendliness 42/100
-
Difficulty 4/5 3-5 days Newbie friendliness 42/100
-
Difficulty 3/5 1-2 days Newbie friendliness 68/100
-
Difficulty 5/5 Over a week Newbie friendliness 38/100
-
mlcommons/mobile_app_open#1169 · 1 comment · 1 assignee ·
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
mlcommons/modelbench#1610 ·
-
mlcommons/mobile_app_open#1168 · 1 reaction · 1 assignee ·
Showing the newest 100
This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.