Owner

mlcommons

77 indexed repositories · View on GitHub

• training

  Reference implementations of MLPerf® training benchmarks

  Python · 1771 stars

• inference

  Reference implementations of MLPerf® inference benchmarks

  Python · 1629 stars

• croissant

  Croissant is a high-level format for machine learning datasets that brings together four rich layers.

  Jupyter Notebook · 901 stars

• ck

  Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to learn how to run AI, ML, and oth...

  Python · 651 stars

• tiny

  MLPerf® Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers

  C · 479 stars

• algorithmic-efficiency

  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement...

  Python · 425 stars

• storage

  MLPerf® Storage Benchmark Suite

  Python · 203 stars

• chakra

  Repository for MLCommons Chakra schema and tools

  Python · 196 stars

• GaNDLF

  A generalizable application framework for segmentation, regression, and classification using PyTorch

  Python · 191 stars

• medperf

  An open benchmarking platform for medical artificial intelligence using Federated Evaluation.

  Python · 172 stars

• mlcube

  MLCube® is a project that reduces friction for machine learning by ensuring that models are easily portable and reproducible.

  Python · 160 stars

• modelbench

  Run safety benchmarks against AI models and view detailed reports showing how well they performed.

  Python · 134 stars

• peoples-speech

  The People’s Speech Dataset

  Jupyter Notebook · 115 stars

• training_policies

  Issues related to MLPerf™ training policies, including rules and suggested changes

  Python · 95 stars

• mlperf_client

  MLPerf Client is a benchmark for Windows, Linux and macOS, focusing on client form factors in ML inference scenarios.

  C++ · 91 stars

• ailuminate

  The AILuminate v1.1 benchmark suite is an AI risk assessment benchmark developed with broad involvement from leading AI companies, academ...

  83 stars

• mobile_app_open

  Mobile App Open

  C++ · 71 stars

• inference_policies

  Issues related to MLPerf® Inference policies, including rules and suggested changes

  63 stars

• training_results_v0.7

  This repository contains the results and code for the MLPerf™ Training v0.7 benchmark.

  Python · 57 stars

• inference_results_v0.5

  This repository contains the results and code for the MLPerf™ Inference v0.5 benchmark.

  C++ · 55 stars

• 57 more repositories live on View on GitHub