mlcommons/tiny

View on GitHub

MLPerf® Tiny is an ML benchmark suite for extremely low-power systems such as microcontrollers

Stars: 479
Forks: 116
Open beginner issues: 0
Indexed issues: 15

Dominant language: C
License: Apache-2.0
Last GitHub push: Jul 13, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

15 open issues indexed

Question: should MCU-scale language runtimes have a Tiny benchmark category? Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlcommons/tiny#181 · Opened Mar 17, 2026
No wakeword detection on Streaming Wakeword benchmark. Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlcommons/tiny#175 · Opened May 7, 2025
Test harness mandatory? Open

mlcommons/tiny#165 · 1 comment · 1 assignee · Opened Sep 24, 2024
Anomaly Detection get_datasets.sh not working Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mlcommons/tiny#159 · 1 comment · Opened Apr 11, 2024
Inconsistency with bias enabled in the pytorch model (Conv2d) for image classification Open

Difficulty 1/5 Under an hour Newbie friendliness 35/100

mlcommons/tiny#147 · 1 comment · Opened Feb 5, 2024
Confusing unused batch_size Variable in train_vww.py Open

Difficulty 1/5 Under an hour Newbie friendliness 68/100

mlcommons/tiny#138 · Opened Mar 8, 2023
Changelog Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlcommons/tiny#136 · Opened Jan 17, 2023
Where is the Visual Wake Word test set? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlcommons/tiny#135 · 5 comments · 4 reactions · Opened Jan 12, 2023
Model from visual wake word does not work for Harvard tinyMLx course arduino code Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlcommons/tiny#132 · Opened Aug 23, 2022
Cannot get anomaly_detection to run, memory issues Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlcommons/tiny#130 · Opened Jun 1, 2022
Loss is negative and accuracy=0.006 when tried to prune anamoly detection Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlcommons/tiny#118 · 1 comment · Opened Jan 20, 2022
Measure performance and accuracy on customized dataset Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlcommons/tiny#109 · Opened Sep 22, 2021
need clarification on the pre-processing rules in open division Open

Difficulty 1/5 Under an hour Newbie friendliness 25/100

mlcommons/tiny#102 · Opened Jul 20, 2021
addQuantize and addDequantize in th_final_initialize of anamoly detection submitter_implemented.cpp Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

mlcommons/tiny#101 · 7 comments · Opened Jul 14, 2021
User guide for submitter/internally implemented was never published Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlcommons/tiny#100 · Opened Jul 7, 2021

mlcommons/tiny

Get new issues in your inbox