mlcommons/logging

View on GitHub

MLPerf™ logging library

Stars: 43
Forks: 60
Open beginner issues: 0
Indexed issues: 41
Avg merge: 19h 56m
Merged PRs (30d): 3

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 3, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

41 open issues indexed

System json extension to include networking information and firmware version Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlcommons/logging#418 · 2 comments · Opened Apr 17, 2025
Remove external dependencies from mlperf_logging so it can run in standard Python3 Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlcommons/logging#379 · 1 comment · Opened Aug 21, 2024
Correctly implement lower convex envelope in RCP pruning logic Open

Difficulty 2/5 1-3 hours Newbie friendliness 65/100

mlcommons/logging#368 · Opened May 10, 2024
Why is RCP pruned based on min instead of mean values? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlcommons/logging#367 · 7 comments · Opened May 10, 2024
Data is very sparse on the website, can filter added Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlcommons/logging#343 · Opened Oct 6, 2023
Exclude data staging from runtime in hpc_3.0.0/common.yaml checks Open

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

mlcommons/logging#318 · Opened May 26, 2023
Description errors for variable that changed names Open

Difficulty 3/5 1-2 days Newbie friendliness 32/100

mlcommons/logging#291 · Opened Jan 18, 2023
package_checker creates file scaling.json in result directory Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mlcommons/logging#278 · 2 comments · Opened Oct 12, 2022
Maskrcnn num_image_candidates compliance Open

v2.1

Difficulty 2/5 1-3 hours Newbie friendliness 48/100

mlcommons/logging#245 · Opened Jun 16, 2022
Maintain log spec Open

mlcommons/logging#244 · 2 assignees · Opened Jun 8, 2022
Check the existence of source code Open

v2.1

mlcommons/logging#243 · 2 assignees · Opened Jun 8, 2022
Logs submission_* fields should match system description files Open

v2.1

mlcommons/logging#241 · 2 assignees · Opened Jun 8, 2022
Finding log file Open

Difficulty 1/5 Under an hour Newbie friendliness 20/100

mlcommons/logging#240 · Opened May 24, 2022
Results summarizer fails when results folder is empty Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

mlcommons/logging#236 · Opened May 18, 2022
Set requirement for SW packages needed to run logging infra Open

v2.1

mlcommons/logging#235 · 1 assignee · Opened May 12, 2022
PyPI package for mllogger Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlcommons/logging#218 · 7 comments · Opened Mar 23, 2022
Use original RCP for RCP test if batch size and ALL hparams of submission match the RCP, otherwise used pruned RCPs. Open

v2.1

mlcommons/logging#214 · 1 comment · 1 assignee · Opened Mar 16, 2022
Address 1.1 review period issues Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlcommons/logging#203 · 2 comments · Opened Nov 16, 2021
Use of constants in constants.py Open

mlcommons/logging#199 · 1 assignee · Opened Oct 19, 2021
New directory structure proposal. Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlcommons/logging#156 · 2 comments · Opened Sep 13, 2021
REQ conditioned on context values Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlcommons/logging#150 · 1 comment · Opened Aug 11, 2021
[BERT|RNNT] Verify vocab size in compliance checker Open

mlcommons/logging#148 · 3 comments · 1 assignee · Opened Aug 3, 2021
Add hparams and compliance checks for training and eval samples for all benchmarks Open

mlcommons/logging#143 · 3 comments · 1 assignee · Opened Jun 14, 2021
Seed checker gets confused when handling multiple implementations Open

v1.1

mlcommons/logging#129 · 8 comments · 1 assignee · Opened May 19, 2021
Document RCPs method of production Open

v1.1

mlcommons/logging#116 · 6 comments · 1 assignee · Opened May 7, 2021
Inference directory structure is out of date Open

Difficulty 3/5 1-2 days Newbie friendliness 30/100

mlcommons/logging#104 · Opened Apr 29, 2021
Validate number of logging entries Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlcommons/logging#91 · 1 comment · Opened Mar 22, 2021
Add info about initialization method in logging Open

training v1.1

mlcommons/logging#80 · 3 comments · 1 assignee · Opened Jan 9, 2021
Compliance checker: epoch number for evaluations should be validated against reference schedule Open

training v1.1

mlcommons/logging#79 · 3 comments · 1 assignee · Opened Jan 9, 2021
Include preprocessing script as part of the submission Open

training

Difficulty 3/5 1-2 days Newbie friendliness 20/100

mlcommons/logging#77 · Opened Jan 9, 2021
Pretrained model checkpoint validation Open

training

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlcommons/logging#76 · 1 comment · Opened Jan 9, 2021
Enable dataset validation Open

training

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlcommons/logging#75 · Opened Jan 9, 2021
Compliance checker should check if the log shows correct line numbers Open

training v1.1

mlcommons/logging#74 · 1 comment · 1 assignee · Opened Jan 9, 2021
[Training+Inference] Common lib for common logging format Open

training+inference

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlcommons/logging#54 · Opened Jun 18, 2020
[Training+Inference] Spec of common format Open

training+inference

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlcommons/logging#53 · Opened Jun 18, 2020
[Training+Inference] Package checker Open

training+inference

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlcommons/logging#52 · Opened Jun 18, 2020
[Training] File level checker Open

training

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlcommons/logging#51 · Opened Jun 18, 2020
[Inference] Logging performance Open

inference

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlcommons/logging#50 · Opened Jun 18, 2020
[Inference] Utility checkers Open

inference

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlcommons/logging#49 · Opened Jun 18, 2020
[Inference] Change logging format to match training Open

inference

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlcommons/logging#48 · Opened Jun 18, 2020
[Inference] Fuse logs to 1 file Open

inference

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlcommons/logging#47 · Opened Jun 18, 2020

mlcommons/logging

Get new issues in your inbox