mlcommons/cm4mlops

View on GitHub

Legacy CM repository with a collection of portable, reusable and cross-platform CM automations for MLOps and MLPerf to simplify the process of building, benchmarking and optimizing AI systems across diverse models, data sets, software and hardware

Stars: 20
Forks: 21
Open beginner issues: 0
Indexed issues: 11

Dominant language: Python
License: Apache-2.0
Last GitHub push: Mar 13, 2025
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: help wanted
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

11 open issues indexed

MLPerf Inference: Errors across ONNX Runtime, PyTorch, and TensorRT Backends Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlcommons/cm4mlops#661 · Opened Jun 14, 2025
TensorRT fails with calibration Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlcommons/cm4mlops#660 · Opened Jun 12, 2025
Can't set output location for model download Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mlcommons/cm4mlops#658 · Opened Feb 13, 2025
Not able to execute MLPERF due to error at libcuda.so.1 file not found/available Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mlcommons/cm4mlops#657 · Opened Feb 6, 2025
Error when running MLPerf inference with --device rocm = main.py: error: argument --device: invalid choice: 'rocm' (choose from 'cpu', 'cuda:0') Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlcommons/cm4mlops#649 · Opened Jan 15, 2025
Miniconda Issue Running MLPerf Inference on Windows 11: '锘?CM_CONDA_BIN_WITH_PATH' is not recognized as an internal or external command Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mlcommons/cm4mlops#645 · Opened Jan 9, 2025
Feature request: Apple/Metal support for Docker CM workflow Open

enhancement

mlcommons/cm4mlops#62 · 2 comments · 1 reaction · 1 assignee · Opened Jun 4, 2024
Add CM support for private configuration for rclone Open

enhancement

mlcommons/cm4mlops#25 · 1 comment · 1 assignee · Opened Apr 29, 2024
Improving universal build and run scripts to support cross-platform compilation Open

enhancement help wanted

Difficulty 5/5 Over a week Newbie friendliness 25/100

mlcommons/cm4mlops#24 · Opened Apr 28, 2024
Adding profiling and performance analysis during benchmarking Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 15/100

mlcommons/cm4mlops#23 · Opened Apr 28, 2024
Improving CM script automation and CM scripts Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

mlcommons/cm4mlops#21 · Opened Apr 24, 2024

mlcommons/cm4mlops

Get new issues in your inbox