mlcommons / mlcommons/inference

Consolidate dir structure

Open
#2,176 2 comments 0 reactions 1 assignee View on GitHub

@pgmpablo157321 is already working on this.

Since Sep 15, 2025.

postmortem 5.0
Dominant language
Python
Stars
1.6k
Forks
650
Avg merge
1d 22h
Merged PRs (30d)
6

Description

After v4.1 we removed legacy ‘calibration’ dir because it was no longer valued (usurped by code dir). There continue to be three largely overlapping dirs which are inconvenient to navigate and only separated due to legacy (not utility): compliance, measurements, results. Due to common structure, these can be easily merged as follows. Simplifying the dir structure will reduce common difficulties, merge complications, and especially error debugging from submission checker (frequent vague errors due to misnaming and missing files):

Image

Post mortem task proposed by @keithachorn-intel

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.