mlcommons / mlcommons/inference

Bandwidth Requirement check in submission checker

Open
#2,347 1 comment 0 reactions 1 assignee View on GitHub

@pgmpablo157321 is already working on this.

Since Oct 6, 2025.

postmortem 5.1
Dominant language
Python
Stars
1.6k
Forks
650
Avg merge
1d 22h
Merged PRs (30d)
6

Description

As per our discussion in postmortem v5.1, we need to add an automatic check in the submission checker which will check the network speed of a given system (relevant field ) is meeting the BW requirement of a submitted benchmark result. As part of this we also need to make sure that the relevant system json field is non empty and a numeral.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.