mlcommons / mlcommons/storage

[Bug] MLPStorage Validation Fails with "Expected 6 run files, but found 12" for RetinaNet on Both B200 and MI355

Open
#679 5 comments 0 reactions 1 assignee View on GitHub

@FileSystemGuy is already working on this.

Since Jul 5, 2026.

Dominant language
Python
Stars
203
Forks
67
Avg merge
20m
Merged PRs (30d)
8

Description

Issue Summary
When running mlpstorage validate on the aggregated RetinaNet results from both B200 and MI355 platforms, the validation tool reports a file count mismatch error. The tool expects 6 files but finds 12.

Scenario Context
We are conducting run validation for RetinaNet on two accelerator platforms:

B200 – 6 runs

MI355 – 6 runs

This results in a total of 12 runtime files (6 from each platform), which is correct and expected behavior. However, the validation script appears to assume a single-platform context and expects only 6 files, failing when it encounters the combined set of 12.

[ERROR] [2.1.17 runTimestamps] ./closed/xxxx/training/retinanet/run: Expected 6 run files, but found 12. Timestamps

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.