mlcommons / mlcommons/logging

package_checker creates file scaling.json in result directory

Open
#278 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
43
Forks
60
Avg merge
19h 56m
Merged PRs (30d)
3

Description

When running the package checker to check for a valid MLPerf training submission, the package_checker leaves a file
scaling.json in the results/.../maskrcnn directory. This file makes the submission directory invalid for submission it seems.

python3 -m mlperf_logging.package_checker Final/Lenovo training 2.1.0 --rcp_bert_train_samples

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by running the reported python3 -m mlperf_logging.package_checker command and inspect the generated results/.../maskrcnn directory. Trace the mlperf_logging.package_checker entry point to find where scaling.json is created. Done means the checker still validates the submission without leaving that file in the result directory.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli, tooling
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.