mlcommons / mlcommons/logging

Pretrained model checkpoint validation

Open
#76 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

training
Dominant language
Python
Stars
43
Forks
60
Avg merge
19h 56m
Merged PRs (30d)
3

Description

If a pretrained model is used, have a list of approved checkpoints and make sure the submission uses the approved checkpoints.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named. Start by locating where pretrained model submissions and checkpoints are validated; done means an approved-checkpoint list exists and submissions using unapproved checkpoints are rejected.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, testing-qa
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.