mlcommons / mlcommons/inference
dlrm or dlrm-v2 is the official model name?
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 650
- Avg merge
- 1d 22h
- Merged PRs (30d)
- 6
Description
In the mlperf.conf we have both dlrm and dlrm-v2 and this is confusing to the submitters as to which one to use. Even though dlrm-v2 is the expected one, we have submissions where dlrm is used. Currently, both dlrm and dlrm-v2 are having non-conflicting values, but it is good to clarify this.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Review mlperf.conf around line 12 to understand why both dlrm and dlrm-v2 are defined and which name submissions are expected to use. Confirm the official model name and clarify the configuration so submitters have one unambiguous choice.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100