MLPerf benchmarks: which are provided as containers?
Open
@michaelmckinsey1 is already working on this.
Since Jul 29, 2025.
application
- Dominant language
- Python
- Stars
- 78
- Forks
- 52
- Avg merge
- 4d 19m
- Merged PRs (30d)
- 10
Description
Main thing
- Ramble has apptainer (for custom MPIs), docker (single node), and nroot modifiers.
- pynemo and pynemo2 can be used for constructing inputs.
- The main one is Llama 3.1 405B training --- https://github.com/NVIDIA/NeMo-Framework-Launcher/tree/main/launcher_scripts/conf/training/llama
We need to look whether the MLPerf benchmarks below are provided as containers:
Identify benchmarks for:
- Transformers
- Stable diffusion
- Inference datacenter
- LLM GPT3
- Llama 3.1 405B inference
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.