NVIDIA / NVIDIA/Megatron-LM

MFSDP v2: Improve DCP checkpoint-saving performance

Open
#6,929 1 comment 0 reactions 1 assignee Claimed by @ahmadki View on GitHub
Dominant language
Python
Stars
17.9k
Forks
4.5k
Avg merge
4d 3h
Merged PRs (30d)
272

Description

DCP checkpoint-saving performance may need further optimization. This was briefly discussed in [nv/lj1](http://nv/lj1), but supporting data is still needed.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.