NVIDIA / NVIDIA/Megatron-LM

Muon Documentation and user guide

Open
#3,176 0 comments 0 reactions 1 assignee Claimed by @BoxiangW View on GitHub
Dominant language
Python
Stars
17.9k
Forks
4.5k
Avg merge
4d 6h
Merged PRs (30d)
271

Description

Add documentation for muon and LayerwiseDistributedOptimizer. Also user guide with Muon and LayerwiseDistributedOptimizer

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.