NVIDIA / NVIDIA/Megatron-LM

Muon Optimizer optimization main issue

Open
#3,174 8 comments 0 reactions 1 assignee Claimed by @janEbert View on GitHub
enhancement
Dominant language
Python
Stars
17.9k
Forks
4.5k
Avg merge
4d 6h
Merged PRs (30d)
271

Description

We have supported LayerwiseDistributed Optimizer in main branch. This is the main issue for Muon optimizer usage also optimization.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.