NVIDIA / NVIDIA/Megatron-LM

MFSDP v2: Add NVFP4 support

Open
#6,928 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
17.9k
Forks
4.5k
Avg merge
4d 3h
Merged PRs (30d)
272

Description

Add NVFP4 support for MFSDP v2.

Do this after #5615

Contributor guide

Open the contributing guide

Research direction

Start by reviewing issue #5615, since this work is explicitly dependent on it, then locate the MFSDP v2 implementation and its existing precision-support paths. Determine the project's validation approach for NVFP4 support; done means MFSDP v2 supports NVFP4 without regressing existing modes.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.