ByteDance-Seed / ByteDance-Seed/ByteCheckpoint

megatron-LM support?

Open
#4 2 comments 3 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
290
Forks
22
No merged PRs in 30d

Description

Great job！ I saw the example only FSDP backend, is megatron-LM backend supported (like TP, PP parameter segmentation)?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.