huggingface / huggingface/picotron

tp-sp feature

Open
#35 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
2.3k
Forks
203
PR merge metrics
No merged PRs in 30d

Description

Have you guys considered implementing the tp-sp feature of Megatron? I see that only tp is supported.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.