facebookresearch / facebookresearch/fairscale

[doc] Example for intra-layer parallelism

Open
#226 1 comment 0 reactions 0 assignees View on GitHub
documentation icebox
Dominant language
Python
Stars
3.4k
Forks
293
PR merge metrics
No merged PRs in 30d

Description

Can we add an example on how to use intra-layer parallelism?

Contributor guide

Open the contributing guide

Research direction

No file, test, or entry point is named. Start by locating FairScale's existing parallelism documentation and examples, then determine where an intra-layer parallelism example belongs. Done means the documentation includes a clear, usable example of how to use intra-layer parallelism.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
documentation
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.