deepspeedai / deepspeedai/DeepSpeed
[BUG] how to achieve hybrid data and pipeline parallelism?
Open
Nobody has claimed this yet.
bug
training
- Dominant language
- Python
- Stars
- 43.1k
- Forks
- 5k
- Avg merge
- 4d 15h
- Merged PRs (30d)
- 112
Description
I have carefully read the tutorial(https://www.deepspeed.ai/tutorials/pipeline), but I’m still unclear about how to achieve hybrid data and pipeline parallelism. Is there an example available?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the pipeline tutorial linked in the issue and compare its documented setup with the requested hybrid data and pipeline parallelism. Clarify the intended configuration and define what a runnable example must demonstrate; done would be an agreed, usable example or documentation addition.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- distributed-systems, machine-learning
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100