How to make it work with torch DDP
Open
- Dominant language
- Jupyter Notebook
- Stars
- 2.6k
- Forks
- 1k
- PR merge metrics
- No merged PRs in 30d
Description
Debugging code for parallel training is very painful, and it would be very appealing to be able to do it in a notebook.
The most relevant thing I found is https://github.com/philtrade/Ddip and https://github.com/Bluefog-Lib/bluefog, but it seems that they are no longer being maintained.
Contributor guide
Assessment
This issue has not been assessed yet.