Integration ZeroDDP and ShardedModelv2 from colossal AI
Open
- Dominant language
- Python
- Stars
- 176
- Forks
- 26
- PR merge metrics
- No merged PRs in 30d
Description
## Describe a TODO feature
There are two version of Zero support from ZeroDDP and ShardedModelv2
1. check the possibility to merge two into one
2. Otherwise, it has a function to choose one of them based on the flag (not shown to users directly)
## Assignees
- Dongsung and Hyen
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.