bigscience-workshop / bigscience-workshop/Megatron-DeepSpeed
hello， I meet a problem
Open
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 226
- PR merge metrics
- No merged PRs in 30d
Description
hello， when I run script to train gpt model，I meet an assertion error：Not sure how to proceed, we were given deepspeed configs in the deepspeed arguments and deepspeed. the script I used is https://github.com/bigscience-workshop/Megatron-DeepSpeed#deepspeed-pp-and-zero-dp. can you tell me why?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.