bigscience-workshop / bigscience-workshop/Megatron-DeepSpeed
About reshape deepspeed checkpoint
Open
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 226
- PR merge metrics
- No merged PRs in 30d
Description
I want to ask why we can not make tp and pp of a checkpoint bigger? For example, make tp=4 when its original tp is 2. I tried to do this thing but got an assertion error. Thanks for any reply.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.