huggingface / huggingface/accelerate
[Feature Request] Support Megatron-Deepspeed
Open
enhancement
feature request
- Dominant language
- Python
- Stars
- 9.9k
- Forks
- 1.5k
- Avg merge
- 5d 2h
- Merged PRs (30d)
- 27
Description
Megatron-LM and Deepspeed is supported by accelerate in experimental state. Do you have a plan to support [Megatron-Deepeed](https://github.com/microsoft/Megatron-DeepSpeed)?
Contributor guide
Assessment
This issue has not been assessed yet.