huggingface / huggingface/accelerate
Why does accelerate's MegatronLMPlugin use its own megatron?
Open
wip
- Dominant language
- Python
- Stars
- 9.9k
- Forks
- 1.5k
- Avg merge
- 5d 2h
- Merged PRs (30d)
- 27
Description
I want to use the MegatronLMPlugin to train a megatron model, but [the guide](https://huggingface.co/docs/accelerate/main/en/usage_guides/megatron_lm) tell me the Megatron is https://github.com/huggingface/Megatron-LM, not the https://github.com/NVIDIA/Megatron-LM.
I want to ask why does accelerate use its own megatron? What differents between these two megatron?
Contributor guide
Assessment
This issue has not been assessed yet.