[Bug] 用MoE训练的时候tflop超级低
Open
bug
- Dominant language
- Python
- Stars
- 421
- Forks
- 67
- PR merge metrics
- No merged PRs in 30d
Description
### 描述该错误
训练MoE模型时，模型的tflops只有几十，正常训练的时候是正常的
### 环境信息
官方镜像代码
### 其他信息
_No response_
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.