InternLM / InternLM/InternEvo

[Feature] MoE模型里稠密层和专家层zero和并行的解耦

Open
#325 0 comments 0 reactions 1 assignee Claimed by @blankde View on GitHub
enhancement
Dominant language
Python
Stars
421
Forks
67
PR merge metrics
No merged PRs in 30d

Description

### Describe the feature

MoE模型里稠密层和专家层zero和并行的解耦

### Will you implement it?

- [ ] I would like to implement this feature and create a PR!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.