InternLM / InternLM/InternEvo

[QA] 用Internevo已经训练出来了一个7B模型,如何用这个internevo权重跑MoE?

Open
#251 1 comment 0 reactions 1 assignee Claimed by @sunpengsdu View on GitHub
question
Dominant language
Python
Stars
421
Forks
67
PR merge metrics
No merged PRs in 30d

Description

### Describe the question.

我用internevo跑了一个7B的模型,拿到了一个internevo的模型权重,现在我要基于这个权重跑一个MoE的模型,我发现load进来会报这个错,请问如何解决?
AssertionError: /beegfs/workspace/nlp/leo/model_ckpt/7B_v7/715255/model_moe_layer0_expert0_tp0.pt is not found!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.