InternLM / InternLM/InternEvo

[QA] 关于使用张量并行或流水线并行的模型切分与合并问题

Open
#176 0 comments 0 reactions 1 assignee Assigned to @SolenoidWGT View on GitHub
question
Dominant language
Python
Stars
421
Forks
67
PR merge metrics
No merged PRs in 30d

Description

### 描述问题

请问基于一个书生格式的ckpt希望做张量并行或流水线并行,需要自己切分模型以适配对应的并行度吗?
直接加载会报错,官方有提供相应的脚本吗?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.