InternLM / InternLM/xtuner

多卡微调报错

Open
#695 10 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

单卡qlora微调可正常启动；多卡启动报错：
![微信图片_20240516154210](https://github.com/InternLM/xtuner/assets/51654766/43e9fe0a-22f2-4b65-a7fd-3297c34070cb)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.