InternLM / InternLM/InternLM-XComposer

多张gpu没法加载

Open
#83 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.9k
Forks
175
PR merge metrics
No merged PRs in 30d

Description

我在运行python web_demo.py --num_gpus 4的时候,执行到第49行代码的时候就报错cuda out of memory退出程序,执行不了后续代码。nvidia-smi监测显示只在第一张显卡上有效,其他显卡都没用上。

image

image

这种情况怎么处理呢

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.