InternLM / InternLM/InternLM-XComposer

InternLM-XComposer2-4KHD-7B 多卡推理

Open
#256 2 comments 0 reactions 1 assignee Claimed by @LightDXY View on GitHub
Dominant language
Python
Stars
2.9k
Forks
175
No merged PRs in 30d

Description

请问一下 InternLM-XComposer2-4KHD-7B 如何多卡推理，单卡 A100 40G 显存提示不够

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.