InternLM / InternLM/InternLM-XComposer
GPU out of memory when running example code
Open
- Dominant language
- Python
- Stars
- 2.9k
- Forks
- 175
- PR merge metrics
- No merged PRs in 30d
Description
Hi.
When running `infer_llm_base.py` in `InternLM-XComposer/InternLM-XComposer-2.5-OmniLive/example`, my 40GB A100 went out of memory.
I'm using the downloaded model locally(downloaded from hugging face`.
Is that a problem with the model or the code?
PS: Please provided more detailed guide for running inference of InternLM-XComposer-2.5-OmniLive. Thanks!
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.