What is the VRAM required for inference?
Open
- Dominant language
- Python
- Stars
- 840
- Forks
- 14
- PR merge metrics
- No merged PRs in 30d
Description
Great work!
I followed the instructions in the documentation for inference, but I always encounter an out-of-memory issue.
My GPU is an RTX 3090 with 24GB of VRAM.
If the issue is related to VRAM, could you provide an option for multi-GPU inference?
Looking forward to your response.
Thank you very much.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.