InternLM / InternLM/InternLM-XComposer
Can we run 4bit Model on RTX4090 with 25GB memory?
Open
- Dominant language
- Python
- Stars
- 2.9k
- Forks
- 175
- PR merge metrics
- No merged PRs in 30d
Description
also is it possible that we can do some improvements on gradio_demo_chat.py
like sd-webui, models are not hard-coded and can be selected from UI.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.