InternLM / InternLM/InternLM-XComposer
About the acceleration frame work.
Open
- Dominant language
- Python
- Stars
- 2.9k
- Forks
- 175
- PR merge metrics
- No merged PRs in 30d
Description
Hi!
I wonder if you have tried to deploy any acceleration or memory saving framework for InternLM-XComposer? like vLLM.
If so can you provide code or possible solution?
Thanks!
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.