InternLM / InternLM/InternLM-XComposer
batch inference support
Open
- Dominant language
- Python
- Stars
- 2.9k
- Forks
- 175
- PR merge metrics
- No merged PRs in 30d
Description
Awesome work!
Currently, the provided inference code example seems to not support batch inference. Can you add support for it?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.