请问lmdeploy如何在多卡部署
Open
- Dominant language
- Python
- Stars
- 2k
- Forks
- 1.5k
- PR merge metrics
- No merged PRs in 30d
Description
输入命令lmdeploy serve api_server后，默认是在单卡（0号卡）上部署，请问怎么实现在多卡上部署？
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.