deepseek-ai / deepseek-ai/DeepSeek-Coder-V2
使用deepspeed lora 4bit 微调完，如何多卡4bit推理呢？
Open
- Dominant language
- No language data
- Stars
- 7k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
可以给一个deepspeed lora 4bit 微调完的推理脚本吗？
順頌時祺～
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.