deepseek-ai / deepseek-ai/DeepSeek-V2
为何我在A800上运行DeepSeek-V2-Lite-Chat (SFT)，竟然消耗60G的显存？！
Open
- Dominant language
- No language data
- Stars
- 5k
- Forks
- 550
- PR merge metrics
- No merged PRs in 30d
Description
权重文件一共32G左右。
为啥实际加载模型后，占用内存将近60多G呢。
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.