deepseek-ai / deepseek-ai/DeepGEMM
The reduction of GPU core frequency leads to significant fluctuations in GEMM performance
- Dominant language
- Cuda
- Stars
- 7.8k
- Forks
- 1.3k
- Avg merge
- 3d 7h
- Merged PRs (30d)
- 3
Description
We encounter a problem when performing deepseek inference. When we overlap computation and communication, the power consumption exceeded the limit, resulting in GPU core frequency reduction (e.g. from 1980MHz to 1575 MHz), which caused large fluctuations in GEMM performance. We notice that similar situation does not exist in the deepseek profile, so we would like to ask if there is a corresponding solution?
We have tried locking the frequency to a lower level (e.g. 1575 MHz), but it resulted in a decrease in overall end-to-end performance.
Looking forward to your answer! Thank you!
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.