deepseek-ai / deepseek-ai/DeepGEMM

The reduction of GPU core frequency leads to significant fluctuations in GEMM performance

Open
#120 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Cuda
Stars
7.8k
Forks
1.3k
Avg merge
3d 7h
Merged PRs (30d)
3

Description

We encounter a problem when performing deepseek inference. When we overlap computation and communication, the power consumption exceeded the limit, resulting in GPU core frequency reduction (e.g. from 1980MHz to 1575 MHz), which caused large fluctuations in GEMM performance. We notice that similar situation does not exist in the deepseek profile, so we would like to ask if there is a corresponding solution?
We have tried locking the frequency to a lower level (e.g. 1575 MHz), but it resulted in a decrease in overall end-to-end performance.
Looking forward to your answer! Thank you!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.