deepseek-ai / deepseek-ai/DeepGEMM
[Feature] Support Bias
Open
- Dominant language
- Cuda
- Stars
- 7.8k
- Forks
- 1.3k
- Avg merge
- 3d 7h
- Merged PRs (30d)
- 3
Description
I was wondering if deepgemm can support bias computation. I think bias term is widely existing in linear layers.
Without bias support, we need to write dedicated kernels to perform sum operator. Compared with fused operator, extra time is needed to read and write the matrix.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.