deepseek-ai / deepseek-ai/DeepGEMM
[Feature] Will DeepGEMM support more advanced epilogue fusion for GEMM kernels?
Open
- Dominant language
- Cuda
- Stars
- 7.8k
- Forks
- 1.3k
- Avg merge
- 3d 7h
- Merged PRs (30d)
- 3
Description
https://github.com/deepseek-ai/DeepGEMM/pull/347 has support BF16 accumulation, which can help a lot for large problem sizes. However, I'm wondering if DeepGEMM will consider support direct FP8 output GEMMs in the future and potentially other activation functions too?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.