deepseek-ai / deepseek-ai/FlashMLA
Why warp specialization is faster than the older traditional style?
Open
- Dominant language
- C++
- Stars
- 12.9k
- Forks
- 1.2k
- Avg merge
- 4h 20m
- Merged PRs (30d)
- 2
Description
I'm curious about this.
It seems we can overlap cuda core and tensor core using warp specialization.
But if it's just for overlap g2s and computation, is there any difference between the warp-specialization style and the traditional style?
Thank you!
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.