deepseek-ai / deepseek-ai/FlashMLA

Why warp specialization is faster than the older traditional style?

Open
#48 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
12.9k
Forks
1.2k
Avg merge
4h 20m
Merged PRs (30d)
2

Description

I'm curious about this.

It seems we can overlap cuda core and tensor core using warp specialization.

But if it's just for overlap g2s and computation, is there any difference between the warp-specialization style and the traditional style?

Thank you!

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.