deepseek-ai / deepseek-ai/FlashMLA

Is there any comparison between the effects of FA3 and FA2?

Open
#2 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
C++
Stars
12.9k
Forks
1.2k
Avg merge
4h 20m
Merged PRs (30d)
2

Description

Is there any comparison between the three in MLA? And how does GQA perform under the common dense condition? 1000 Thanks.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.