deepseek-ai / deepseek-ai/FlashMLA
[Question] Why the first release version support the block_size = 64
Open
- Dominant language
- C++
- Stars
- 12.9k
- Forks
- 1.2k
- Avg merge
- 4h 20m
- Merged PRs (30d)
- 2
Description
the block_size of traditional page attn is 16, used on head_size 128，make one page size 4KB。
here why to support 64 block_size。
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.