deepseek-ai / deepseek-ai/FlashMLA
flash_fwd_mla_kernel.h offset calculation 偏移量计算问题
Open
- Dominant language
- C++
- Stars
- 12.9k
- Forks
- 1.2k
- Avg merge
- 4h 20m
- Merged PRs (30d)
- 2
Description
In the file *flash_fwd_mla_kernel.h*, there are several double-buffering processes. In each of these processes, the target offsets are either `sK_offset / 8` or `sK_offset`, where `sK_offset` is equal to `576 * 64`. However, I am unclear about the purpose of the `/8` operation.
If the iteration is intended to proceed along the N-dimension, the offset in matrix K should naturally be `576 * 64`. Why is the additional division by 8 necessary?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.