Can AQT be used to calculate qk score?
Open
- Dominant language
- Python
- Stars
- 361
- Forks
- 33
- Avg merge
- 18h 9m
- Merged PRs (30d)
- 4
Description
I see that the sample codes all talk about Attention block or MLP block. Can aqt int8 only be used for parts involving parameter calculation? For example, qk score calculation, score * V calculation, can these be used aqt int8?
Contributor guide
Assessment
This issue has not been assessed yet.