intel / intel/graph-compiler

[Experimental] Scaled Dot Product Attention FlashAttention Algorithm Conversion

Open
#147 1 comment 0 reactions 1 assignee Claimed by @yifeizh2 View on GitHub
Dominant language
C++
Stars
54
Forks
16
PR merge metrics
No merged PRs in 30d

Description

Utilize flash attention algorithm to optimize the performance of attention

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.