softmax_type != vanilla support thd format
Open
community-request
enhancement
waiting-on-customer
- Dominant language
- Python
- Stars
- 17.9k
- Forks
- 4.5k
- Avg merge
- 4d 6h
- Merged PRs (30d)
- 271
Description
hello, i find in TransformerEngine, it will close Fusedattn when i use softmax_type==learnable and thd format
Contributor guide
Assessment
This issue has not been assessed yet.