transformers 4.42.4以后已经没有_flash_attention_forward方法
Open
- Dominant language
- Python
- Stars
- 5.2k
- Forks
- 448
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 26
Description
如题，由于model dispatch attention部分未兼容新版transformers，不能更新transformers以训练llama3.1
Contributor guide
Assessment
This issue has not been assessed yet.