AttributeError: 'Qwen2FlashAttention2' object has no attribute '_flash_attention_forward'
Open
- Dominant language
- Python
- Stars
- 5.2k
- Forks
- 448
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 26
Description
https://github.com/modelscope/ms-swift/issues/2107#issuecomment-2370042882
xtuner 0.1.23
[rank1]: File "/data1/zhangyq/miniforge3/envs/py310/lib/python3.10/site-packages/xtuner/model/modules/dispatch/qwen2.py", line 160, in qwen2_attn_forward
[rank1]: attn_output = self._flash_attention_forward(
[rank1]: File "/data1/zhangyq/miniforge3/envs/py310/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1729, in __getattr__
[rank1]: raise AttributeError(f"'{type(self).__name__}' object has no attribute '{name}'")
[rank1]: AttributeError: 'Qwen2FlashAttention2' object has no attribute '_flash_attention_forward'
Contributor guide
Assessment
This issue has not been assessed yet.