deepseek-ai / deepseek-ai/DeepSeek-VL2
cannot import name 'LlamaFlashAttention2' from 'transformers.models.llama.modeling_llama'
- Dominant language
- Python
- Stars
- 5.4k
- Forks
- 1.8k
- PR merge metrics
- No merged PRs in 30d
Description
Python version is above 3.10, patching the collections module.
Traceback (most recent call last):
File "/home/pzz/pythoncode/deepseek/vl2_load.py", line 4, in
from deepseek_vl2.models import DeepseekVLV2Processor, DeepseekVLV2ForCausalLM
File "/home/pzz/pythoncode/deepseek/DeepSeek-VL2-main/deepseek_vl2/models/__init__.py", line 21, in
from .modeling_deepseek_vl_v2 import DeepseekVLV2ForCausalLM
File "/home/pzz/pythoncode/deepseek/DeepSeek-VL2-main/deepseek_vl2/models/modeling_deepseek_vl_v2.py", line 28, in
from .modeling_deepseek import DeepseekV2ForCausalLM
File "/home/pzz/pythoncode/deepseek/DeepSeek-VL2-main/deepseek_vl2/models/modeling_deepseek.py", line 37, in
from transformers.models.llama.modeling_llama import (
ImportError: cannot import name 'LlamaFlashAttention2' from 'transformers.models.llama.modeling_llama' (/home/pzz/miniconda3/lib/python3.12/site-packages/transformers/models/llama/modeling_llama.py). Did you mean: 'LlamaAttention'?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.