deepseek-ai / deepseek-ai/DeepSeek-VL2

ImportError: cannot import name 'LlamaFlashAttention2' from 'transformers.models.llama.modeling_llama' , !pip install transformers==4.47.1 does not fix

Open
#87 7 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.4k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

---------------------------------------------------------------------------
ImportError Traceback (most recent call last)
Cell In[43], line 11
6 except ImportError:
7 LlamaFlashAttention2 = None # or assign a fallback implementation
---> 11 from deepseek_vl2.models import DeepseekVLV2ForCausalLM
12 from deepseek_vl2.models import DeepseekVLV2Processor
14 from deepseek_vl2.utils.io import load_pil_images

File ~/DeepSeek-VL2/deepseek_vl2/models/__init__.py:21
1 # Copyright (c) 2023-2024 DeepSeek.
2 #
3 # Permission is hereby granted, free of charge, to any person obtaining a copy of
(...)
17 # IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN
18 # CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
20 from .processing_deepseek_vl_v2 import DeepseekVLV2Processor
---> 21 from .modeling_deepseek_vl_v2 import DeepseekVLV2ForCausalLM
23 __all__ = [
24 "DeepseekVLV2Processor",
25 "DeepseekVLV2ForCausalLM",
26 ]

File ~/DeepSeek-VL2/deepseek_vl2/models/modeling_deepseek_vl_v2.py:28
26 from .siglip_vit import VisionTransformer
27 from .configuration_deepseek import DeepseekV2Config
---> 28 from .modeling_deepseek import DeepseekV2ForCausalLM
31 logger = logging.get_logger(__name__)
34 class MlpProjector(nn.Module):

File ~/DeepSeek-VL2/deepseek_vl2/models/modeling_deepseek.py:37
35 from transformers.cache_utils import Cache, DynamicCache
36 from transformers.modeling_attn_mask_utils import _prepare_4d_causal_attention_mask
---> 37 from transformers.models.llama.modeling_llama import (
38 LlamaAttention,
39 LlamaFlashAttention2
40 )
41 from transformers.modeling_outputs import (
42 BaseModelOutputWithPast,
43 CausalLMOutputWithPast,
44 SequenceClassifierOutputWithPast,
45 )
46 from transformers.modeling_utils import PreTrainedModel

ImportError: cannot import name 'LlamaFlashAttention2' from 'transformers.models.llama.modeling_llama'

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.