OpenGVLab / OpenGVLab/InternVideo
Problem with dropout_layer_norm
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 2.4k
- Forks
- 160
- PR merge metrics
- No merged PRs in 30d
Description
Hi, thank you for your great work!
I want to use InternVideo2 as backbone. I installed flash-attn 2.7.3 and dropout_layer_norm from source. But now i am struggling with this error when trying to run sample code:
Traceback (most recent call last):
File "/home/maxim/test/main.py", line 2, in
import InternVideo.InternVideo2.single_modality.models.internvideo2
File "/home/maxim/test/InternVideo/InternVideo2/single_modality/models/init.py", line 1, in
from .internvl_clip_vision import internvl_clip_6b
File "/home/maxim/test/InternVideo/InternVideo2/single_modality/models/internvl_clip_vision.py", line 13, in
from flash_attn.ops.rms_norm import DropoutAddRMSNorm
File "/home/maxim/anaconda3/envs/myenv/lib/python3.12/site-packages/flash_attn/ops/rms_norm.py", line 7, in
from flash_attn.ops.layer_norm import (
File "/home/maxim/anaconda3/envs/myenv/lib/python3.12/site-packages/flash_attn/ops/layer_norm.py", line 4, in
import dropout_layer_norm
ImportError: /home/maxim/anaconda3/envs/myenv/lib/python3.12/site-packages/dropout_layer_norm.cpython-312-x86_64-linux-gnu.so: undefined symbol: __cxa_call_terminate
Can you give any guidance how to solve it or provide config.json like you have on hugging face for VideoMae please. That will be really helpfull
Thank you!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the import chain in single_modality/models/internvl_clip_vision.py and the flash_attn.ops.rms_norm and flash_attn.ops.layer_norm modules shown in the traceback. Reproduce the sample import in the reported Python 3.12 environment and inspect the dropout_layer_norm installation. Done should mean the InternVideo2 sample imports successfully, or the required configuration and compatible dependency setup are documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100