OpenGVLab / OpenGVLab/InternVideo

Problem with dropout_layer_norm

Open
#226 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2.4k
Forks
160
PR merge metrics
No merged PRs in 30d

Description

Hi, thank you for your great work!
I want to use InternVideo2 as backbone. I installed flash-attn 2.7.3 and dropout_layer_norm from source. But now i am struggling with this error when trying to run sample code:

Traceback (most recent call last):
File "/home/maxim/test/main.py", line 2, in
import InternVideo.InternVideo2.single_modality.models.internvideo2
File "/home/maxim/test/InternVideo/InternVideo2/single_modality/models/init.py", line 1, in
from .internvl_clip_vision import internvl_clip_6b
File "/home/maxim/test/InternVideo/InternVideo2/single_modality/models/internvl_clip_vision.py", line 13, in
from flash_attn.ops.rms_norm import DropoutAddRMSNorm
File "/home/maxim/anaconda3/envs/myenv/lib/python3.12/site-packages/flash_attn/ops/rms_norm.py", line 7, in
from flash_attn.ops.layer_norm import (
File "/home/maxim/anaconda3/envs/myenv/lib/python3.12/site-packages/flash_attn/ops/layer_norm.py", line 4, in
import dropout_layer_norm
ImportError: /home/maxim/anaconda3/envs/myenv/lib/python3.12/site-packages/dropout_layer_norm.cpython-312-x86_64-linux-gnu.so: undefined symbol: __cxa_call_terminate

Can you give any guidance how to solve it or provide config.json like you have on hugging face for VideoMae please. That will be really helpfull
Thank you!

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the import chain in single_modality/models/internvl_clip_vision.py and the flash_attn.ops.rms_norm and flash_attn.ops.layer_norm modules shown in the traceback. Reproduce the sample import in the reported Python 3.12 environment and inspect the dropout_layer_norm installation. Done should mean the InternVideo2 sample imports successfully, or the required configuration and compatible dependency setup are documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.