alipay / alipay/Ant-Multi-Modal-Framework

AntMMF method RuntimeError: mat1 and mat2 shapes cannot be multiplied (8x512 and 768x768)

Offen
#32 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
Vorherrschende Sprache
Python
Sterne
180
Forks
7
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

I used python 3.9 with cuda 11.9, torch 2.1.0 and I could not run the msr_ctt_pvt.local.sh script. I got the follow error. Any ideas?
I have not changed the proposed architecture and only I have run the script.

File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/prj/base_vtp/roi_univl/univl/model/univl_video_ret.py", line 474, in forward
cap_input, vis_input, _, _ = self.module.get_l2_input(
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/prj/base_vtp/roi_univl/univl/model/univl_video_base.py", line 286, in get_l2_input
visual_embed_dict = self.forward_img_encoder(**img_input)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/prj/base_vtp/roi_univl/univl/model/univl_video_base.py", line 124, in forward_img_encoder
clip_feature = img_encoder.img_fc(clip_feature)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/container.py", line 215, in forward
input = module(input)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/linear.py", line 114, in forward
return F.linear(input, self.weight, self.bias)
RuntimeError: mat1 and mat2 shapes cannot be multiplied (8x512 and 768x768)

Beitragsleitfaden

Für dieses Repository ist kein Beitragsleitfaden indexiert

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.