alipay / alipay/Ant-Multi-Modal-Framework

AntMMF method RuntimeError: mat1 and mat2 shapes cannot be multiplied (8x512 and 768x768)

Abierto
#32 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Python
Estrellas
180
Forks
7
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

I used python 3.9 with cuda 11.9, torch 2.1.0 and I could not run the msr_ctt_pvt.local.sh script. I got the follow error. Any ideas?
I have not changed the proposed architecture and only I have run the script.

File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/prj/base_vtp/roi_univl/univl/model/univl_video_ret.py", line 474, in forward
cap_input, vis_input, _, _ = self.module.get_l2_input(
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/prj/base_vtp/roi_univl/univl/model/univl_video_base.py", line 286, in get_l2_input
visual_embed_dict = self.forward_img_encoder(**img_input)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/prj/base_vtp/roi_univl/univl/model/univl_video_base.py", line 124, in forward_img_encoder
clip_feature = img_encoder.img_fc(clip_feature)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/container.py", line 215, in forward
input = module(input)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
return forward_call(*args, **kwargs)
File "/home/mpegia/MyProjects/Ant-Multi-Modal-Framework-main/env/lib/python3.9/site-packages/torch/nn/modules/linear.py", line 114, in forward
return F.linear(input, self.weight, self.bias)
RuntimeError: mat1 and mat2 shapes cannot be multiplied (8x512 and 768x768)

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.