InternLM / InternLM/InternLM-XComposer
微调使用zero3在载入vision_tower出现报错,当前是不支持zero3吗?
- Dominant language
- Python
- Stars
- 2.9k
- Forks
- 175
- PR merge metrics
- No merged PRs in 30d
Description
Traceback (most recent call last):
File "/opt/tiger/internlm-xcomposer/finetune/finetune.py", line 311, in
train()
File "/opt/tiger/internlm-xcomposer/finetune/finetune.py", line 242, in train
model = transformers.AutoModelForCausalLM.from_pretrained(
File "/home/tiger/.local/lib/python3.9/site-packages/transformers/models/auto/auto_factory.py", line 479, in from_pretrained
return model_class.from_pretrained(
File "/home/tiger/.local/lib/python3.9/site-packages/transformers/modeling_utils.py", line 2675, in from_pretrained
model = cls(config, *model_args, **model_kwargs)
File "/usr/local/lib/python3.9/dist-packages/deepspeed/runtime/zero/partition_parameters.py", line 385, in wrapper
f(module, *args, **kwargs)
File "/home/tiger/.cache/huggingface/modules/transformers_modules/internlm-xcomposer2-vl-7b/modeling_internlm_xcomposer2.py", line 67, in __init__
self.vit = build_vision_tower()
File "/home/tiger/.cache/huggingface/modules/transformers_modules/internlm-xcomposer2-vl-7b/build_mlp.py", line 12, in build_vision_tower
return CLIPVisionTower(vision_tower)
File "/usr/local/lib/python3.9/dist-packages/deepspeed/runtime/zero/partition_parameters.py", line 385, in wrapper
f(module, *args, **kwargs)
File "/home/tiger/.cache/huggingface/modules/transformers_modules/internlm-xcomposer2-vl-7b/build_mlp.py", line 60, in __init__
self.resize_pos()
File "/home/tiger/.cache/huggingface/modules/transformers_modules/internlm-xcomposer2-vl-7b/build_mlp.py", line 91, in resize_pos
pos_tokens = pos_tokens.reshape(-1, orig_size, orig_size,Traceback (most recent call last):
File "/opt/tiger/internlm-xcomposer/finetune/finetune.py", line 311, in
RuntimeError: cannot reshape tensor of 0 elements into shape [-1, 24, 24, 0] because the unspecified dimension size -1 can be any value and is ambiguous
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.