InternLM / InternLM/xtuner

TypeError: object of type 'NoneType' has no len()

Open
#741 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

python ./llama.cpp/examples/llava/llava-surgery-v2.py -C -m llava-llama-3-8b-v1_1

i try to build gguf from a to z.
f i run this, i got error.
```
model.layers.29.self_attn.k_proj.weight : torch.Size([1024, 4096])
model.layers.29.self_attn.o_proj.weight : torch.Size([4096, 4096])
model.layers.29.self_attn.q_proj.weight : torch.Size([4096, 4096])
model.layers.29.self_attn.v_proj.weight : torch.Size([1024, 4096])
model.layers.30.input_layernorm.weight : torch.Size([4096])
model.layers.30.mlp.down_proj.weight : torch.Size([4096, 14336])
model.layers.30.mlp.gate_proj.weight : torch.Size([14336, 4096])
model.layers.30.mlp.up_proj.weight : torch.Size([14336, 4096])
model.layers.30.post_attention_layernorm.weight : torch.Size([4096])
model.layers.30.self_attn.k_proj.weight : torch.Size([1024, 4096])
model.layers.30.self_attn.o_proj.weight : torch.Size([4096, 4096])
model.layers.30.self_attn.q_proj.weight : torch.Size([4096, 4096])
model.layers.30.self_attn.v_proj.weight : torch.Size([1024, 4096])
model.layers.31.input_layernorm.weight : torch.Size([4096])
model.layers.31.mlp.down_proj.weight : torch.Size([4096, 14336])
model.layers.31.mlp.gate_proj.weight : torch.Size([14336, 4096])
model.layers.31.mlp.up_proj.weight : torch.Size([14336, 4096])
model.layers.31.post_attention_layernorm.weight : torch.Size([4096])
model.layers.31.self_attn.k_proj.weight : torch.Size([1024, 4096])
model.layers.31.self_attn.o_proj.weight : torch.Size([4096, 4096])
model.layers.31.self_attn.q_proj.weight : torch.Size([4096, 4096])
model.layers.31.self_attn.v_proj.weight : torch.Size([1024, 4096])
model.norm.weight : torch.Size([4096])
Taking projector from None
Traceback (most recent call last):
File "/Users/jaylee/Desktop/langchain/pdf_upload/youtube/gguf/vconvert/./llama.cpp/examples/llava/llava-surgery-v2.py", line 137, in
print(f"Found {len(mm_tensors)} tensors to extract out of {len(last_checkpoint)} tensors.")
^^^^^^^^^^^^^^^^^^^^
TypeError: object of type 'NoneType' has no len()

```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.