DAMO-NLP-SG / DAMO-NLP-SG/VideoLLaMA2

Can't load model from huggingface transformers

Open
#147 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.3k
Forks
90
PR merge metrics
No merged PRs in 30d

Description

i try to load the model using

```
# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("DAMO-NLP-SG/VideoLLaMA2.1-7B-16F")
```

but got error

```ValueError: The checkpoint you are trying to load has model type `videollama2_qwen2` but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.```

I tried various transformer version, including suggested 4.40.0 and latest 4.48.0, but all face the same issue

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.