OpenGVLab / OpenGVLab/InternVideo

InternVideo2-Stage1-1B-224p-K400 missing processor/config for Hugging Face transformers

Open
#305 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2.4k
Forks
160
PR merge metrics
No merged PRs in 30d

Description

Hello,

I am trying to use the Hugging Face model OpenGVLab/InternVideo2-Stage1-1B-224p-K400 with the transformers library for video feature extraction.

When I call:

from transformers import AutoImageProcessor
processor = AutoImageProcessor.from_pretrained("OpenGVLab/InternVideo2-Stage1-1B-224p-K400")

I get the error:

OSError: Can't load image processor for 'OpenGVLab/InternVideo2-Stage1-1B-224p-K400'.
... no preprocessor_config.json file

Looking at the repo, it only contains:

.gitattributes
1B_ft_k710_ft_k400_f16.pth
1B_ft_k710_ft_k400_f8.pth
README.md

There is no config.json or preprocessor_config.json.

This makes it incompatible with AutoImageProcessor / AutoVideoProcessor.

Request

Could you add the appropriate processor/config files (e.g. preprocessor_config.json, config.json) so the model can be loaded via transformers?

Or provide guidance on the recommended way to preprocess inputs for this model when using Hugging Face.

Thanks a lot for releasing this model!

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the AutoImageProcessor.from_pretrained call for OpenGVLab/InternVideo2-Stage1-1B-224p-K400 and inspect the model repository contents and README.md. Compare the existing .pth files with the processor and model metadata expected by transformers. Done means the model has the appropriate configuration files or clear preprocessing guidance for loading and extracting video features.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.