OpenGVLab / OpenGVLab/InternVideo
InternVideo2-Chat 8B Visual Encoder and Text Encoder
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 2.4k
- Forks
- 160
- PR merge metrics
- No merged PRs in 30d
Description
Dear Team, Thank you for the great work.
I was currently exploring the InternVideo2-Chat 8B and had a few questions/doubts regarding it.
- What is the visual encoder used? Is it the InternVideo2 s2-1B or InternVideo2clip-1B?
- I am interested in utilising the corresponding text-encoder to the vision-encoder that was jointly trained in stage 2. In the code, you just load the vision encoder and I was wondering if it was possible to access the aligned text-encoder using the hugging-face api or I have to write a separate function like build_text_encoder similar to build_vision_encoder in modelling_base.py. file.
Hopefully it makes sense, otherwise kindly ask.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading modelling_base.py and the build_vision_encoder entry point mentioned in the issue. Trace which visual encoder InternVideo2-Chat 8B loads and check whether the aligned text encoder is exposed through the Hugging Face API. Done means documenting both answers and the available access path.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface, python
- Domain
- ai, machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100