Tencent / Tencent/digitalhuman
Question about VISTA
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 361
- Forks
- 52
- PR merge metrics
- No merged PRs in 30d
Description
Thank you for sharing this interesting work! I'm having trouble figuring out which modules are being trained even after looking at the VISTA code. Is it correct that only the MLP is trained, and the vision encoder and LLM are frozen, as depicted in Figure 1 of the paper?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the VISTA code and comparing its training configuration with Figure 1 of the paper. Confirm which modules are trainable and which are frozen, then document the answer in the relevant project documentation or issue response.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 1/5
- Estimated time
- Under an hour
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100