InternLM / InternLM/InternLM-XComposer

When fine-tune with fix_vit=False, will the CLIP-VIT be tuned, or the PORA adapter be tuned?

Open
#449 0 comments 0 reactions 1 assignee Claimed by @panzhang0212 View on GitHub
Dominant language
Python
Stars
2.9k
Forks
175
PR merge metrics
No merged PRs in 30d

Description

I am tuning the 4KHD model for downstream tasks, and I have such question because after fine-tuning, the checkpoint directory does not have checkpoint for CLIP-VIT, and the build_mlp.py is rewritten as
`vision_tower = 'openai/clip-vit-large-patch14-336'`

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.