InternLM / InternLM/InternLM-XComposer
When fine-tune with fix_vit=False, will the CLIP-VIT be tuned, or the PORA adapter be tuned?
Open
- Dominant language
- Python
- Stars
- 2.9k
- Forks
- 175
- PR merge metrics
- No merged PRs in 30d
Description
I am tuning the 4KHD model for downstream tasks, and I have such question because after fine-tuning, the checkpoint directory does not have checkpoint for CLIP-VIT, and the build_mlp.py is rewritten as
`vision_tower = 'openai/clip-vit-large-patch14-336'`
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.