AlibabaResearch / AlibabaResearch/AdvancedLiterateMachinery

Where do I load pre-trained DiT and GiT in the VGT code?

Open
#89 5 comments 1 reaction 0 assignees View on GitHub
Dominant language
C++
Stars
1.8k
Forks
195
PR merge metrics
No merged PRs in 30d

Description

I downloaded 2 weights for finetining VGT.

- [VGT-pretrain-model](https://github.com/AlibabaResearch/AdvancedLiterateMachinery/releases/download/v1.3.0-VGT-release/VGT_pretrain_model.pth) : it looks for pre-trained GiT
- [dit_base_patch16_224](https://github.com/microsoft/unilm/tree/master/dit) : it looks for ViT(DiT)

When finetuning VGT, Where should I specify the pre-trained ViT and DiT weight file paths?
If possible, please specify which file the 2 weight paths are loaded from.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.