alibaba / alibaba/AliceMind

visual grounding finetune咨询

Open
#65 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2k
Forks
301
PR merge metrics
No merged PRs in 30d

Description

hello
我有在finetune 模型时,发现模型存在_IncompatibleKeys(主要是fusion_encoder的所有层), 这个是对训练否有影响。 我按照操作流程进行训练,在epoch=10自动停止,并第十轮结果如下:
{'train_lr1': 1.9676295349747303e-05, 'train_lr2': 4.931851652578033e-06, 'train_loss_seq': 0.08181070101696078, 'miou': 0.6400532953981678, 'accu': 0.7921358685619346, 'epoch': 10}

这个结果与论文的accu值存在差距,两个数值是否一致啊?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the documented visual grounding finetuning workflow and inspect the reported IncompatibleKeys for the fusion_encoder layers. Compare the epoch 10 accu and miou values with the paper's metric definitions and determine whether the missing keys affect training. Done means clarifying both the checkpoint warning and whether the reported accu values are comparable.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.