AlibabaResearch / AlibabaResearch/AdvancedLiterateMachinery

VGT evaluation result not matching for DoclayNet.

未关闭
#188 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
C++
星标
1.8k
派生
195
PR 合并指标
30 天内没有已合并 PR

描述

Hi,

Thank you for creating and sharing the Vision Grid Transformer repository.

I am currently trying to evaluate the model on the DocLayNet test dataset in order to replicate the published results (mAP of 83.7). I am using the weights available here: [doclaynet_VGT_model.pth](https://github.com/AlibabaResearch/AdvancedLiterateMachinery/releases/download/v1.3.0-VGT-release/doclaynet_VGT_model.pth).

I executed the evaluation using the following command:

bash
Copy code
python path/to/train_VGT.py --config-file VGT/object_detection/Configs/cascade/doclaynet_VGT_cascade_PTM.yaml --eval-only --num-gpus 1 MODEL.WEIGHTS VGT/downloads/weights/doclaynet_VGT_model.pth OUTPUT_DIR VGT/AdvancedLiterateMachinery/DocumentUnderstanding/VGT/downloads
However, the results I obtained differ from the published ones. Please see the attached matrix for reference:

![image](https://github.com/user-attachments/assets/9b6a9443-62b2-441f-83f8-d3fb6be02a51)

Could you please advise if I might be overlooking something in the evaluation process?

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。