allenai / allenai/close

vqa_score divided by 3

Open
#5 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
58
Forks
5
PR merge metrics
No merged PRs in 30d

Description

Hello, thank you for the interesting work. Though I have a question about the vqa score calculation. When I run the eval.py to calculate the evaluation scores for vqa, I find the min(normlized_answers.get(vqa_preprocess(answer), 0) / 3, 1) is used to calculate the score (accuracy?). However, I am confused by the **/3** here. Can you explain this to me thanks!
`def vqa_score(answer, ground_truth_answer_counts)` in evaluator.py

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.