facebookresearch / facebookresearch/sam2

Questions about evaluation dataset

Open
#400 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
19.9k
Forks
2.5k
PR merge metrics
No merged PRs in 30d

Description

Thank you for the great work! While attempting to reproduce the evaluation results, I noticed some inconsistency in the video samples (Table 16) between the datasets LVOSv2 and VOST and the ones used in the paper. Specifically, the LVOSv2 validation set originally contains 140 videos, but only 136 are sampled in the evaluation. Similarly, the VOST dataset originally had 70 videos, but the evaluation uses 636. Due to these inconsistencies, I am unable to reproduce the evaluation results. Could you provide clarification on this difference? Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.