DAMO-NLP-SG / DAMO-NLP-SG/VideoLLaMA3

evaluate the 7b model on charades-sta benchmark

Open
#67 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1.2k
Forks
89
PR merge metrics
No merged PRs in 30d

Description

hello, when i evaluate this 7b model on charades-sta benchmark, I see [charades_annotations_test-random_prompt.json in evaluation](https://github.com/DAMO-NLP-SG/VideoLLaMA3/blob/6c10bf2e28ef0d37ad22ea6ee899370ca7881d08/evaluation/benchmarks/charades_sta.py#L21), but I cannot find this file in google search, I just find dataset like [charades-sta url](https://opendatalab.com/OpenDataLab/Charades-STA) with only ground-truth, but no prompt, could please give a file download url for "charades_annotations_test-random_prompt.json", especially when the prompt is random. Thanks

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.