DAMO-NLP-SG / DAMO-NLP-SG/VideoLLaMA3
nextqa eval
- Dominant language
- Jupyter Notebook
- Stars
- 1.2k
- Forks
- 89
- PR merge metrics
- No merged PRs in 30d
Description
Traceback (most recent call last):
File "/data/home/test_yanjunchi/wangshaobo/LLaMA-Factory/model/VideoLLaMA3/evaluation/evaluate.py", line 115, in main
prediction = dataset.process_response(data_id, response)
File "/data/home/test_yanjunchi/wangshaobo/LLaMA-Factory/model/VideoLLaMA3/./evaluation/benchmarks/nextqa.py", line 97, in process_response
if opt.lower() in output.lower():
NameError: name 'output' is not defined
Error in data_id: 92
Can you fix this problem？
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with evaluation/benchmarks/nextqa.py around line 97 and trace the call from evaluation/evaluate.py line 115. Reproduce the NextQA evaluation, including data_id 92, and verify that processing completes without the reported NameError.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 1/5
- Estimated time
- Under an hour
- Activity status
- Stale
- Clarity
- Clearly specified
- Newbie friendliness
- 45/100