DAMO-NLP-SG / DAMO-NLP-SG/Video-LLaMA

Evaluation on large-scale dataset

Open
#151 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
3.1k
Forks
286
PR merge metrics
No merged PRs in 30d

Description

Hello,
Thank you for your amazing work. The demo runs fine for a single video.

I'm curious if there are any provisions for generating inference on a larger dataset of videos, each accompanied by corresponding text questions. Additionally, I'm interested to know if there's an API available for this purpose.

Looking forward to your insights on this matter.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue does not identify a file, test, entry point, or existing batch-inference interface to inspect. Clarify the intended dataset format, API behavior, and evaluation criteria before implementation can be scoped.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.