TIGER-AI-Lab / TIGER-AI-Lab/VideoScore2
The three scores for the same prompt in the same video are very unstable.
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 58
- Forks
- 4
- Avg merge
- 1m
- Merged PRs (30d)
- 1
Description
Video Path: /videos/badcase_14_1.mp4
Visual Quality: 4.0
Text-to-Video Alignment: 4.0
Physical Consistency: 4.0
Video Path: /videos/badcase_14_1.mp4
Visual Quality: 3.0
Text-to-Video Alignment: 4.0
Physical Consistency: 1.0
Video Path:/videos/badcase_14_1.mp4
Visual Quality: 3.0
Text-to-Video Alignment: 4.0
Physical Consistency: 2.9771
I used the same prompt for the same video and evaluated it using the instructions from GitHub. Each time, I got completely different results.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the evaluation described for /videos/badcase_14_1.mp4 with the same prompt and the repository's GitHub instructions. Compare repeated outputs and trace the evaluation entry point to identify the source of score variation. Done means the instability is fixed or its cause and reproducible behavior are documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100