DAMO-NLP-SG / DAMO-NLP-SG/VideoLLaMA2

RuntimeError: Error reading datasets/videollava_pt/valley/023651_023700/1014646391.mp4

Open
#150 0 comments 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.3k
Forks
90
PR merge metrics
No merged PRs in 30d

Description

Hello, I encountered an issue during the pretraining phase where the video could not be read. After checking, it turns out that the video path in the JSON file is pointing to a video that is not actually stored.

![Image](https://github.com/user-attachments/assets/8f443042-9d60-45bb-89b2-1bc574250918)

I downloaded the valley dataset for the pretraining phase **strictly** according to the path from Google Drive mentioned in your README, but this issue has occurred many times (about 1 in 20 videos are missing). Have you encountered this issue during your training? Thank you very much!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the Valley dataset download path in the README and compare it with the video paths referenced by the pretraining JSON files, including the missing MP4 path shown here. Check whether the reported files are absent from the downloaded dataset and document the expected resolution; the issue is done when the dataset references and available files agree or the project explains how missing videos should be handled.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.