NVIDIA / NVIDIA/DALI

Variable length video ?

Open
#2,464 16 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement question Video
Dominant language
C++
Stars
5.8k
Forks
678
Avg merge
3d 1h
Merged PRs (30d)
27

Description

From what I can gather, loading variable length videos is not supported. Is this correct? If so, is there any way to work around this? For instance, is there a way to randomly sample N frames from every video so that the variable length is implicity dealt with and we produce consistent batches of N frames? I have done this in the pytorch dataloader for multiple projects.

I would really like to use DALI since data loading is clearly the bottleneck for me at the moment, but I work almost exclusively with datasets featuring variable length video.

Thanks a lot.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. First inspect DALI's existing video-loading and batching documentation and APIs, then determine whether variable-length inputs are supported. Done should mean that support or a documented workaround for consistent frame sampling is clearly defined and covered by appropriate tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
data, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.