huggingface / huggingface/datasets

Add option for loading audio with video

Open
#8,007 7 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
22k
Forks
3.4k
Avg merge
5d 7h
Merged PRs (30d)
17

Description

### Describe the bug

Currently, `torchcodec` don't allow extracting `Audio` from `Video` https://github.com/meta-pytorch/torchcodec/issues/1158, but when I upload videos with audio to hub using `videofolder`, then this is not possible to retrieve audio from it. Probably `VideoDecoder` can be extended with `audio` parameter to retrieve this information

### Steps to reproduce the bug

```python
from datasets import load_dataset

test_ds = load_dataset("videofolder", data_dir="/path/to/video")
# uploaded version
# test_ds = load_dataset("Samoed/testds")

test_ds["train"][1]["video"]
#

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.