facebookresearch / facebookresearch/ImageBind

Splitting VISION into text and video

Open
#81 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
9.1k
Forks
842
PR merge metrics
No merged PRs in 30d

Description

Hi,

I have worked out using the different data loaders to compare images and video but cannot work out a way to do both simultaneously. It seems using ModalityType.VISION, you can only load and transform either video or still image at one time and not both (from my limited understanding). I think it would be a good idea to split VISION into two types of modality for ease of use. Anyone able to point me to a way to do this?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.