facebookresearch / facebookresearch/ImageBind

The norm of the audio embedding is not 1

Open
#141 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
9.1k
Forks
842
PR merge metrics
No merged PRs in 30d

Description

I am computing embeddings for a video and an audio clip, and I calculated their inner product to be 1. Just when I thought everything was going smoothly, I discovered that the cosine similarity between their embeddings was only 0.2391. It turned out that the norm of the audio embedding was not 1, meaning that despite the inner product being 1, their actual similarity was quite low.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.