google-deepmind / google-deepmind/magiclens

Why is the Attention Mask not used?

Open
#16 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
211
Forks
15
PR merge metrics
No merged PRs in 30d

Description

Hello,

I would like to know why you don't use the mask in self-attention? You feed the magiclens input with an image and empty text, but you don't use the attention mask.

I'd be glad to receive your response!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.