Self attention in mask decoder

Hi,
If I understand correctly, you're providing the mask prompt as a dense embedding and then adding it to the image embeddings.
When feeding this combined input into the transformer in the mask decoder, did you perform self-attention on the [image embedding + mask dense embedding]?
Thanks.