[Question]: Multi tower model?

Hi @maciejkula

I have a simple model currently which essentially matches query to documents, my training data looks like this:

[
  {'q': 'is AI taking over?', 'doc': 'AI is a very ....'},
  ...
]

What I would like to do is incorporate other features by which I could query. For example for a document I also may have features such as topic or entities.

I would like to train my model in such a way that these other features are also placed into the same embedding space, so that I can query into my docs not by way of free text but the topics for example.

One thing to mention is that I am using a BERT based language model on both the query and candidate tower.

Thanks in advance!

EDIT: do you think this is a good way to use TFRS?