NVIDIA-Merlin / NVIDIA-Merlin/Transformers4Rec

[QST] Help with creating two tower model with transformers.

Open
#763 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

status/needs-triage
Dominant language
Python
Stars
1.3k
Forks
165
Avg merge
1m
Merged PRs (30d)
2

Description

❓ Questions & Help

Details

I have two separate sequences and want to create two towers and then concat the output layers of two transformer towers. Can you please help me with this implementation? Is it possible to do it with transformer4rec? Im am not sure how to contact the output layers of the two towers @gabrielspmoreira @rnyak @oliverholworthy @benfred

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. Start by reviewing the existing Transformer4Rec implementation and determining whether two separate sequences and two transformer towers are supported; done would be a confirmed approach or a clearly documented limitation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.