NVIDIA-Merlin / NVIDIA-Merlin/Merlin

[QST] 2-stage ensemble throwing 'extra columns' error

Open
#862 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

question
Dominant language
Python
Stars
907
Forks
129
PR merge metrics
No merged PRs in 30d

Description

❓ Questions & Help

Details

I am trying to simply create a 2-stage ensemble using System and TIS.
I first used NV Tabular to transform my data and trained a DLRM on it and tried to serve workflow + ranking ensemble using TIS, but it was giving me an error saying there are two extra columns (userID and itemID) and won't allow me to do inference, what have I done wrong ?

The transform workflow is defined as in the image. I did not 'categorify' user_id and item_id, because those were tokenized beforehand and I just want to use the original tokens as features and avoid an extra mapping step in the end (as long as I understand right, the categorify is not equal to 'tokenize', instead it is doing some kind of 'binning' operation on the features, right?)
image
the schema looks like this:
image
Model info looks like this:
image

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the attached transform workflow, schema, and model information, then trace how the 2-stage ensemble passes columns from NV Tabular through DLRM and TIS. Determine why userID and itemID are treated as extra during inference and document the configuration or input-schema change needed for the workflow to run.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.