facebookresearch / facebookresearch/dlrm

DRLM model for ranking

Open
#402 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4.1k
Forks
859
PR merge metrics
No merged PRs in 30d

Description

Hi,

I wanted to check if the DLRM model can be used for ranking instead of classification. I’ve updated the loss function accordingly, but the model doesn’t seem to be performing any better. I’m evaluating performance using NDCG@5, which is around 0. In contrast, XGBoost performs significantly better on the same data.

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named in the issue. Start by tracing DLRM's training and evaluation flow to verify how the updated ranking loss is connected, then reproduce NDCG@5 on the same data used by XGBoost. Done means determining whether ranking is supported and identifying the cause of the near-zero metric.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.