tensorflow / tensorflow/recommenders

Interpretation of scores and how to find the scores confidence level?

Open
#658 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2k
Forks
300
PR merge metrics
No merged PRs in 30d

Description

Hello there,
1- I am wondering if the user-item scores (ie query-candidate scores) outputted by model prediction are interaction-probability or affinity scores?
2- Is it possible to compare the scores across users? for example, let's assume the triplet of (userID, itemID, score) for a user is (u_i, I_j, s_ij) and for another user is (u_ii, I_jj, s_iijj) such that u_i <> u_ii and I_j <> I_jj and s_ij > s_iijj. Can we conclude that the u_i likes I_j more than u_ii likes I_jj?
3- What is the best and most computationally efficient way of calculating how much confidence there is for each user_item interaction? In another word, I am looking for this quadruplet (u_i, I_j, s_ij, cs_ij) such that the s_ij is the score associated with the user i interaction with item j and cs_ij is the confidence score associated with the original score s_ij and demonstrate how much confidence there is in the predicted scores?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue does not name a file, test, or entry point. Start by locating the prediction API and its score documentation, then clarify score semantics, cross-user comparison, and confidence estimation; done means documenting answers and a supported approach.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.