lenskit / lenskit/lkpy

Add reranking behavior metric functions

Open
#778 0 comments 0 reactions 2 assignees View on GitHub

@sushobhan2024 is already working on this.

Since May 30, 2025.

evaluation
Dominant language
Python
Stars
314
Forks
77
Avg merge
4d 6m
Merged PRs (30d)
10

Description

To support measuring the behavior of reranking components, it would be useful to add functions that will compute Rank Biased Overlap and Least Item Promoted given two lists (a base ranking and reranked outputs).

For the initial task (this issue), these should just be functions that take two ItemLists along with other parameters (i.e., the weighting model), and return the score.

When working on #766, we can work on an interface to incorporate these kinds of metrics into an analysis. Getting the code into LensKit as functions without integration into an analysis or evaluation loop will allow the code to at least be reused in prototype experiments while we work on the harder interface design problem.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.