intuit / intuit/metriks

Recall and Precision at K Examples

Open
#11 1 comment 0 reactions 0 assignees View on GitHub
gracehopperOSD
Dominant language
Python
Stars
25
Forks
25
PR merge metrics
No merged PRs in 30d

Description

Create a usage example on how these ranking metrics can be used:

```+------------------------------------------------------------+-------------------------------------------------------------------------------+
| Python API | Description |
+============================================================+===============================================================================+
| `metriks.recall_at_k(y_true, y_prob, k)` | Calculates recall at k for binary classification ranking problems. |
+------------------------------------------------------------+-------------------------------------------------------------------------------+
| `metriks.precision_at_k(y_true, y_prob, k)` | Calculates precision at k for binary classification ranking problems. |
+------------------------------------------------------------+-------------------------------------------------------------------------------+
```

1. Identify a dataset that can be used to train a ranking model
2. Train a ranking model with the data
3. Use the given metrics above and show results and demonstrate how these metrics can be used

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the Python API entries for metriks.recall_at_k(y_true, y_prob, k) and metriks.precision_at_k(y_true, y_prob, k), then identify a suitable ranking dataset and model. Done means a usage example documents the dataset, training process, metric calls, and resulting values.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.