aai-institute / aai-institute/pyDVL

Hard-code ranges for known scorers if requested by name

Open
#272 1 comment 0 reactions 0 assignees View on GitHub
enhancement good first issue
Dominant language
Python
Stars
146
Forks
10
PR merge metrics
No merged PRs in 30d

Description

when instantiating the Scorer class, the user has the option of passing in a range of values.

Since most of the time the users will use well known and well defined scorers we should be able to auto-fill
its range from a dictionary of known scorers.

We can get the names of the scikit-learn's scorers from [here](https://github.com/scikit-learn/scikit-learn/blob/8c9c1f27b/sklearn/metrics/_scorer.py#L842).

Contributor guide

Open the contributing guide

Research direction

Look at the Scorer class in the codebase to understand how ranges are currently passed. The issue references a specific line in scikit-learn's _scorer.py for known scorer names. Start by examining how scorers are instantiated and where a dictionary mapping scorer names to their ranges could be added. Check existing tests for the Scorer class to see how to validate the new feature.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, scikit-learn
Domain
machine-learning, tooling
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.