aai-institute / aai-institute/pyDVL
Hard-code ranges for known scorers if requested by name
- Dominant language
- Python
- Stars
- 146
- Forks
- 10
- PR merge metrics
- No merged PRs in 30d
Description
when instantiating the Scorer class, the user has the option of passing in a range of values.
Since most of the time the users will use well known and well defined scorers we should be able to auto-fill
its range from a dictionary of known scorers.
We can get the names of the scikit-learn's scorers from [here](https://github.com/scikit-learn/scikit-learn/blob/8c9c1f27b/sklearn/metrics/_scorer.py#L842).
Contributor guide
Research direction
Look at the Scorer class in the codebase to understand how ranges are currently passed. The issue references a specific line in scikit-learn's _scorer.py for known scorer names. Start by examining how scorers are instantiated and where a dictionary mapping scorer names to their ranges could be added. Check existing tests for the Scorer class to see how to validate the new feature.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, scikit-learn
- Domain
- machine-learning, tooling
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100