tidymodels / tidymodels/yardstick
`classification_cost()` using predicted events
Open
Nobody has claimed this yet.
feature
- Dominant language
- R
- Stars
- 402
- Forks
- 63
- Avg merge
- 33m
- Merged PRs (30d)
- 1
Description
classification_cost() takes probabilities and computes cost from them. Since we are going to be doing more with setting thresholds, we should probably have a version that takes the hard class predictions and has class "class_metric". Right now, threshold_perf() only takes those types of metrics.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the existing classification_cost() and threshold_perf() entry points to understand their input types and class_metric handling. Determine the intended hard-prediction API and behavior, then verify that the new metric works with threshold_perf() and preserves the expected classification cost semantics.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- r
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 39/100