tidymodels / tidymodels/probably
Use average of predicted probabilities instead of bin midpoint
Nobody has claimed this yet.
- Dominant language
- R
- Stars
- 123
- Forks
- 16
- PR merge metrics
- No merged PRs in 30d
Description
Feature
This package looks extremely useful. Pretty plots, and very useful with the rugs and the options for windowing!
One suggestion: Currently the value on the x-axis is the bin midpoint. I would suggest to instead use the average of the predicted probabilities included in that bin: this will be the expected value of the event rate.
(For instance, if a bin only has predicted probabilities near the lower edge of the bin range, then we would also expect an event rate near that lower edge. Using the average predicted probability will sort this out)
This will mostly matter when using few bins.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No file or test is named. Start by locating the plotting and binning entry points for predicted probabilities, then trace where the bin midpoint becomes the x-axis value. Done means the x-axis uses the average predicted probability within each bin, including the few-bin case described in the issue, with relevant tests updated or added.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- r
- Domain
- data-visualization, machine-learning
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100