dotnet / dotnet/machinelearning

Binary ensemble score and prediction column relationship

Open
#2,070 1 comment 0 reactions 0 assignees View on GitHub
area-Trainers bug Priority:2
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

So let's say I'm using WeightedAverage ensemble of two binary classification learners.
Each learner will produce Score and Probability column.

Since it's a weightedAvaerage we will learn weights for each learner let's say A and B.
Resulted Score value would be (A*ScoreA + B*ScoreB)/2.
For probability column we just take median so Resulted probability = (ProbA+ProbB)/2.
I'm not quite sure why we decide to calculate probability this way for all binary Ensembles (no matter is it average, min, max).

In all other binary learners Probability and score is related to each other via calibrator. So there is a function of score which produce probability, in case of ensemble it's not and I find it bit confusing.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.