dmlc / dmlc/xgboost

why there is such big difference between total gain and total loss change

Open
#9,196 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
28.8k
Forks
8.9k
Avg merge
1d 12h
Merged PRs (30d)
54

Description

I have trained a model using subsample = 1, use get_score(importance_type=='total_gain') to get total gain for each feature and then sum them up. Then I calculate the difference between initial total loss and final total loss with square loss function. But I find that the sum of total gain is much larger than the total loss change.
From my understanding, when I split a node into two part, the gain equals how much the loss decrease.
How should I interpret this difference and why this happen ?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.