autogluon / autogluon/autogluon

[Tabular] Add cross-validation support out of the box

Open
#3,016 1 comment 6 reactions 1 assignee Claimed by @Innixma View on GitHub
enhancement module: tabular priority: 0
Dominant language
Python
Stars
10.7k
Forks
1.2k
Avg merge
21h 29m
Merged PRs (30d)
57

Description

It would be useful to allow the user to run true cross-validation out of the box in TabularPredictor.

True cross-validation would ensure that the validation data is never used for any early stopping or ensembling logic, to avoid any kind of overfitting.

This could be implemented in several ways.

Most elegantly, we could implemented nested bagging, with models using the inner bag validation data for early stopping and ensembling, and never using the outer bag validation folds.

Nested bagging should also help improve ensembling performance on small datasets by avoiding overfitting.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.