autogluon / autogluon/autogluon

Cross Validation and custom pipeline in Autogluon.

Open
#999 4 comments 0 reactions 0 assignees View on GitHub
enhancement feature request module: tabular
Dominant language
Python
Stars
10.7k
Forks
1.2k
Avg merge
21h 29m
Merged PRs (30d)
57

Description

Hello,
I have a problem with data leakage and wanted to avoid it so I created a custom pipeline to cleanse the data before train/validation. However, when the cross validation is performed across the train dataset, splitting it into train and val in each fold, does the pair go through the _fit_transform within the pipeline? Is there any extra configuration that I'll have to enable first?

Contributor guide

Open the contributing guide

Research direction

Start by tracing AutoGluon's custom pipeline and cross-validation entry points, focusing on how _fit_transform is invoked for each train/validation fold. Check the relevant pipeline and validation documentation or tests, then establish whether transformations are fit only on each training split and whether any configuration is required; done means the behavior and configuration are clearly documented or reproduced.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.