autogluon / autogluon/tabarena

Interest check: HPO-tunable preprocessing as a first-class concept in TabArena?

Open
#509 4 comments 0 reactions 1 assignee Claimed by @LennartPurucker View on GitHub
TabArena-v0.X
Dominant language
Python
Stars
303
Forks
69
Avg merge
1d 4h
Merged PRs (30d)
49

Description

Quick question, not a proposal yet.

RamanBench (built on `tabarena`/`bencheval`, see #495/#506) tunes its domain-specific preprocessing (baseline correction, denoising, etc.) jointly with each model's own hyperparameters, via a mixin that adds `prep_*` params to the model's search space, so HPO can pick a preprocessing recipe per model per fold rather than applying one fixed pipeline upfront.

TabArena's own preprocessing (`TabArenaModelAgnosticPreprocessing`/`TabArenaModelSpecificPreprocessing`) runs once via the feature-generator path, outside HPO.

Would a general concept of HPO-tunable preprocessing (as part of a model's search space, not a fixed pre-pass) be of interest for TabArena itself, beyond domain-specific downstream benchmarks? Just gauging interest before writing anything up.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.