alteryx / alteryx/evalml

Smarter values of top_n for One Hot Encoder in AutoML

Offen
#1,893 1 Kommentar 0 Reaktionen 1 zugewiesene Person Beansprucht von @asniyaz Auf GitHub ansehen
enhancement needs design
Vorherrschende Sprache
Python
Sterne
850
Forks
96
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

Currently, `AutoMLSearch` will only fit `OneHotEncoder`s with `top_n` [set to 10](https://github.com/alteryx/evalml/blob/main/evalml/pipelines/components/transformers/encoders/onehot_encoder.py#L25).

This can be problematic because a user can have data with more than 10 categories, e.g. 50 US states, and the 40 least frequent states in the data get lumped together.

We currently have two workarounds for this:

1. Pass in a `pipeline_parameters` argument to `AutoML` where the value of `top_n` is set by the user. This may not be the best because this value of `top_n` would be applied for all categorical features.
2. User can create a DAG with multiple OHE (one for each categorical feature) where `top_n` varies for each OHE.

Ideally, `AutoMLSearch` would set a smart value of `top_n` for each categorical feature automatically that the user could then change depending on their domain knowledge.

This is closely related to #1728 but I feel it's a separate as it relates specifically to `top_n` in the OHE.

Maybe it makes sense to mark this as blocked by #1728.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.