Smarter values of top_n for One Hot Encoder in AutoML
- Lingua principale
- Python
- Stelle
- 850
- Fork
- 96
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
Currently, `AutoMLSearch` will only fit `OneHotEncoder`s with `top_n` [set to 10](https://github.com/alteryx/evalml/blob/main/evalml/pipelines/components/transformers/encoders/onehot_encoder.py#L25).
This can be problematic because a user can have data with more than 10 categories, e.g. 50 US states, and the 40 least frequent states in the data get lumped together.
We currently have two workarounds for this:
1. Pass in a `pipeline_parameters` argument to `AutoML` where the value of `top_n` is set by the user. This may not be the best because this value of `top_n` would be applied for all categorical features.
2. User can create a DAG with multiple OHE (one for each categorical feature) where `top_n` varies for each OHE.
Ideally, `AutoMLSearch` would set a smart value of `top_n` for each categorical feature automatically that the user could then change depending on their domain knowledge.
This is closely related to #1728 but I feel it's a separate as it relates specifically to `top_n` in the OHE.
Maybe it makes sense to mark this as blocked by #1728.
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.