alteryx / alteryx/evalml

Add label leakage check after training models in AutoML

Abierto
#928 1 comentario 0 reacciones 1 asignado Reclamado por @asniyaz Ver en GitHub
new feature
Lenguaje dominante
Python
Estrellas
850
Forks
96
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

Per @kmax12's comment in #917, we could do a label leakage check after training a model, checking if it scored very highly but only has a single feature with all the importance. This could indicate that the feature that scored highly is correlated to the target.

This would need a little more design: currently, we only perform any data checks before searching. How should we support data checks (or only some data checks) running after a batch / iteration?

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.