alteryx / alteryx/evalml

Add model selection split for automl search

Abierto
#2,284 0 comentarios 0 reacciones 1 asignado Reclamado por @asniyaz Ver en GitHub
needs design new feature spike
Lenguaje dominante
Python
Estrellas
850
Forks
96
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

Rather than relying on the CV scores to rank the pipelines on the leaderboard, perhaps we should have a model selection split where we hold out some data and rank the pipelines depending on how well it performs on this holdout data.

I vaguely remember @dsherry mentioning that there was discussion about this with @kmax12, and @freddyaboulton mentioned a good point in #2260, so I figured it'd be a good thing to track.

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.