EducationalTestingService / EducationalTestingService/rsmtool

Provide descriptives for all features, not just those in the final model

Abierto
#336 0 comentarios 0 reacciones 0 asignados Ver en GitHub
enhancement
Lenguaje dominante
Python
Estrellas
71
Forks
21
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

Aoife: In a few cases features of interest didn't make it into the final NNLS model. Unfortunately that also meant that they were excluded from all analyses including  feature descriptions. We were able to get feature descriptions by rerunning with Linear Regression, but would it be possible to include feature descriptives and inter-feature correlations for all features listed in the features file, not just the ones that make it into the final model? 

Jeremy: We can address this in the refactored version of RSMTool.

The feature descriptives and inter-feature correlations get calculated by the run_training_analyses() method in the Analyzer class. Currently, this method subsets the data using a selected_features parameter, but we could use something like {{all_features }}instead.

I'm assuming we would want to give users the option to include all features (whether or not they drop out of the model) or selected features in the analysis, correct? If so, we'll have to add a new configuration parameter to that effect.

Aoife: Making it an option sounds reasonable to me

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Línea de trabajo

Comienza con el método Analyzer.run_training_analyses() e inspecciona cómo selected_features controla los descriptivos de las features y las correlaciones entre features. Define el parámetro de configuración tratado en el issue y verifica que los usuarios puedan elegir entre todas las features del archivo de features y únicamente las features seleccionadas, y que ambos análisis reflejen esa elección.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
python
Área
machine-learning
Tipo de issue
Nueva funcionalidad
Dificultad
4/5
Tiempo estimado
3-5 días
Estado de actividad
Estancado
Claridad
Bastante claro
Aptitud para principiantes
42/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.