EducationalTestingService / EducationalTestingService/rsmtool
Provide descriptives for all features, not just those in the final model
- Lenguaje dominante
- Python
- Estrellas
- 71
- Forks
- 21
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
Aoife: In a few cases features of interest didn't make it into the final NNLS model. Unfortunately that also meant that they were excluded from all analyses including feature descriptions. We were able to get feature descriptions by rerunning with Linear Regression, but would it be possible to include feature descriptives and inter-feature correlations for all features listed in the features file, not just the ones that make it into the final model?
Jeremy: We can address this in the refactored version of RSMTool.
The feature descriptives and inter-feature correlations get calculated by the run_training_analyses() method in the Analyzer class. Currently, this method subsets the data using a selected_features parameter, but we could use something like {{all_features }}instead.
I'm assuming we would want to give users the option to include all features (whether or not they drop out of the model) or selected features in the analysis, correct? If so, we'll have to add a new configuration parameter to that effect.
Aoife: Making it an option sounds reasonable to me
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Línea de trabajo
Comienza con el método Analyzer.run_training_analyses() e inspecciona cómo selected_features controla los descriptivos de las features y las correlaciones entre features. Define el parámetro de configuración tratado en el issue y verifica que los usuarios puedan elegir entre todas las features del archivo de features y únicamente las features seleccionadas, y que ambos análisis reflejen esa elección.
Escrito por el modelo de indexación a partir del texto del issue.
Evaluación
- Stack tecnológico
- python
- Área
- machine-learning
- Tipo de issue
- Nueva funcionalidad
- Dificultad
- 4/5
- Tiempo estimado
- 3-5 días
- Estado de actividad
- Estancado
- Claridad
- Bastante claro
- Aptitud para principiantes
- 42/100