dotnet / dotnet/machinelearning-modelbuilder
Poor peerformance of TimeSeriesCatalog.ForecastBySsa Method
- Lenguaje dominante
- Dockerfile
- Estrellas
- 285
- Forks
- 66
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
**System Information:**
Windows 11
Microsoft Visual Studio Professional 2022 (64-bit) - Current
Version 17.3.5
**Describe the bug**
I am very disappointed in the Time Series Model Builder project. I have the following comments:
1. There are 144 rows in my data file (VERU_9_26_2022_144.csv). The code that was generated by Model Builder set the value of “seriesLength” to 2118. The documentation states that “seriesLength” is “The length of series that is kept in buffer for modeling (parameter N)”. What the hell does that mean? The value of 2118 does not make sense. Please explain.
2. The code that was generated by Model Builder set “windowSize” to 50. I assume that “windowSize” and “seriesLength” ae hyperparameters. Is that true? If so, it would sure be nice if you guys would share that code that generated the values.
3. Model Builder gives the option to plot the error curve. That is necessary, but not sufficient. A plot of the predicted values is what researchers want to see. A table is not good enough. If you plot the predicted values generated by Model Builder you will see how bad the predictions are. Here is the plot of the predictions. The red dots are the predicted values:

No cigar!
Either there is a serious bug in Model Builder, or the SsaForecast algorithm is worthless.
I give this project a grade of D-.
I have put the reproducible source code on GitHub so you can see the data file and code.
[CBrauer/Poor-Performance-of-ModelBuilder (github.com)](https://github.com/CBrauer/Poor-Performance-of-ModelBuilder)
Charles Brauer
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Línea de trabajo
Comienza con el código fuente reproducible enlazado en el issue y la llamada generada a TimeSeriesCatalog.ForecastBySsa; después, compara los parámetros documentados seriesLength y windowSize con la entrada CSV de 144 filas. No se indica ningún archivo del repositorio ni ninguna prueba; para darlo por terminado habría que determinar si la configuración generada o las predicciones de SSA son defectuosas, y documentar o corregir el comportamiento demostrado.
Escrito por el modelo de indexación a partir del texto del issue.
Evaluación
- Stack tecnológico
- machine-learning
- Área
- machine-learning
- Tipo de issue
- Error
- Dificultad
- 5/5
- Tiempo estimado
- Más de una semana
- Estado de actividad
- Estancado
- Claridad
- Necesita aclaración
- Aptitud para principiantes
- 20/100