DSML-Research-Group / DSML-Research-Group/public-projects

[PROJECT IDEA]Ensembling Different Window Lengths As a Form of Time Series Regularization

Open
#2 0 comments 0 reactions 0 assignees View on GitHub
analytical In Progress open source software pandas time series
Dominant language
No language data
Stars
1
Forks
0
PR merge metrics
No merged PRs in 30d

Description

### Main Project Goal
The main idea behind this project is to test an analytical thesis: for time series problems the window length that you use for training data is often the most important variable in your results, and I suspect it's true that combining different window lengths for a final predictive output is a very powerful form of model improvement, with an affect that's akin to regularization, but better suited for the time series domain.

### Why This Project is Interesting
If this idea is true, then it would undercover an important methodological improvement in time series analysis, that's both easy to implement and verify. Enduring improvements in technique are often some of the most important academic work, something like this would have immediate impact on how lots of practitioners do their work. This project also has both an empirical component and a software one, because its technique could easily be put into modeling pipelines for different ML libraries.

### Brief Description of Work Involved
- Collect different varieties of time series datasets: electricity, tourism, m3, m4, airline, etc
- Write training scripts that run a wide variety of models testing performance on the different datasets combining the different window sizes
- Probably spend a lot of time sifting through the results to try and find interesting relationships: is the effect robust? how large? does it work particularly well for some models than others? etc
- Find a good way to communicate the results: arxiv, medium, towards data science, etc
- Potentially deploy it as a pipeline technique to use in ML libraries, so others can make use of it

### First Steps
- Collect some of the common datasets to use for the project
- Would be useful to toy around with smaller examples in notebooks to make sure we understand the right approach
- Begin writing training scripts to train a lot of different models simultaneously and get the results

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named. Start with small notebook experiments using the proposed time-series datasets, then define reproducible training scripts for comparing window lengths and combined predictions. Completion criteria still need to be agreed for datasets, models, evaluation, and how results will be communicated.

Written by the indexing model from the issue text.

Assessment

Domain
data, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.