google-research / google-research/google-research

Question: How Effectively Does TFT Deal with Nonstationarity?

Open
#459 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
38.8k
Forks
8.5k
PR merge metrics
No merged PRs in 30d

Description

After reading through your paper and applying TFT to model COVID-19 trends across US states, I am still unclear about how effectively TFT deals with nonstationarity. My trained model appears to be doing as well as can be expected, given how aberrant the pandemic trends have been in the US; however, I'm wondering if TFT necessitates stationarity transformations in this case or if the sequential attention is able to learn to deal with this on its own fairly effectively (given that obviously the more feature engineering that is done can help improve model performance but then again part of the appeal of TFT is that one can avoid much of that work through the model).

Thanks for your thoughts. Much appreciated!

Contributor guide

Open the contributing guide

Research direction

No repository file, test, or entry point is named. Start with the referenced TFT paper and the model's treatment of nonstationarity; a useful resolution would explain whether stationarity transformations are required or whether sequential attention handles the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
machine-learning
Domain
machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.