google-research / google-research/google-research
Question: How Effectively Does TFT Deal with Nonstationarity?
- Dominant language
- Jupyter Notebook
- Stars
- 38.8k
- Forks
- 8.5k
- PR merge metrics
- No merged PRs in 30d
Description
After reading through your paper and applying TFT to model COVID-19 trends across US states, I am still unclear about how effectively TFT deals with nonstationarity. My trained model appears to be doing as well as can be expected, given how aberrant the pandemic trends have been in the US; however, I'm wondering if TFT necessitates stationarity transformations in this case or if the sequential attention is able to learn to deal with this on its own fairly effectively (given that obviously the more feature engineering that is done can help improve model performance but then again part of the appeal of TFT is that one can avoid much of that work through the model).
Thanks for your thoughts. Much appreciated!
Contributor guide
Research direction
No repository file, test, or entry point is named. Start with the referenced TFT paper and the model's treatment of nonstationarity; a useful resolution would explain whether stationarity transformations are required or whether sequential attention handles the issue.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- machine-learning
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100