Fix first graph to show accuracy at time x rather than average accuracy over time x+t
Open
- Dominant language
- JavaScript
- Stars
- 4
- Forks
- 1
- PR merge metrics
- No merged PRs in 30d
Description
Need to fix: The first plot the user sees in Tyra displays the average metric over test sets, rather than the metric for the test set at that given time.
For example, if you train a model through December 31, 2012, and then test that model on 2012, then 2013, then 2014, and finally 2015, the current implementation plots a point at January 1, 2015 (the start of the final test set) using the average value across those test sets.
The current implementation hides that nuance and reduces variance in performance.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.