dssg / dssg/tyra

Fix first graph to show accuracy at time x rather than average accuracy over time x+t

Open
#92 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
4
Forks
1
PR merge metrics
No merged PRs in 30d

Description

Need to fix: The first plot the user sees in Tyra displays the average metric over test sets, rather than the metric for the test set at that given time.

For example, if you train a model through December 31, 2012, and then test that model on 2012, then 2013, then 2014, and finally 2015, the current implementation plots a point at January 1, 2015 (the start of the final test set) using the average value across those test sets.

The current implementation hides that nuance and reduces variance in performance.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.