dssg/tyra

View on GitHub

Prediction model evaluation

Stars: 4
Forks: 1
Open beginner issues: 0
Indexed issues: 46

Dominant language: JavaScript
License: No license data
Last GitHub push: Sep 22, 2017
Latest indexed: Sep 15, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Open All

46 open issues indexed

Remaining test graphs need to link to real data Open

dssg/tyra#18 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Remove evaluation codes from tyra when we have the repo for evaluation Open

dssg/tyra#28 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Fix install steps Open

dssg/tyra#36 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Create model comparison graph Open

dssg/tyra#38 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Model selection: grid of small per-model graphs Open

dssg/tyra#39 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Allow installations of Tyra to configure the graphs shown Open

dssg/tyra#40 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Implement more model ranking functions and make them customizable Open

dssg/tyra#41 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Graph showing effect of different training windows (same test) Open

dssg/tyra#42 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Be able to choose outcome label for model selection for newer db schema. Open

dssg/tyra#44 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add linting npm script Open

dssg/tyra#46 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Convert metrics over time to use model group and only use one as_of_date Open

dssg/tyra#48 · 0 comments · 0 reactions · 2 assignees · Indexed Sep 15, 2026
Switch default metric ranking to avg Open

dssg/tyra#49 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Remove duplication from get_model_groups Open

dssg/tyra#55 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Drawing full rectangle for zoom-in Open

dssg/tyra#65 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Tyra crashed suddenly and a restart causes this error Open

dssg/tyra#73 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Problem with capital feature names in the feature distribution graph Open

dssg/tyra#74 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Are the name of the configuration files hardcoded? Open

enhancement

dssg/tyra#78 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Link is broken in README Open

enhancement

dssg/tyra#80 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Instructions in README are misleading Open

enhancement

dssg/tyra#81 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
After running cache_table.sql... Open

bug

dssg/tyra#82 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Increase granularity of "precision and recall by threshold" plot Open

dssg/tyra#87 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Better handling for the materialized view Open

dssg/tyra#88 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add nginx support Open

dssg/tyra#90 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Fix first graph to show accuracy at time x rather than average accuracy over time x+t Open

dssg/tyra#92 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
It seems that Tyra always rank by avg, it doesn't care about the metric Open

bug

dssg/tyra#94 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
No Individual Feature Importance Plot Open

bug

dssg/tyra#95 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
No Feature Distribution Plot Open

bug

dssg/tyra#96 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Score distribution seems weird Open

bug

dssg/tyra#97 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Modify README with Docker instructions Open

dssg/tyra#99 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Make changes at the model input to be compatible with Audition Open

dssg/tyra#101 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Use lift := precision / baseline for inter-year averages and comparisons to compensate for changing baseline Open

enhancement

dssg/tyra#102 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
View for Between model: plot counts and sums per year Open

dssg/tyra#103 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Between model: rank-order correlation over time Open

dssg/tyra#104 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Between model: Jaccard similarity over time Open

dssg/tyra#105 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Between model: jaccard similarity Open

dssg/tyra#106 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Plot predicted vs true probabilities Open

dssg/tyra#107 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
View for within model: crosstabs Open

dssg/tyra#108 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Implement front-end testing Open

dssg/tyra#109 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Tyra compatibility check Open

dssg/tyra#110 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add reasonable default metrics or block user from hitting 'go' button before adding one Open

dssg/tyra#111 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Make not-yet-trustable evaluation dates dashed Open

dssg/tyra#112 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Plot jaccard similarities using thresholds from 0% to 100% Open

dssg/tyra#113 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Show KNN graph Open

dssg/tyra#114 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Upgrade jquery Open

dssg/tyra#115 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Dockerfile fails Open

dssg/tyra#116 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
update README for configuration Open

dssg/tyra#117 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026

dssg/tyra

Get new issues in your inbox