cmu-delphi/forecast-eval

View on GitHub

delphi.cmu.edu/forecast-eval

Stars: 6
Forks: 3
Open beginner issues: 0
Indexed issues: 38

Dominant language: R
License: MIT
Last GitHub push: Jan 24, 2025
Latest indexed: Sep 15, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue
PR merge metrics: No merged PRs in 30d

Open All

38 open issues indexed

Include county level data? Open

blocked

cmu-delphi/forecast-eval#33 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Include new tabbed sections Open

enhancement

cmu-delphi/forecast-eval#35 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Switch data pipeline from scraping forecasthub github web pages to using zoltar API Open

data-pipeline

cmu-delphi/forecast-eval#64 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Take advantage of as-of functionality in Zoltar API for forecasts Open

data-pipeline enhancement

cmu-delphi/forecast-eval#65 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Prediction cards: Memory and runtime optimization Open

data-pipeline

cmu-delphi/forecast-eval#73 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Consider tracking inclusion on a per-forecast basis Open

data-pipeline

cmu-delphi/forecast-eval#74 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add a checkbox to aggregate/average over all horizons Open

enhancement

cmu-delphi/forecast-eval#123 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
retool exclusion criteria for location overlap Open

cmu-delphi/forecast-eval#151 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Forecasters with multiple forecasts for same target date with same score failing on tsibble key/index selection Open

bug

cmu-delphi/forecast-eval#157 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
NA plot shows up when show forecasts checkbox checked with certain forecasters selected Open

bug

cmu-delphi/forecast-eval#160 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Truth plot does not reappear when it should for certain forecaster Open

bug

cmu-delphi/forecast-eval#161 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Include uncertainty bands for forecasts with 20% and 80% predictions Open

enhancement

cmu-delphi/forecast-eval#167 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Idea/v2 for alternate way of showing "as of" data Open

enhancement

cmu-delphi/forecast-eval#168 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
consider changing data logic Open

enhancement

cmu-delphi/forecast-eval#174 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
consider changing tabbing Open

enhancement

cmu-delphi/forecast-eval#175 · 5 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Allow As Of selection by clicking on evaluation plot Open

enhancement

cmu-delphi/forecast-eval#189 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Use error measure fns from `evalcast` Open

good first issue

cmu-delphi/forecast-eval#247 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Add influenza hospitalization forecast evaluations to the dashboard and pipeline Open

data-pipeline enhancement

cmu-delphi/forecast-eval#249 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Combine dashboards/forecast evals with the generalized hub-building infrastructure Reich Lab has built Open

enhancement

cmu-delphi/forecast-eval#251 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Data downloading fails if score type is coverage or if summarizing across multiple locations Open

good first issue

cmu-delphi/forecast-eval#255 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Save output as CSV, and read and write using `data.table` Open

enhancement good first issue

cmu-delphi/forecast-eval#262 · 5 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Set max as-of data possible to select for cases/deaths in dashboard Open

cmu-delphi/forecast-eval#263 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Drop unused county hospitalization aheads early in pipeline instead of in dashboard Open

enhancement

cmu-delphi/forecast-eval#264 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Turn discussion of various pipeline and dashboard improvements into issues Open

documentation good first issue

cmu-delphi/forecast-eval#265 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Restore target variable selection when changing from and then back to the archive tab Open

good first issue

cmu-delphi/forecast-eval#268 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Provide backup data if loading from S3 is slow Open

enhancement

cmu-delphi/forecast-eval#269 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Consider caching old common location set to check if we should rerender the truth plot, instead of using an observer Open

cmu-delphi/forecast-eval#272 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Consider defining `USE_CURR_TRUTH` as a `reactive` Open

good first issue

cmu-delphi/forecast-eval#273 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Specify disease in target variable text Open

good first issue

cmu-delphi/forecast-eval#275 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Consider making `plotly` plot directly instead of converting from `ggplot` plot Open

enhancement

cmu-delphi/forecast-eval#276 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Make tool that lets us run specific dashboard components in an automated way (for profiling) Open

enhancement

cmu-delphi/forecast-eval#278 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Consider merging the `covidcast-docker` repo into this repo Open

enhancement

cmu-delphi/forecast-eval#279 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Makefile `r_build` target is sometimes used inappropriately Open

bug

cmu-delphi/forecast-eval#280 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Trigger `covidcast-docker` image build automatically Open

enhancement

cmu-delphi/forecast-eval#281 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Remove, revise, or replace `start_dev` target Open

cmu-delphi/forecast-eval#283 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Potentially make a continuously updating version of #290 Open

enhancement

cmu-delphi/forecast-eval#291 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Last created plot is reused on dashboard refresh Open

bug

cmu-delphi/forecast-eval#304 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Automatic filtering down to only shared states should be togglable Open

cmu-delphi/forecast-eval#310 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

cmu-delphi/forecast-eval

Get new issues in your inbox