cmu-delphi / cmu-delphi/forecast-eval

Provide backup data if loading from S3 is slow

Open
#269 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
R
Stars
6
Forks
3
PR merge metrics
No merged PRs in 30d

Description

Occasionally it takes a _really_ long time (1 min vs the normal 15-20s) to load input data from the S3 bucket. This problem can be seen in both staging and public dashboards at the same time, which indicates that it is an AWS or network problem rather than a bug in our code. Can [load fallback data](https://github.com/cmu-delphi/forecast-eval/blob/dev/app/R/data.R#L54) if directly loading from AWS takes longer than [x] seconds.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in app/R/data.R around line 54, where input data is loaded directly from AWS. Trace the loading path and determine how the fallback data is currently made available. Done means slow AWS loads use fallback data after an agreed timeout while normal loads continue to work.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, r
Domain
cloud, data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.