MoreCast: Model Data Purge
- Dominant language
- Python
- Stars
- 65
- Forks
- 11
- Avg merge
- 1d 2h
- Merged PRs (30d)
- 70
Description
**Describe the task**
Rachet down the `model_run_predictions` table to only contain Operational Data from the last 4 weeks.
**Acceptance Criteria**
- [ ] `pg_dump` prod database ignoring `model_run_predictions` table.
- [ ] `pg_dump` prod db `model_run_predictions` data for the past month in separate dump.
- [ ] Spin up new crunchydb cluster with pgv17 (and associated postgis verson compat with 16/17)
- [ ] import both data dump to new cluster.
- [ ] Repoint API/Jobs to new cluster
- [ ] Shutdown old cluster
**Additional context**
- Add any other context about the task here.
- Or here
Contributor guide
Research direction
No files or tests are named. Start by reviewing the acceptance criteria and the production database, API, and Jobs deployment configuration; confirm the dump scope, PostgreSQL 17/PostGIS compatibility, data import, service repointing, and old-cluster shutdown. Done means the new cluster serves the API and Jobs with only four weeks of model_run_predictions data and the old cluster is shut down.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- postgres, postgresql
- Domain
- backend, database, infrastructure
- Issue type
- Refactor
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100