LukePrior / LukePrior/nbn-upgrade-map

Consider more lightweight DB system

Open
#268 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Python
Stars
222
Forks
28
Avg merge
1m
Merged PRs (30d)
2

Description

Following on from the work in https://github.com/LukePrior/nbn-upgrade-map/issues/255

Ideas for reducing the size of the DB. Perhaps it's time to consider:

  • using something more lightweight than postgresql: maybe sqllite, compressed and readonly
  • maybe stored in filesystem rather than docker image
  • preprocessing the DB into a format more specific to the application (there's only 1 main query)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading issue #255 and the current database setup to understand the existing PostgreSQL deployment and its size. Compare the proposed SQLite, compressed read-only, filesystem, and application-specific formats; done means agreeing on and documenting a smaller approach that still supports the main query.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, postgresql, sqlite
Domain
databases, infrastructure
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.