bcgov / bcgov/bcdata_py

bc2pg - simplify

Open
#209 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
32
Forks
7
Avg merge
21h 3m
Merged PRs (30d)
15

Description

Data loads to existing postgres tables can be done via `bcdata dump | ogr2ogr`, a specific postgres loader isn't really required.

`bc2pg` could be stripped back to just table creation from the catalogue provided metadata:
- read schema from bcdc catalogue
- download a sample of the data
- create empty table based on combination of bcdc schema and data download
- add comments to columns/table
- do not attempt to track the primary keys

Maybe support providing a mapping of {"column_name": "column_type"} to override the detected types - but this is not a priority. Just guess the types / add comments and let the user alter the postgres table definition if any customization required.

Low priority as existing bc2pg works fine apart from minor noted issues - but for v1.0, simplifying makes sense.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.