bcgov / bcgov/entity

ULC/CCC/BC pipeline - data mapping analysis for agm extension

Open
#22,448 0 comments 0 reactions 0 assignees View on GitHub
Entities - Data Migration
Dominant language
JavaScript
Stars
23
Forks
62
Avg merge
24m
Merged PRs (30d)
1

Description

This ticket is used to analyze whether we have the required tables and data in the COLIN db extract(postgres) and LEAR db to start updating the corps data pipeline to bring over agm extensions for corps.

- [ ] Determine if COLIN db extracts all relevant data for filing that need to make it into LEAR db. Reference [data mapping\(COLIN  LEAR\) doc](https://docs.google.com/spreadsheets/d/1kTumSX59lp72kD6GdYLufn3nXAD1PA4E/edit?gid=1604073602#gid=1604073602) as starting point. May need to talk with David Roberts if there are questions about data mapping doc or COLIN specific questions.
- [ ] Determine if LEAR db supports all the data from COLIN db extract
- [ ] Cut tickets as required based off of analysis done in this ticket.
Potential tickets may include:
* Update COLIN db extract script to pull missing data
* Update LEAR db and/or code to support data being pulled over from COLIN db extract

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the COLIN–LEAR data mapping document and compare the COLIN PostgreSQL extract with the LEAR database support for AGM extension filings. Record missing source or destination data and use the findings to define follow-up tickets for extract, database, or pipeline changes.

Written by the indexing model from the issue text.

Assessment

Tech stack
postgres
Domain
data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.