ULC/CCC/BC pipeline - update to support Amend Registered and Records Office
- Dominant language
- JavaScript
- Stars
- 23
- Forks
- 62
- Avg merge
- 24m
- Merged PRs (30d)
- 1
Description
This ticket is to update the pipeline to support Amend Registered and Records Office.
This will include:
* Updating raw sql queries to pull in required data from COLIN db extract
* Updating code to generating filing json for given filing
* Update custom filer code to process generated filing json
* Testing pipeline against a decent sample size to see what errors come up
When updating the pipeline to support a given filing, the initial testing will be done locally against a COLIN db extract. We can test with a smaller but significant sample size of fillings to have a certain level of confidence that the pipeline is working in general for a given filing.
In our overall migration testing, all migration of prod COLIN corp data will be tested. Under this comprehensive testing, various data issues and edge cases will be discovered for various filings. We will cut tickets at this time to address the issues that come up.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the raw SQL queries against the COLIN database extract, then trace filing JSON generation and the custom filer processing path. Test locally with a smaller representative sample of Amend Registered and Records Office filings; done means the pipeline handles the sample and errors are identified for follow-up.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- sql
- Domain
- data-engineering, database
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100