Update pipeline to support Financial Institution Change of Directors
- Dominant language
- JavaScript
- Stars
- 23
- Forks
- 62
- Avg merge
- 24m
- Merged PRs (30d)
- 1
Description
This ticket is to update the pipeline to support Financial Institution Change of Directors.
This will include:
* Updating raw sql queries to pull in required data from COBRS db extract
* Updating code to generating filing json for given filing
* Update custom filer code to process generated filing json
* Testing pipeline against a decent sample size to see what errors come up
When updating the pipeline to support a given filing, the initial testing will be done locally against a COBRS db extract.
In our overall migration testing, all migration of prod COBRS corp data will be tested. Under this comprehensive testing, various data issues and edge cases will be discovered for various filings. We will cut tickets at this time to address the issues that come up.
NOTE: Before data can be loaded into an environment, there must be a robust facility to delete that data from the environment into which it was loaded.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the raw SQL queries, filing JSON generation code, and custom filer code involved in the pipeline. Use a local COBRS database extract for initial testing, then test against a meaningful sample of Financial Institution Change of Directors filings and confirm the pipeline handles the resulting errors and data deletion requirements.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- flask, javascript, postgres, python, sql
- Domain
- backend, data-engineering, database
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100