bcgov / bcgov/alcs

ETL C&E Production Data

Open
#2,672 0 comments 0 reactions 0 assignees View on GitHub
Ready Task
Dominant language
TypeScript
Stars
10
Forks
0
Avg merge
20h 8m
Merged PRs (30d)
30

Description

Run the ETL on C&E production data!

@ancharb to cut off NRIS updates and pull the final copy of the data, attach to ticket
- Reminder: we are not importing Status = INCOMPLETE so remind users to complete their drafts before import

**Acceptance Criteria**
- Make sure NRIS data file numbers haven't passed our minimum sequence value (set to 300k in #2660)
- run the ETL to get the latest copy of production data into the production schema

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing issue #2660 for the 300k minimum sequence value and the repository's ETL entry point; no file or test is named in this issue. Confirm the final NRIS data copy is attached, incomplete records are excluded, sequence numbers meet the minimum, and the latest production data is loaded into the production schema.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
data-engineering, database
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.