bcgov / bcgov/foi-flow

ECGROUPS AXIS ETL package is failing on PRODUCTION, TEST

Open
#4,567 0 comments 0 reactions 0 assignees View on GitHub
bug Data Infrastructure production
Dominant language
Python
Stars
8
Forks
2
Avg merge
14h 34m
Merged PRs (30d)
46

Description

**Describe the bug in current situation**
Need to RCA and fix the issue happening with below ETL. Seems like Groups got updated on AXIS and its causing a FOREIGN KEY violation.

[Private Zenhub Image](https://api.zenhub.com/attachedFiles/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBK01PQVE9PSIsImV4cCI6bnVsbCwicHVyIjoiYmxvYl9pZCJ9fQ==--18222f845ab0fde98fc8d86facb1d222702857f4/image.png)

**Link bug to the User Story**

**Impact of this bug**
Performance Dashboard might have affected, need to do complete RCA and Impact analysis. Not all reports will be affected

**Chance of Occurring (high/medium/low/very low)**

**Pre Conditions: which Env, any pre-requesites or assumptions to execute steps?**

**Steps to Reproduce**
Steps to reproduce the behavior:
1. Go to ETL JOB HISTORY on Tikal. SSIS Catalogue
2. Click on the execution history/report tab of the ECGROUPS
3.[Private Zenhub Image](https://api.zenhub.com/attachedFiles/eyJfcmFpbHMiOnsibWVzc2FnZSI6IkJBaHBBK1VPQVE9PSIsImV4cCI6bnVsbCwicHVyIjoiYmxvYl9pZCJ9fQ==--adee2d17e9971755d45e9ffbea855c49f0f28343/image.png)

4. See error

**Actual/ observed behaviour/ results**

**Expected behaviour**
A clear and concise description of what you expected to happen. Use the gherking language.

**Screenshots/ Visual Reference/ Source**
If applicable, add screenshots to help explain your problem. You an use screengrab.

Contributor guide

Open the contributing guide

Research direction

Start in Tikal's ETL JOB HISTORY and the SSIS Catalogue by opening the ECGROUPS execution history for the PRODUCTION and TEST failures. Trace the reported foreign-key violation and document the affected dashboard or reports; done means the ECGROUPS ETL completes successfully in both environments and the impact analysis is recorded.

Written by the indexing model from the issue text.

Assessment

Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.