eclipse-tractusx / eclipse-tractusx/sig-release

Priority-Based Data Processing for Golden Record

Open
#856 13 comments 0 reactions 2 assignees Claimed by @jupakajo View on GitHub
bpdm Prep-R25.03
Dominant language
Go
Stars
12
Forks
10
PR merge metrics
No merged PRs in 30d

Description

## Description

The golden record service should prioritize data sets based on predefined criteria to ensure timely and fair processing. This feature will enable the system to handle data sets with varying urgency and importance, ensuring that critical data is processed promptly while maintaining fairness across different sharing members.

### Key Scenarios

**Portal Registration Priority:**

Data sets submitted via the portal should be processed with higher priority to ensure the Business Partner Number (BPNL) is available quickly.

**Fair Share of Processing:**

When multiple sharing members submit data sets, the system should ensure that smaller batches of data are not delayed excessively by larger batches. This ensures fair processing time for all members.

**SLA-Based Priority:**

Data sets should be prioritized based on Service Level Agreements (SLAs). If a data set has been waiting for a significant amount of time and is nearing its SLA deadline, it should be automatically elevated in priority.

### Implementation Details

**Priority Definition:**

- Introduce a priority attribute for data sets.
- Priority levels can be defined as High, Medium, and Low.

**Priority Assignment:**

- Portal Registration: Assign High priority to data sets submitted via the portal.
- Fair Share of Processing: Implement a round-robin or weighted round-robin algorithm to ensure fair processing across different sharing members.
- SLA Consideration: Monitor the waiting time of data sets and adjust their priority based on SLA deadlines.

**Processing Logic:**

- Modify the golden record service to check the priority attribute before processing data sets.
- Implement a queue management system that dynamically adjusts the order of data sets based on their priority.

**SLA Monitoring:**

- Introduce a monitoring mechanism to track the waiting time of each data set.
- Automatically elevate the priority of data sets that are approaching their SLA deadline.

## Additional information

Contribution will be done by @dilipdhankecha2530
Committer to support this will be @SujitMBRDI / @nicoprow / @maximilianong

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.