AbsaOSS / AbsaOSS/EventGate

Add one more field into the job runs schema, for Atum measurements

未關閉
#169 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
enhancement
主要語言
Python
星號
4
分支
0
平均合併
1 天 5 小時
30 天內合併 PR
8

描述

### Feature Description

There is Atum Service: https://github.com/AbsaOSS/atum-service we use within our ecosystem to perform various metrics calculations against the processed data, such as record counts.

The EventGate is common integration point between our applications and can hold references to Atum measurements in the message; for this, we talked that the schema can be adjusted by creating a new field under the jobs, maybe `atum_measurements` or something like that.

This should be an optional field, basically a JSON, similar to `additional_info` which we did not selected for this because it can contain much more, and application-specific info. But the `atum_measurements` is relatively directed and well-formatted (the format is outside of the scope of this ticket and even EventGate).

### Problem / Opportunity

Being informed about the record counts / measurements on the jobs' messages side can provide insight for our customers and convenient, consistent usage.

### Acceptance Criteria

The job runs schema contains one more optional attribute for capturing atum measurements in some format.
Consider adding this into the PG DB for reference, same as `additional_info` attribute.

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。