AbsaOSS / AbsaOSS/enceladus

Improve INFO file metrics

未关闭
#392 0 条评论 0 个 reaction 已指派 1 人 已被 @yruslan 认领 在 GitHub 查看
Conformance feature priority: undecided Standardization under discussion
主要语言
Scala
星标
33
派生
16
PR 合并指标
30 天内没有已合并 PR

描述

## Background
Currently, INFO file metrics have the following meaning:

| Metric | Description |
| ---------- |:--------------- |
| `std_records_succeeded` | The number of records that **don’t have any errors** in the error column after running **Standardization**. |
| `std_records_failed` | The number of records that have **at least 1 error** in the error column after running **Standardization**. |
| `std_errors_count` | The number of errors in the error column after running **Standardization**. A record can have several errors so this number can be larger than `std_records_failed`. |
| `conform _records_succeeded` | The number of records that **don’t have any errors** in the error column after running **Standardization+Conformance**. |
| `conform _records_failed` | The number of records that have **at least 1 error** in the error column after running **Standardization+Conformance**. |
| `conform_errors_count` | The number of errors in the error column after running **Standardization+Conformance**. A record can have several errors so this number can be larger than `conform_records_failed`. |

The names are counter intuitive and need to be changed.

## Feature
Add metrics for error totals and change the semantics of the current metrics according to the following:

| Metric | Description |
| ---------- |:--------------- |
| `std_records_succeeded` | The number of records that **don’t have any Standardization errors** in the error column. |
| `std_records_failed` | The number of records that have **at least 1 Standardization error** in the error column. |
| `std_errors_count` | The total number of **Standardization** errors in the error column. |
| `conform _records_succeeded` | The number of records that **don’t have any Conformance errors** in the error column. |
| `conform _records_failed` | The number of records that have **at least 1 Conformance error** in the error column. |
| `conform_errors_count` | The number of **Conformance errors** in the error column. |
| `publish _records_succeeded` | The number of records that **don’t have ANY errors** in the error column after running **Standardization+Conformance**. |
| `publish _records_failed` | The number of records that have **at least 1 error** in the error column after running **Standardization+Conformance**. |
| `publish_errors_count` | The number of errors in the error column after running **Standardization+Conformance**. A record can have several errors so this number can be larger than `publish_records_failed`. |

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。