AbsaOSS / AbsaOSS/enceladus

Improve INFO file metrics

Đang mở
#392 0 bình luận 0 reaction 1 người được giao Được @yruslan nhận Xem trên GitHub
Conformance feature priority: undecided Standardization under discussion
Ngôn ngữ chính
Scala
Star
33
Fork
16
Chỉ số merge pull request
Không có pull request nào được merge trong 30 ngày

Mô tả

## Background
Currently, INFO file metrics have the following meaning:

| Metric | Description |
| ---------- |:--------------- |
| `std_records_succeeded` | The number of records that **don’t have any errors** in the error column after running **Standardization**. |
| `std_records_failed` | The number of records that have **at least 1 error** in the error column after running **Standardization**. |
| `std_errors_count` | The number of errors in the error column after running **Standardization**. A record can have several errors so this number can be larger than `std_records_failed`. |
| `conform _records_succeeded` | The number of records that **don’t have any errors** in the error column after running **Standardization+Conformance**. |
| `conform _records_failed` | The number of records that have **at least 1 error** in the error column after running **Standardization+Conformance**. |
| `conform_errors_count` | The number of errors in the error column after running **Standardization+Conformance**. A record can have several errors so this number can be larger than `conform_records_failed`. |

The names are counter intuitive and need to be changed.

## Feature
Add metrics for error totals and change the semantics of the current metrics according to the following:

| Metric | Description |
| ---------- |:--------------- |
| `std_records_succeeded` | The number of records that **don’t have any Standardization errors** in the error column. |
| `std_records_failed` | The number of records that have **at least 1 Standardization error** in the error column. |
| `std_errors_count` | The total number of **Standardization** errors in the error column. |
| `conform _records_succeeded` | The number of records that **don’t have any Conformance errors** in the error column. |
| `conform _records_failed` | The number of records that have **at least 1 Conformance error** in the error column. |
| `conform_errors_count` | The number of **Conformance errors** in the error column. |
| `publish _records_succeeded` | The number of records that **don’t have ANY errors** in the error column after running **Standardization+Conformance**. |
| `publish _records_failed` | The number of records that have **at least 1 error** in the error column after running **Standardization+Conformance**. |
| `publish_errors_count` | The number of errors in the error column after running **Standardization+Conformance**. A record can have several errors so this number can be larger than `publish_records_failed`. |

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.