AbsaOSS / AbsaOSS/enceladus

Track runs and their metrics for streaming jobs (Atum)

Ouverte
#1,166 0 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Conformance feature priority: undecided under discussion
Langage dominant
Scala
Étoiles
33
Forks
16
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

## Background
Currently, run objects are created for each batch job. Atum control measurements are made only for batch jobs as well.

## Feature
Need to decide how to track runs and control metrics for:
- Stream to batch ingestion + conformance (Hyperdrive)
- Stream to stream ingestion + conformance (Hyperdrive as well?)

```diff
- This task should be amended with a detailed design.
```

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.