Track runs and their metrics for streaming jobs (Atum)
Offen
Conformance
feature
priority: undecided
under discussion
- Vorherrschende Sprache
- Scala
- Sterne
- 33
- Forks
- 16
- PR-Merge-Kennzahlen
- Keine gemergten PRs in 30 T.
Beschreibung
## Background
Currently, run objects are created for each batch job. Atum control measurements are made only for batch jobs as well.
## Feature
Need to decide how to track runs and control metrics for:
- Stream to batch ingestion + conformance (Hyperdrive)
- Stream to stream ingestion + conformance (Hyperdrive as well?)
```diff
- This task should be amended with a detailed design.
```
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.