Track runs and their metrics for streaming jobs (Atum)
Aperta
Conformance
feature
priority: undecided
under discussion
- Lingua principale
- Scala
- Stelle
- 33
- Fork
- 16
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
## Background
Currently, run objects are created for each batch job. Atum control measurements are made only for batch jobs as well.
## Feature
Need to decide how to track runs and control metrics for:
- Stream to batch ingestion + conformance (Hyperdrive)
- Stream to stream ingestion + conformance (Hyperdrive as well?)
```diff
- This task should be amended with a detailed design.
```
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.