Stateful data checks for ingestion and other types of jobs
Open
DE
DS
enhancement
Pramen-Scala
- Dominant language
- Scala
- Stars
- 31
- Forks
- 4
- Avg merge
- 1d 10m
- Merged PRs (30d)
- 4
Description
## Background
TBD
## Feature
Stateful data checks for ingestion and other types of jobs
## Example
- Check that the number of records in the ingested snapshot today does not deviate too much from the one ingested for the previous day
- Similar checks for transformers and sinks
## Proposed Solution
- Should be configuration-only solution
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.