AbsaOSS / AbsaOSS/pramen

Make sure `disable.count.query = true` does not change the behavior of ingestion

Open
#539 1 comment 0 reactions 0 assignees View on GitHub
arguable enhancement
Dominant language
Scala
Stars
31
Forks
4
Avg merge
1d 10m
Merged PRs (30d)
4

Description

## Background
Currently, when
```hocon
disable.count.query = true
```

a table is considered successfully loaded even if it does not have data for the current date. This is because the count check is skipped.

## Feature
Make sure `disable.count.query = true` does not change the behavior of ingestion.

## Example [Optional]
--

## Proposed Solution [Optional]
The correct behavior is the same as the one when `disable.count.query = false`. If the number of records is 0 and empty tables are considered 'no data', the the record of data should not be written to the bookkeeping table.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.