debezium / debezium/dbz

Reduce frequency of data dictionary build steps for redo_log_catalog strategy [DBZ-8978]

Open
#1,356 0 comments 0 reactions 0 assignees View on GitHub
component/oracle-connector migrated-from-jira type/enhancement
Dominant language
HTML
Stars
6
Forks
8
Avg merge
2d 19h
Merged PRs (30d)
1

Description

Migrated from [DBZ-8978](https://issues.redhat.com/browse/DBZ-8978)

In all LogMiner implementations, we know the current list of logs and what of those will be mined on the next iteration. We should look into whether we can inspect the current log list that include or come after the low watermark SCN and if those logs have the dictionary begin/end markers set to Yes. If both markers exist, that means the entire data dictionary is present, and we could theoretically skip the next build step.

This has several advantages, which include:

- Less log switches generated by the redo_log_catalog strategy
- Better stability with the redo_log_catalog strategy with multi-connector deployments
- Faster mining session start-ups reading fewer dictionary extracts

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.