debezium / debezium/dbz

new snapshot, where it snap db schema and start from the beginning of binlog [DBZ-3583]

Open
#466 0 comments 0 reactions 0 assignees View on GitHub
component/mysql-connector migrated-from-jira type/enhancement
Dominant language
HTML
Stars
6
Forks
9
Avg merge
2d 19h
Merged PRs (30d)
1

Description

Migrated from [DBZ-3583](https://issues.redhat.com/browse/DBZ-3583)

When our db cluster do SST, binlog are reset so there are no longer available and debezium fail to read new one, and we must fully reset him including topic, or change offset in kafka offset topic which in our environment include two admin team (one for kafka and one for db and debezium) and our team and it is time consuming operation.
So are request is for snapshot mode, where it perform database scheme snapshot and than start reading from the first available binlog and position or some other solution how easily on run change reading binlog file and his offset/position.

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named in the issue. Start by tracing how snapshot mode and binlog offsets are handled, then assess the requested SST-reset scenario. Done should provide a way to snapshot the database schema and resume from the first available binlog position without manually resetting topics or Kafka offsets.

Written by the indexing model from the issue text.

Assessment

Tech stack
kafka
Domain
databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.