debezium / debezium/dbz

Add conditional snapshot support to Vitess connector

Open
#1,511 0 comments 0 reactions 0 assignees View on GitHub
component/vitess-connector type/enhancement
Dominant language
HTML
Stars
6
Forks
8
Avg merge
2d 19h
Merged PRs (30d)
1

Description

## Feature request or enhancement

**Which use case/requirement will be addressed by the proposed feature?**

Add conditional snapshot support to the Vitess connector, allowing users to snapshot a subset of data rather than the full table.

This is useful for:
- Backfilling data gaps after a service incident without re-ingesting full history
- Snapshotting only recent data for large tables

---

**Implementation ideas (optional)**

Two approaches:

1. **Start copy from a specific PK** (e.g., `id > 1000000`)
- Use VStream's `table_p_ks` in the VGTID to specify the starting point
- This would be a Vitess-specific feature

2. **Filter with WHERE clauses** (e.g., `created_at > '2024-01-01'`)
- VStream already supports this natively; just needs config exposure in the connector

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.