pingcap / pingcap/ticdc

fetch data from tikv every time after resuming the changefeed even though subscribe the same table

Open
#1,388 0 comments 0 reactions 1 assignee View on GitHub

@lidezhu is already working on this.

Since May 30, 2025.

Dominant language
Go
Stars
56
Forks
63
Avg merge
2d 20h
Merged PRs (30d)
34

Description

Run the following steps:

  1. deploy one ticdc node.
  2. create 4 changefeeds, all subscribe all tables, no filter set.
  3. pause the changefeed
  4. run the workload, write in a lot of data to trigger incremental scan
  5. resume changefeed one by one.

Image

Image
From images above we can know that after each changefeed resumed, all triggers incremental scan tasks.

Since all tables share the same, those data should can be shared, to reduce the cost on fetch data from tikv and write into the local disk storage.

Only fetch data after resume the first changefeed is expected

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.