CDC cluster takes very long time to initialize when there are huge number tables upstream.
Open
@hongyunyan is already working on this.
Since Mar 27, 2025.
severity/moderate
type/bug
- Dominant language
- Go
- Stars
- 56
- Forks
- 63
- Avg merge
- 2d 20h
- Merged PRs (30d)
- 34
Description
After creating 10 million tables upstream, the CDC cluster was restarted. It took about 20 minutes for the CDC cluster to complete the initialization.
The initialization speed of the CDC cluster should be independent of the scale of the upstream cluster. This is because if no changefeed is created, the CDC cluster doesn't need to load the schema information from the upstream.
CDC Version
Release Version: v9.0.0-alpha-185-gb3c5be2a
Git Commit Hash: b3c5be2a5565c111a4babfe10b5b7f3bfb87da74
Git Branch: master
UTC Build Time: 2025-03-27 03:10:59
Go Version: go version go1.23.4 darwin/arm64
Failpoint Build: false
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.