当同步的表数据在20亿以上时，channel大于1 时会报错
Open
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
我有一个mogno表，里面有25亿的数据，在从mongo全量同步数据到clickhouse时，channel设置大于1会报错。看源码应该是数据量过多超出了整形的长度限制，不止可有小伙伴碰到过此问题？
Contributor guide
No contributing guide indexed for this repository
Research direction
No source file, test, or entry point is named. Start by reproducing a full MongoDB-to-ClickHouse sync with more than 2 billion rows and channel greater than 1, then trace the reported integer overflow; done means the sync completes without the error at that scale.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- clickhouse, java, mongodb
- Domain
- data-engineering, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100