重复数据问题
Open
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
为何不管是单线程同步还是多线程分割同步，数据量1000万左右时总是有重复数据出现呢？
我读取的表可是复制出来的静态数据表
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing the issue with the reported static table and roughly 10 million rows, using both single-threaded and multithreaded synchronization. Compare the resulting records and execution details to identify where duplicates are introduced; done means locating the cause and confirming that both synchronization modes no longer produce duplicate data.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100