alibaba / alibaba/DataX

同步完成后的记录数汇报有误

Open
#541 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

同步一张大数据量的表后(耗时40分钟左右以上),接下来几次同步的记录数汇报都出现不准确的情况。如下:耗时61s,实际同步的数据是1000条。
![image](https://user-images.githubusercontent.com/34637592/70961531-03a0d080-20bd-11ea-813d-8af8043a59b8.png)

Contributor guide

No contributing guide indexed for this repository

Research direction

No source file, test, or entry point is named in the issue. Reproduce synchronization of a large table, then inspect the record-count reporting path across the subsequent syncs and compare reported counts with the actual 1,000-row result. Done means counts remain accurate after a long-running sync.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.