alibaba / alibaba/DataX

mysql-mysql在并发模式下异常会导致数据缺失

Open
#1,223 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

问题描述: 从MySQL复制到MySQL,配置为5个channel,如果突然网络中断(中断持续到数据库释放了链接),此时全量同步的程序终止;改用基于ID的增量复制补数据,然后得到的最大id不正确,最终导致数据不完整。

请问大佬们,这种问题有招么?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by examining DataX's MySQL-to-MySQL path for five-channel concurrent synchronization and its handling of network interruption during full sync. Reproduce the failure where full sync stops, then compare the ID-based incremental recovery result with the source's maximum ID; done means recovery does not leave data incomplete.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
databases, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.