alibaba / alibaba/cobar

丢数据啊,丢数据

Open
#72 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
3.2k
Forks
1.2k
PR merge metrics
No merged PRs in 30d

Description

用datax倒cobar的数据时候,出现丢数据的情况。
我们现在5个分片。量级在2000多万。
走cobar的话,出现丢数据的情况,直接走mysql实例不存在丢的情况。
测试的时候发现,如果数据量过亿的话,倒到后面直接没反应了。貌似是超时断掉了。

Contributor guide

Open the contributing guide

Research direction

Reproduce the transfer through Cobar with five shards, comparing it with a direct MySQL transfer at more than 20 million rows. Investigate the reported missing rows and the apparent timeout or hang beyond 100 million rows; done means transfers complete without loss and the results match the source.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
databases, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.