alibaba / alibaba/DataX

为什么rdbms的单表读split方式是channel数量乘以5?

Open
#658 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

我在优化datax抽取mysql数据的时候,并不能特别的理解task的数量
如下是 ReaderSplitUtil的切分实现,为什么这里是乘以5,5是经验值吗?还是有什么特殊的意义?
------------
`eachTableShouldSplittedNumber = eachTableShouldSplittedNumber * 5;`
------------

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading ReaderSplitUtil and the surrounding task-splitting logic, focusing on the eachTableShouldSplittedNumber = eachTableShouldSplittedNumber * 5 line. Determine the rationale for the multiplier and whether it is an empirical value, then record the confirmed explanation in the appropriate documentation.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
databases
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.