alibaba / alibaba/DataX

splitFactor阈值设定

Open
#2,063 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

源码当中,这个阈值是Job维度的,一个Job下可能有多个conns,有的conn下表数据量大,有的小,阈值怎么设定?支持数据源级别的阈值配置吗?

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue identifies only the Job-level splitFactor threshold and does not name a file, test, or entry point. Start by locating where splitFactor is configured and applied across Jobs and connections, then determine whether datasource-level configuration is supported. Done requires an agreed configuration behavior that handles connections with different table sizes.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.