alibaba / alibaba/DataX

odps->ads迁移时能否设置只迁移指定量的数据

Open
#542 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

如题,由于数据量太大,导致一次迁移任务耗时太久。故,能否或者如何在job里配置只迁移指定数量的数据条数

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the ODPS-to-ADS migration job configuration and its data-transfer entry points. Check whether a row-count limit is already supported or documented, then define and verify the expected behavior for a configured maximum. Done means a job can migrate only the requested number of rows without affecting other migration settings.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.