alibaba / alibaba/DataX

任务没有缘由hung住

Open
#1,056 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

任务由Hive导入数据至Hbase。数据量在50G-500G, 导入过程中会不明原因出现任务hung住。且不仅是一个任务, 当数据量较大的时候就可能出现任务hung住,并且增加执行内存也不能解决问题。

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing a large Hive-to-HBase import in the 50G–500G range and record where the task stops responding. The issue names no files, tests, logs, or entry points, so identify the relevant DataX reader and writer paths before investigating. Done means the hang is reproduced and its cause and corrective scope are documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, databases
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.