alibaba / alibaba/DataX

接入的时候有时候会卡住,任务不会结束。如何解决?

Open
#805 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

Total 292832 records, 40401132 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 5.284s | All Task WaitReaderTime 39.885s | Percentage 0.00%
2020-08-23 20:46:19.518 [job-0] INFO StandAloneJobContainerCommunicator - Total 292832 records, 40401132 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 5.284s | All Task WaitReaderTime 39.885s | Percentage 0.00%
2020-08-23 20:46:29.518 [job-0] INFO StandAloneJobContainerCommunicator - Total 292832 records, 40401132 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 5.284s | All Task WaitReaderTime 39.885s | Percentage 0.00%
2020-08-23 20:46:49.519 [job-0] INFO StandAloneJobContainerCommunicator - Total 292832 records, 40401132 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 5.284s | All Task WaitReaderTime 39.885s | Percentage 0.00%
2020-08-23 20:47:09.520 [job-0] INFO StandAloneJobContainerCommunicator - Total 292832 records, 40401132 bytes | Speed 0B/s, 0 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 5.284s | All Task WaitReaderTime 39.885s | Percentage 0.00%

一直执行几天都是这种日志。完全卡住了

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the ingestion task described in the issue and inspect the repeated StandAloneJobContainerCommunicator output, especially the reader and writer wait times. The issue provides no file, test, configuration, or entry point; done would mean identifying why the task stops progressing and confirming that the affected task completes normally.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.