alibaba / alibaba/DataX

datax任务完成后,任务信息打印问题

Open
#2,069 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

我是datax跑一个表的同步任务,发现任务完成后,到打印任务统计信息打印,中间隔了10s,这个是因为什么,有什么办法减少这个时间了吗,日志信息如下
2024-03-07 15:18:47.243 [taskGroup-0] INFO TaskGroupContainer - taskGroup[0] completed it's tasks.
2024-03-07 15:18:56.942 [job-0] INFO StandAloneJobContainerCommunicator - Total 32 records, 4000 bytes | Speed 400B/s, 3 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 100.00%

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing the logged transition from TaskGroupContainer to StandAloneJobContainerCommunicator using the timestamps in the report. Determine what causes the roughly 10-second gap, then verify the result with a comparable DataX table-synchronization run; done means the delay is explained and any reduction is demonstrated.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.