datax任务完成后,任务信息打印问题
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
我是datax跑一个表的同步任务,发现任务完成后,到打印任务统计信息打印,中间隔了10s,这个是因为什么,有什么办法减少这个时间了吗,日志信息如下
2024-03-07 15:18:47.243 [taskGroup-0] INFO TaskGroupContainer - taskGroup[0] completed it's tasks.
2024-03-07 15:18:56.942 [job-0] INFO StandAloneJobContainerCommunicator - Total 32 records, 4000 bytes | Speed 400B/s, 3 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.000s | All Task WaitReaderTime 0.000s | Percentage 100.00%
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing the logged transition from TaskGroupContainer to StandAloneJobContainerCommunicator using the timestamps in the report. Determine what causes the roughly 10-second gap, then verify the result with a comparable DataX table-synchronization run; done means the delay is explained and any reduction is demonstrated.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100