alibaba / alibaba/DataX

writer的presql在reader报错时仍然可以执行

Open
#2,256 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

例如配置从某数据源提取数据写入mysql,writer的presql配置为truncate table;当reader报错时,presql仍然会执行,而不是reader执行完后再执行writer

Contributor guide

No contributing guide indexed for this repository

Research direction

No files or tests are identified. Trace DataX's reader and writer execution flow, focusing on when the writer's preSQL is invoked relative to reader failure. Done means a reader error no longer allows the writer preSQL to execute prematurely, with the intended ordering covered by a regression test.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, sql
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.