alibaba / alibaba/DataX

脏数据导致任务失败

Open
#257 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

0. 使用的是rdbmsReader 2 mysqlWriter
1. rdbmsReader 通过querySql来取数据
2.执行过程中,**遇到脏数据**,突然报下面错误:
列配置信息有错误. 因为您配置的任务中,源头读取字段数:4 与 目的表要写入的字段数:53 不相等. 请检查您的配置并作出修改.
**表中已经成功插入部分数据**
这样的情况该怎么处理?

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files or tests; start by tracing the rdbmsReader querySql path and mysqlWriter handling. Reproduce the dirty-data case while checking the source and target column counts and partial inserts. Done means the cause of the 4-versus-53 mismatch and the behavior of already inserted rows are explained and covered by a regression test.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.