脏数据导致任务失败
Open
- Dominant language
- Java
- Stars
- 17.4k
- Forks
- 5.7k
- PR merge metrics
- No merged PRs in 30d
Description
0. 使用的是rdbmsReader 2 mysqlWriter
1. rdbmsReader 通过querySql来取数据
2.执行过程中,**遇到脏数据**,突然报下面错误:
列配置信息有错误. 因为您配置的任务中,源头读取字段数:4 与 目的表要写入的字段数:53 不相等. 请检查您的配置并作出修改.
**表中已经成功插入部分数据**
这样的情况该怎么处理?
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no files or tests; start by tracing the rdbmsReader querySql path and mysqlWriter handling. Reproduce the dirty-data case while checking the source and target column counts and partial inserts. Done means the cause of the 4-versus-53 mismatch and the behavior of already inserted rows are explained and covered by a regression test.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, mysql
- Domain
- data-engineering, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100