alibaba / alibaba/DataX

datax 写入oceanbase 4.2.5 errorlimit 策略配置为record:0不生效

Open
#2,337 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
17.4k
Forks
5.7k
PR merge metrics
No merged PRs in 30d

Description

datax 202309版本,在写OceanBase 4.2.5时。配置了脏数据退出策略,"errorLimit": {"record": 0,"percentage": 0.00001},遇到目标库字段长度不足时,不抛异常退出,会一直执行。

关键日志,详见截图

![Image](https://github.com/user-attachments/assets/d1d6fa9c-2c77-4a95-b359-2dd791ddcdf5)
![Image](https://github.com/user-attachments/assets/aeb414b1-bada-49e7-9aa7-6c4f2185a5ba)
![Image](https://github.com/user-attachments/assets/b674a1aa-14a0-4eaf-a725-f1ca9a11d545)
![Image](https://github.com/user-attachments/assets/17f8465a-3d64-400d-bcd5-3bb73394d4f8)

Contributor guide

No contributing guide indexed for this repository

Research direction

No source file or test is named. Reproduce the DataX 202309 job against OceanBase 4.2.5 with errorLimit record:0 and a value exceeding the target column length, then inspect the logs and the error-limit handling path. Done means the job raises an exception and exits after the first dirty record.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.